-- Logs begin at Thu 2022-05-19 14:11:11 UTC, end at Thu 2022-05-19 15:23:35 UTC. -- May 19 14:50:27.745895 dv-cinder-825492-12-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 19 14:50:27.754330 dv-cinder-825492-12-iscsi devstack@keystone.service[80147]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 19 14:50:27.756498 dv-cinder-825492-12-iscsi devstack@keystone.service[80147]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 14:50:27 2022] *** May 19 14:50:27.756498 dv-cinder-825492-12-iscsi devstack@keystone.service[80147]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 14:50:27.756498 dv-cinder-825492-12-iscsi devstack@keystone.service[80147]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 14:50:27.756498 dv-cinder-825492-12-iscsi devstack@keystone.service[80147]: nodename: dv-cinder-825492-12-iscsi May 19 14:50:27.756498 dv-cinder-825492-12-iscsi devstack@keystone.service[80147]: machine: x86_64 May 19 14:50:27.756498 dv-cinder-825492-12-iscsi devstack@keystone.service[80147]: clock source: unix May 19 14:50:27.756498 dv-cinder-825492-12-iscsi devstack@keystone.service[80147]: pcre jit disabled May 19 14:50:27.756498 dv-cinder-825492-12-iscsi devstack@keystone.service[80147]: detected number of CPU cores: 4 May 19 14:50:27.756498 dv-cinder-825492-12-iscsi devstack@keystone.service[80147]: current working directory: / May 19 14:50:27.756498 dv-cinder-825492-12-iscsi devstack@keystone.service[80147]: detected binary path: /usr/bin/uwsgi-core May 19 14:50:27.756498 dv-cinder-825492-12-iscsi devstack@keystone.service[80147]: your processes number limit is 47680 May 19 14:50:27.756498 dv-cinder-825492-12-iscsi devstack@keystone.service[80147]: your memory page size is 4096 bytes May 19 14:50:27.757115 dv-cinder-825492-12-iscsi devstack@keystone.service[80147]: detected max file descriptor number: 2048 May 19 14:50:27.757115 dv-cinder-825492-12-iscsi devstack@keystone.service[80147]: lock engine: pthread robust mutexes May 19 14:50:27.757115 dv-cinder-825492-12-iscsi devstack@keystone.service[80147]: thunder lock: enabled May 19 14:50:27.757115 dv-cinder-825492-12-iscsi devstack@keystone.service[80147]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 19 14:50:27.757115 dv-cinder-825492-12-iscsi devstack@keystone.service[80147]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 14:50:27.802687 dv-cinder-825492-12-iscsi devstack@keystone.service[80147]: Python main interpreter initialized at 0x56421da9b9c0 May 19 14:50:27.802687 dv-cinder-825492-12-iscsi devstack@keystone.service[80147]: python threads support enabled May 19 14:50:27.802687 dv-cinder-825492-12-iscsi devstack@keystone.service[80147]: your server socket listen backlog is limited to 100 connections May 19 14:50:27.802687 dv-cinder-825492-12-iscsi devstack@keystone.service[80147]: your mercy for graceful operations on workers is 90 seconds May 19 14:50:27.803040 dv-cinder-825492-12-iscsi devstack@keystone.service[80147]: mapped 403077 bytes (393 KB) for 2 cores May 19 14:50:27.803123 dv-cinder-825492-12-iscsi devstack@keystone.service[80147]: *** Operational MODE: preforking *** May 19 14:50:27.803396 dv-cinder-825492-12-iscsi devstack@keystone.service[80147]: *** uWSGI is running in multiple interpreter mode *** May 19 14:50:27.803396 dv-cinder-825492-12-iscsi devstack@keystone.service[80147]: spawned uWSGI master process (pid: 80147) May 19 14:50:27.803596 dv-cinder-825492-12-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 19 14:50:27.807239 dv-cinder-825492-12-iscsi devstack@keystone.service[80147]: spawned uWSGI worker 1 (pid: 80157, cores: 1) May 19 14:50:27.807239 dv-cinder-825492-12-iscsi devstack@keystone.service[80147]: spawned uWSGI worker 2 (pid: 80158, cores: 1) May 19 14:50:27.807239 dv-cinder-825492-12-iscsi devstack@keystone.service[80147]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 14:50:33.494778 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 14:50:33.494778 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: from cryptography.utils import int_from_bytes May 19 14:50:33.495570 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 14:50:33.495570 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: from cryptography.utils import int_from_bytes May 19 14:50:33.496243 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 14:50:33.496243 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: from cryptography.utils import int_from_bytes May 19 14:50:33.496353 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 14:50:33.496353 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: from cryptography.utils import int_from_bytes May 19 14:50:33.545674 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 14:50:33.545827 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 14:50:33.545912 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 14:50:33.545995 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 14:50:33.546072 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] command line args: [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 14:50:33.546149 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] command line args: [] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 14:50:33.546310 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 14:50:33.546389 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 14:50:33.546494 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ================================================================================ {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 14:50:33.546580 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ================================================================================ {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 14:50:33.546752 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] admin_token = **** {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.546831 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] admin_token = **** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.547000 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] config_dir = [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.547084 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] config_dir = [] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.547187 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.547302 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.547381 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] config_source = [] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.547451 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] config_source = [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.547567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] debug = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.547648 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] debug = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.547767 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.548063 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.548209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.548316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.548417 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.548518 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.548618 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.548719 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.548832 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.548928 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.549028 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] list_limit = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.549128 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] list_limit = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.549222 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] log_config_append = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.549334 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] log_config_append = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.549429 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.549527 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.549621 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] log_dir = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.549726 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] log_dir = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.549827 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] log_file = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.549929 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] log_file = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.550038 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.550167 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.550249 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.550366 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.550440 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.550566 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.550642 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.550761 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.550843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.550966 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.551051 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.551136 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.551236 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.551313 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.551478 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.551601 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.551718 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.551798 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.551951 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.552027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.552186 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.552263 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.552419 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.552538 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.552669 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.552763 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.552918 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.553001 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.553197 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.553282 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.553689 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.24/identity {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.553763 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.24/identity {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.553871 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] publish_errors = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.553950 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] publish_errors = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.554107 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.554188 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.554339 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.554416 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.554519 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.554602 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.554771 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.554924 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.555011 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.555083 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.555253 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] standard_threads = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.555337 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] standard_threads = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.555490 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.555579 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.555739 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.555823 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.555916 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.555992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.556091 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] use_journal = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.556179 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] use_journal = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.556251 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] use_json = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.556318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] use_json = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.556428 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] use_stderr = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.556512 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] use_stderr = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.556604 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] use_syslog = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.556689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] use_syslog = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.556836 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.556915 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:50:33.557094 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.557171 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.557334 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.557417 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.557597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.557680 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.557839 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.557915 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.558092 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.558180 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.558334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.558411 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.558582 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.558665 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.558941 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.559055 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.559169 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.559326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.559428 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.559582 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.559672 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.559822 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.559928 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.560076 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.560154 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.560320 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.560410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.560573 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.560652 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.560828 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.560912 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.561073 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.561162 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.561334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.561412 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.561591 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.561668 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.561838 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.561924 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.562080 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.562157 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.562316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.562393 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.562575 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.562672 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.562839 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.562922 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.563095 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.563173 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.563359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.563454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.563592 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.563675 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.563825 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.563907 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.564055 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.564144 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.564292 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.564371 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.564541 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.564654 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.564773 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.564931 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.565006 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.565075 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.565231 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.565310 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.565498 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.565633 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.565715 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.565786 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.565958 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.566036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.566718 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.566810 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.566956 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.567034 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.567193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.567290 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.567449 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.567528 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.567682 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.567759 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.567914 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.567990 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.568143 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.568222 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.568375 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.568453 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.568614 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.568718 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.568848 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.568951 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.569093 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.569200 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.569303 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.569407 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.569545 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.569667 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.569783 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.569868 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.570036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.570114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.570272 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.570360 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.570507 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.570631 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.570744 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.570824 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.570984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.571064 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.571244 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.571331 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.571489 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.571569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.571720 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.571798 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.571949 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.572027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.572201 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.572277 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.572435 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.572522 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.572666 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.572751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.572896 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.572985 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.573156 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.573233 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.573391 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.573477 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.573622 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.573699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.573863 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.573941 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.574101 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.574181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.574364 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.574441 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.574603 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.574686 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.574858 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.574937 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.575099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.575177 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.575365 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.575445 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.575603 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.575682 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.575856 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.575933 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.576099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.576178 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.576339 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.576418 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.576583 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.576666 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.576822 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.576898 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.577045 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.577125 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.577289 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.577368 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.577525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.577602 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.577763 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.577842 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.578002 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.578081 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.578259 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.578344 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.578503 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.578581 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.578746 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.578823 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.578988 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.579074 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.579249 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.579336 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.579494 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.579578 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.579733 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.579823 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.579968 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.580055 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.580200 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.580278 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.580431 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.580507 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.580661 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.580746 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.580892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.580969 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.581121 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.581199 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.581359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.581447 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.581593 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.581672 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.582395 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.582486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.582642 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.582809 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.583010 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.583088 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.583306 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.583389 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.583557 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.583648 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] auth.external = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.583795 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] auth.external = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.583875 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.584032 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.584111 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.584328 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.584419 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.584565 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.584656 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] auth.password = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.584800 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] auth.token = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.584878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] auth.password = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.585035 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] auth.token = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.585113 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.585279 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.585368 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.585518 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.585603 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.585759 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.585837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.585995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.586082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.586249 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.586330 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.586482 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.586560 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.586721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] credential.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.586802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.586958 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] credential.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.587037 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.587250 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.587335 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.587486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.587572 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.587731 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.587811 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.587972 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.588050 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.588208 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.588287 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.588449 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.588527 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.588717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.588797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.588956 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.589042 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.589206 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.589285 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.589464 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.589543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.589731 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.589810 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.589994 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.590073 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.590242 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.590320 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.590493 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.590573 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.590731 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] federation.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.590808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.590981 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] federation.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.591059 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.591247 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.591332 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.591501 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.591579 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.591737 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.591816 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.591972 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.592054 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.592210 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.592290 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.592451 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.592530 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.592708 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.592794 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.592947 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.593026 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.593198 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.593283 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.593438 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.593517 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.593680 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.593765 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.593916 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.593994 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.594169 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.594250 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.594409 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.594488 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.594647 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.594726 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.594885 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.594966 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.595120 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.595236 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.595383 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.595463 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.595626 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.595703 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.595880 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.595960 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.596113 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.596191 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.596355 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.596434 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.596587 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.596665 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.596816 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.596894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.597061 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.597142 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.597313 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.597391 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.597589 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.597676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.597852 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.597931 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.598105 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.598184 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.598348 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.598434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.598593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.598673 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.598828 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.598906 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.599059 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.599145 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.599315 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.599395 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.599547 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.599626 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.599786 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.599877 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.600026 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.600113 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.600266 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.600345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.600500 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.600585 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.600740 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.600819 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.600990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.601068 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.601231 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.601319 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.601467 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.601547 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.601719 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.601798 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.601954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.602040 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.602189 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.602267 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.602418 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.602497 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.602652 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.602739 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.602890 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.602968 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.603128 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.603233 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.603401 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.603492 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.603639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.603718 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.603880 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.603960 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.604129 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.604216 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.604376 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.604455 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.604607 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.604685 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.604842 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.604930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.605094 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.605180 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.605331 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.605409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.605572 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.605661 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.605810 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.605888 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.606045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.606124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.606275 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.606360 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.606517 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.606596 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.606766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.606844 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.606999 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.607086 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.607276 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.607359 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.607529 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.607606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.607766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.607856 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.608002 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.608082 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.608234 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.608312 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.608470 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.608556 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.608705 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.608784 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.608937 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.609014 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.609167 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.609247 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.609416 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.609495 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.609665 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.609744 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.609915 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.609994 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.610184 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.610262 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.610404 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.610489 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.610634 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.610718 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.610883 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.610961 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.611122 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.611241 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.611385 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.611466 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.611626 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.611705 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.611865 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.611942 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.612116 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.612195 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.612358 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.612437 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.612597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.612675 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.612838 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.612917 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.613589 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.613673 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.613832 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.613916 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.614070 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.614150 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.614309 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.614387 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.614547 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.614625 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.614796 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.614875 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.615033 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.615112 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.615290 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.615373 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.615523 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.615600 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] resource.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.615763 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] resource.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.615843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.616016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.616096 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.616253 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.616333 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.616493 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.616572 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.616747 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.616826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.616985 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.617065 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.617229 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.617308 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.617471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.617549 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.617708 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.617789 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.617946 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] role.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.618020 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.618182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] role.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.618260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] role.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.618432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.618511 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] role.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.618663 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.618741 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.618914 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.618994 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.619167 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.619299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.619445 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.619523 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.619694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.619772 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.619944 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.620024 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.620193 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.620271 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.620442 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.620522 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.620677 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.620757 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.620916 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.621272 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.621446 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.621528 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.621698 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.621779 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.621947 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.622026 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.622197 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.622345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.622586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.622664 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.622825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.622903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.623080 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.623168 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.623357 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.623437 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.623610 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.623688 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.623847 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.623940 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.624095 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.624173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.624351 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.624430 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.624596 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.624686 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.624833 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.624913 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.625066 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.625145 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.625300 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.625385 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.625532 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.625610 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.625787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.625867 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.626039 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.626121 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.626280 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.626360 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.626518 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.626595 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.626755 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.626842 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.626987 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.627065 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] token.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.627244 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] token.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.627330 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.627489 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.627581 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.627726 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.627804 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.627968 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.628047 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.628224 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.628303 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.628464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.628543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.628755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.629331 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.629504 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.629586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.629751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.629830 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.629990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.630075 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.630233 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.630314 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.630471 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.630549 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.630710 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.630789 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.630960 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.631040 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.631205 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.631287 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.631457 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.631535 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.631703 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.631784 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.631999 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.632079 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.connection = **** {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.632260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.632348 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.connection = **** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.632508 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.632596 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.632749 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.632837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.632990 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.633069 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.633229 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.633306 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.633464 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.633551 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.633703 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.633785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.633940 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.634018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.634178 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.634266 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.634417 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.634496 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.634653 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.634731 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.634894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.634979 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.635127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.635249 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.635401 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.635480 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.635637 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.635794 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.635872 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.635942 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.636101 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.636182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.636339 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.636427 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.636502 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 14:50:33.636572 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:50:33.636735 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 14:50:33.666933 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.667082 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.667181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.667285 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.667403 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.667489 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.676613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.676754 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.705322 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.705555 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.705756 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.705992 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.758604 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.759369 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.809156 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.809381 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.810949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.811189 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.876242 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.876392 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.876472 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.876550 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.876625 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.876742 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.876828 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.876964 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.877048 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.877184 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.877277 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.877401 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.901042 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.901279 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.901524 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.901747 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.901833 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.901964 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.902048 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.902180 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.902270 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.902394 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.902475 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.902626 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.902843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.903057 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.913714 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.914203 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.928698 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.928932 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.929115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.929215 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.929358 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.929440 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.929576 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.929656 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.929794 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.929876 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.930009 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.930089 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80158) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.930223 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.930435 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80157) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 19 14:50:33.948000 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.948215 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.948299 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 14:50:33.948428 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 14:50:33.948551 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.948757 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 14:50:33.948838 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.948960 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 19 14:50:33.949040 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.949232 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.949312 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.949500 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.949581 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.949758 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.949837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.950013 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.960808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.961085 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.961167 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.961353 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.961436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.961616 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.961710 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.961892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.969771 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:33.970122 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:33.973105 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:33.973390 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.973471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:33.973720 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.973799 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.974005 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.974164 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.974396 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.974477 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.974682 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.974763 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.974946 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.975033 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.975235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.975318 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.975512 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.975590 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.975784 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.975864 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.976055 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.976135 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:33.976319 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.003170 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.004325 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.005343 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:34.005627 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.005967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:34.006249 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.011028 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:34.011334 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.011617 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.011698 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:34.011896 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.012174 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.018836 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:34.019124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.019518 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:34.019799 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.023774 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:34.024064 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.024347 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.024427 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:34.024628 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.024721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.024902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.024983 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.025176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.025257 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.025445 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.025534 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.025711 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.025792 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.025993 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.026265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.044777 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.045054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.045426 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.045706 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.049564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:34.050240 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:34.053728 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.054024 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.054481 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.054779 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.058960 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:34.059770 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:34.062555 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:34.063389 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:34.066300 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.066596 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.066880 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.067161 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.067339 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.067465 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.067661 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.067820 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.067947 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.068239 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.068528 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.068806 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.086828 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:34.087356 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.087504 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.087778 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.088354 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:34.088994 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.089229 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.089499 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.095701 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.097913 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.098019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.098197 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.099726 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.100001 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.101284 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:34.101566 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.101864 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.102147 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.102424 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.103057 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:34.103364 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.103647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.103934 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.104221 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.116299 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:34.116582 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.116864 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.117156 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.117440 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.117716 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.117990 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.118210 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:34.118489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.118768 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.119047 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.119354 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.119631 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.119914 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.136475 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:34.138236 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:34.139703 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:34.141543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:34.143006 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.144641 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.144910 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.146281 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:34.146524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.146650 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.146831 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.148187 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:34.148475 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.148757 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.154216 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.155859 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:34.156249 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.157857 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:34.159084 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.159401 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.159690 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.160480 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.161628 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.161922 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.162208 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.162484 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.169695 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:34.170027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.170474 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.174638 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:34.174924 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.175222 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.179012 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80158) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:34.179332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.179617 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.179896 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.180175 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.180455 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.180737 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.181005 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.181280 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.181549 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.181827 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.182096 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.182375 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.182637 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80158) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.183710 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80157) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 19 14:50:34.183989 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.184262 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.184544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.184822 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.185091 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.185359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.185622 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.185895 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.186170 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.186447 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.186706 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.186974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.187262 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80157) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 19 14:50:34.222197 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x56421da9b9c0 pid: 80158 (default app) May 19 14:50:34.225579 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e9edc-256c-4a50-8687-2a60df3a38bb None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:34.225887 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e9edc-256c-4a50-8687-2a60df3a38bb None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:34.226169 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e9edc-256c-4a50-8687-2a60df3a38bb None None] PATH_INFO: `/v3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:34.227062 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x56421da9b9c0 pid: 80157 (default app) May 19 14:50:34.230346 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1/1] 10.222.0.24 () {50 vars in 791 bytes} [Thu May 19 14:50:34 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:42.151505 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6421b8-ae8a-4e07-9d99-1d7fb81cfa8a None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:42.152092 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6421b8-ae8a-4e07-9d99-1d7fb81cfa8a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:42.152092 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6421b8-ae8a-4e07-9d99-1d7fb81cfa8a None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:42.156333 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1/2] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:50:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:50:42.161610 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60427b-2b75-4797-a617-d9930a0be2fb None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:42.162033 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60427b-2b75-4797-a617-d9930a0be2fb None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:42.162184 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60427b-2b75-4797-a617-d9930a0be2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:42.234960 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: INFO dbcounter [None req-1d60427b-2b75-4797-a617-d9930a0be2fb None None] Registered counter for database keystone May 19 14:50:42.257612 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG oslo_db.sqlalchemy.engines [None req-1d60427b-2b75-4797-a617-d9930a0be2fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80158) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 14:50:42.263819 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writer thread running {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 14:50:42.437908 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG passlib.handlers.bcrypt [None req-1d60427b-2b75-4797-a617-d9930a0be2fb None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80158) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 14:50:42.438254 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG passlib.handlers.bcrypt [None req-1d60427b-2b75-4797-a617-d9930a0be2fb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80158) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 14:50:42.493265 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1d60427b-2b75-4797-a617-d9930a0be2fb None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:42.494885 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1d60427b-2b75-4797-a617-d9930a0be2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:42.618637 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 2/3] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:50:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 19 14:50:42.788678 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6421b8-ae8a-4e07-9d99-1d7fb81cfa8a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:42.861130 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: INFO dbcounter [None req-cd6421b8-ae8a-4e07-9d99-1d7fb81cfa8a None None] Registered counter for database keystone May 19 14:50:42.882759 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG oslo_db.sqlalchemy.engines [None req-cd6421b8-ae8a-4e07-9d99-1d7fb81cfa8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 14:50:42.888973 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writer thread running {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 14:50:43.007062 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6421b8-ae8a-4e07-9d99-1d7fb81cfa8a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:43.011307 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdf187-eb3e-4257-807f-a6805a4abdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:43.011962 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdf187-eb3e-4257-807f-a6805a4abdeb admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:43.012243 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdf187-eb3e-4257-807f-a6805a4abdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:43.012517 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdf187-eb3e-4257-807f-a6805a4abdeb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:43.020549 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cdf187-eb3e-4257-807f-a6805a4abdeb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:43.072343 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: WARNING keystone.common.rbac_enforcer.enforcer [None req-02cdf187-eb3e-4257-807f-a6805a4abdeb admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 14:50:43.072644 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cdf187-eb3e-4257-807f-a6805a4abdeb admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:43.081827 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 2/4] 10.222.0.24 () {58 vars in 1324 bytes} [Thu May 19 14:50:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 19 14:50:43.087773 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60427b-2b75-4797-a617-d9930a0be2fb None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:43.102443 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60427b-2b75-4797-a617-d9930a0be2fb None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:43.106836 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeedda6-1168-4bf4-8b3d-ad34d8c5d816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:43.107978 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeedda6-1168-4bf4-8b3d-ad34d8c5d816 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:43.108269 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeedda6-1168-4bf4-8b3d-ad34d8c5d816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:43.108549 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeedda6-1168-4bf4-8b3d-ad34d8c5d816 admin admin] PATH_INFO: `/v3/projects/55b46daee5c44a5cacdc54e48d280e5e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:43.110046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeedda6-1168-4bf4-8b3d-ad34d8c5d816 admin admin] RBAC: Authorizing `identity:get_project(project_id=55b46daee5c44a5cacdc54e48d280e5e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:43.270181 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9eeedda6-1168-4bf4-8b3d-ad34d8c5d816 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 19 14:50:43.270832 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeedda6-1168-4bf4-8b3d-ad34d8c5d816 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:43.275234 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 3/5] 10.222.0.24 () {56 vars in 1207 bytes} [Thu May 19 14:50:43 2022] GET /identity/v3/projects/55b46daee5c44a5cacdc54e48d280e5e => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:45.458031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be945d3d-714c-40b7-b403-4fccead4f516 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:45.458555 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be945d3d-714c-40b7-b403-4fccead4f516 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:45.458650 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be945d3d-714c-40b7-b403-4fccead4f516 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:45.462780 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 3/6] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:50:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:45.468131 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60805d52-ac8c-4e44-b407-fde4adb972bf None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:45.468524 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60805d52-ac8c-4e44-b407-fde4adb972bf None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:45.468712 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60805d52-ac8c-4e44-b407-fde4adb972bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:45.488971 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-60805d52-ac8c-4e44-b407-fde4adb972bf None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:45.490531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-60805d52-ac8c-4e44-b407-fde4adb972bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:45.498860 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 4/7] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:50:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 19 14:50:45.521544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be945d3d-714c-40b7-b403-4fccead4f516 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:45.533849 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be945d3d-714c-40b7-b403-4fccead4f516 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:45.544568 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b163d4-b818-4404-b701-bfaf77d01189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:45.545205 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b163d4-b818-4404-b701-bfaf77d01189 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:45.545490 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b163d4-b818-4404-b701-bfaf77d01189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:45.545768 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b163d4-b818-4404-b701-bfaf77d01189 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:45.556595 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b163d4-b818-4404-b701-bfaf77d01189 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:45.559189 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b163d4-b818-4404-b701-bfaf77d01189 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:45.567950 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 4/8] 10.222.0.24 () {58 vars in 1324 bytes} [Thu May 19 14:50:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 14:50:45.573889 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60805d52-ac8c-4e44-b407-fde4adb972bf None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:45.582962 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60805d52-ac8c-4e44-b407-fde4adb972bf None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:45.587333 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc192544-ca97-46cb-8ae5-f15a80be7f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:45.588198 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc192544-ca97-46cb-8ae5-f15a80be7f8c admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:45.588484 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc192544-ca97-46cb-8ae5-f15a80be7f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:45.588848 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc192544-ca97-46cb-8ae5-f15a80be7f8c admin admin] PATH_INFO: `/v3/users/83eec44e6acd4004ba2088801e9d8f88` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:45.590234 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc192544-ca97-46cb-8ae5-f15a80be7f8c admin admin] RBAC: Authorizing `identity:get_user(user_id=83eec44e6acd4004ba2088801e9d8f88)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:45.592116 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc192544-ca97-46cb-8ae5-f15a80be7f8c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:45.593660 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 5/9] 10.222.0.24 () {56 vars in 1198 bytes} [Thu May 19 14:50:45 2022] GET /identity/v3/users/83eec44e6acd4004ba2088801e9d8f88 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:47.856804 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f904f5a-d274-4c98-8e1e-e0b32dc9af87 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:47.857338 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f904f5a-d274-4c98-8e1e-e0b32dc9af87 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:47.857426 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f904f5a-d274-4c98-8e1e-e0b32dc9af87 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:47.858727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 5/10] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:47.864453 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220e950-08a9-4074-8cae-9ce090ba57a4 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:47.864872 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220e950-08a9-4074-8cae-9ce090ba57a4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:47.865099 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220e950-08a9-4074-8cae-9ce090ba57a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:47.882183 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-6220e950-08a9-4074-8cae-9ce090ba57a4 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:47.883401 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6220e950-08a9-4074-8cae-9ce090ba57a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:47.893251 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf30141-156f-4415-a0f9-a9141bf3df7e None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:47.893548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf30141-156f-4415-a0f9-a9141bf3df7e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:47.894349 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf30141-156f-4415-a0f9-a9141bf3df7e None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:47.895754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 6/11] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:50:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:50:47.901115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa9b83-6d36-4b75-a732-7a67211f6d73 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:47.901399 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa9b83-6d36-4b75-a732-7a67211f6d73 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:47.901675 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa9b83-6d36-4b75-a732-7a67211f6d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:47.941684 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG passlib.handlers.bcrypt [None req-18fa9b83-6d36-4b75-a732-7a67211f6d73 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80157) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 19 14:50:47.942101 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG passlib.handlers.bcrypt [None req-18fa9b83-6d36-4b75-a732-7a67211f6d73 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80157) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 19 14:50:47.966113 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 6/12] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:50:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:47.989262 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-18fa9b83-6d36-4b75-a732-7a67211f6d73 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:47.989717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220e950-08a9-4074-8cae-9ce090ba57a4 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:47.990888 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-18fa9b83-6d36-4b75-a732-7a67211f6d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:48.013988 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:48.095741 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220e950-08a9-4074-8cae-9ce090ba57a4 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:48.096825 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 7/13] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:50:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:50:48.119370 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa9b83-6d36-4b75-a732-7a67211f6d73 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:48.131057 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5469d5-0f7d-4d8d-8d4b-1c02850c114a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:48.131884 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5469d5-0f7d-4d8d-8d4b-1c02850c114a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:48.132169 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5469d5-0f7d-4d8d-8d4b-1c02850c114a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:48.132445 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5469d5-0f7d-4d8d-8d4b-1c02850c114a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:48.143282 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5469d5-0f7d-4d8d-8d4b-1c02850c114a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:48.154690 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-3a5469d5-0f7d-4d8d-8d4b-1c02850c114a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:50:48.154690 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:48.154690 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:48.154690 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:48.154690 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:48.154690 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:48.154690 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:48.154690 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:48.154690 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:48.154690 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:48.154690 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:48.154690 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:48.154690 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:48.154690 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:48.154690 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:48.154690 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:48.155771 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:48.155771 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:48.155771 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:48.155771 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:48.155771 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:48.155771 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:48.155771 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:48.155771 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:48.155771 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:48.155771 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:48.155771 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:48.155771 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:50:48.155771 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:48.155771 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:48.155771 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:48.155771 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:48.156585 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:48.156585 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:48.156585 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:48.156585 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:48.156585 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:48.156585 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:48.156585 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:48.156585 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:48.156585 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:48.156585 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:48.156585 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:50:48.156585 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:50:48.156585 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 7/14] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:50:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:50:48.162527 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5469d5-0f7d-4d8d-8d4b-1c02850c114a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:48.248520 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:48.268203 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5469d5-0f7d-4d8d-8d4b-1c02850c114a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:48.303336 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6863d5f-ccdf-4f7f-a4dd-e61850448a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:48.304018 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6863d5f-ccdf-4f7f-a4dd-e61850448a1e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:48.304310 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6863d5f-ccdf-4f7f-a4dd-e61850448a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:48.304592 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6863d5f-ccdf-4f7f-a4dd-e61850448a1e None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:48.305503 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6863d5f-ccdf-4f7f-a4dd-e61850448a1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:48.306065 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6863d5f-ccdf-4f7f-a4dd-e61850448a1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:48.308363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6863d5f-ccdf-4f7f-a4dd-e61850448a1e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:48.322719 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 8/15] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:50:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:48.328577 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6863d5f-ccdf-4f7f-a4dd-e61850448a1e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:48.343026 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa9b83-6d36-4b75-a732-7a67211f6d73 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:48.345449 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:48.388118 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc68bc14-5838-4503-be5a-3f78235ee599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:48.389538 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68bc14-5838-4503-be5a-3f78235ee599 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:48.389852 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68bc14-5838-4503-be5a-3f78235ee599 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:48.390131 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68bc14-5838-4503-be5a-3f78235ee599 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:48.432993 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6863d5f-ccdf-4f7f-a4dd-e61850448a1e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:48.465165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc68bc14-5838-4503-be5a-3f78235ee599 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:48.466688 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc68bc14-5838-4503-be5a-3f78235ee599 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:48.487822 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085fb6d8-7a88-4342-8a35-92e22e3723a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:48.489353 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fb6d8-7a88-4342-8a35-92e22e3723a9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:48.489912 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fb6d8-7a88-4342-8a35-92e22e3723a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:48.490267 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fb6d8-7a88-4342-8a35-92e22e3723a9 None admin] PATH_INFO: `/v3/users/83eec44e6acd4004ba2088801e9d8f88` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:48.491879 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085fb6d8-7a88-4342-8a35-92e22e3723a9 None admin] RBAC: Authorizing `identity:get_user(user_id=83eec44e6acd4004ba2088801e9d8f88)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:48.493844 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085fb6d8-7a88-4342-8a35-92e22e3723a9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:48.497175 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 9/16] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:50:48 2022] GET /identity/v3/users/83eec44e6acd4004ba2088801e9d8f88 => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:48.502269 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085fb6d8-7a88-4342-8a35-92e22e3723a9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:48.516962 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:48.565424 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 8/17] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:50:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:50:48.572415 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc68bc14-5838-4503-be5a-3f78235ee599 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:48.575251 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:48.602632 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085fb6d8-7a88-4342-8a35-92e22e3723a9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:48.637430 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34ca01-efdc-4959-843e-b9135dd9821b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:48.638297 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34ca01-efdc-4959-843e-b9135dd9821b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:48.638526 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34ca01-efdc-4959-843e-b9135dd9821b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:48.638803 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34ca01-efdc-4959-843e-b9135dd9821b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:48.640027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34ca01-efdc-4959-843e-b9135dd9821b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:48.641484 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34ca01-efdc-4959-843e-b9135dd9821b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:48.643084 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 10/18] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:50:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:48.648714 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34ca01-efdc-4959-843e-b9135dd9821b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:48.669426 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc68bc14-5838-4503-be5a-3f78235ee599 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:48.703336 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c843043-12b7-45ef-b8eb-67c5ca2fbd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:48.704131 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c843043-12b7-45ef-b8eb-67c5ca2fbd25 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:48.704419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c843043-12b7-45ef-b8eb-67c5ca2fbd25 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:48.704705 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c843043-12b7-45ef-b8eb-67c5ca2fbd25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:48.723875 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c843043-12b7-45ef-b8eb-67c5ca2fbd25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:48.725376 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c843043-12b7-45ef-b8eb-67c5ca2fbd25 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:48.726269 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:48.745340 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34ca01-efdc-4959-843e-b9135dd9821b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:48.747766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-0c843043-12b7-45ef-b8eb-67c5ca2fbd25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:50:48.747766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:48.747766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:48.747766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:48.747766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:48.747766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:48.747766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:48.747766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:48.747766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:48.747766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:48.747766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:48.747766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:48.747766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:50:48.747766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:50:48.747766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:50:48.748567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:50:48.748567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:48.748567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:48.748567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:48.748567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:48.748567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:48.748567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:48.748567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:48.748567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:50:48.748567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:48.748567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:48.748567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:48.748567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:48.748567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:48.748567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:48.748567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:48.748567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:48.749379 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:50:48.749379 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:50:48.749379 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:50:48.749379 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:50:48.749379 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 9/19] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:50:48.756288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c843043-12b7-45ef-b8eb-67c5ca2fbd25 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:48.779170 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e84c5-f9a3-4bee-98e2-c45a67baf6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:48.779923 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e84c5-f9a3-4bee-98e2-c45a67baf6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:48.780209 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e84c5-f9a3-4bee-98e2-c45a67baf6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:48.780484 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e84c5-f9a3-4bee-98e2-c45a67baf6d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:48.781309 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e84c5-f9a3-4bee-98e2-c45a67baf6d7 None admin] RBAC: Adding query filter params (role.id=ec4b73b709ca4cdc983e35e955aed57a, scope.domain.id=default, user.id=83eec44e6acd4004ba2088801e9d8f88) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:48.781618 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e84c5-f9a3-4bee-98e2-c45a67baf6d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:48.783073 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e84c5-f9a3-4bee-98e2-c45a67baf6d7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:48.790951 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 11/20] 10.222.0.24 () {56 vars in 1322 bytes} [Thu May 19 14:50:48 2022] GET /identity/v3/role_assignments?user.id=83eec44e6acd4004ba2088801e9d8f88&scope.domain.id=default&role.id=ec4b73b709ca4cdc983e35e955aed57a => generated 233 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:48.815159 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:48.864564 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c843043-12b7-45ef-b8eb-67c5ca2fbd25 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:48.901412 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d3acf-56ac-45bb-8a61-4e0b3ea3d401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:48.902099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d3acf-56ac-45bb-8a61-4e0b3ea3d401 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:48.902381 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d3acf-56ac-45bb-8a61-4e0b3ea3d401 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:48.902655 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d3acf-56ac-45bb-8a61-4e0b3ea3d401 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:48.903426 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d3acf-56ac-45bb-8a61-4e0b3ea3d401 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:48.903733 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d3acf-56ac-45bb-8a61-4e0b3ea3d401 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:48.905156 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d3acf-56ac-45bb-8a61-4e0b3ea3d401 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:48.924076 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 10/21] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:51.362484 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef5df6-f992-4e23-ad5a-db63f6f2f1e4 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:51.363002 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef5df6-f992-4e23-ad5a-db63f6f2f1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:51.363090 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef5df6-f992-4e23-ad5a-db63f6f2f1e4 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:51.364446 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 12/22] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:51.369844 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4dae36-df5d-4e01-af56-fab4d0c7548e None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:51.370238 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4dae36-df5d-4e01-af56-fab4d0c7548e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:51.370431 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4dae36-df5d-4e01-af56-fab4d0c7548e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:51.396930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-bc4dae36-df5d-4e01-af56-fab4d0c7548e None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:51.398123 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-bc4dae36-df5d-4e01-af56-fab4d0c7548e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:51.492879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 11/23] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:50:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:51.531536 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b414d4-5ab6-4c95-aea1-894080f71479 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:51.531857 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b414d4-5ab6-4c95-aea1-894080f71479 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:51.532127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b414d4-5ab6-4c95-aea1-894080f71479 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:51.532223 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4dae36-df5d-4e01-af56-fab4d0c7548e None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:51.533493 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 13/24] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:51.540124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f833ae-2a49-49a7-b914-e7912de9c93a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:51.540419 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f833ae-2a49-49a7-b914-e7912de9c93a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:51.540739 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f833ae-2a49-49a7-b914-e7912de9c93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:51.568299 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-32f833ae-2a49-49a7-b914-e7912de9c93a None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:51.569455 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-32f833ae-2a49-49a7-b914-e7912de9c93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:51.614067 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:51.711356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4dae36-df5d-4e01-af56-fab4d0c7548e None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:51.740570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 14/25] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:50:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:50:51.784848 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868942cf-0b36-4ab8-9751-98f0039fe069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:51.785584 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f833ae-2a49-49a7-b914-e7912de9c93a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:51.785709 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868942cf-0b36-4ab8-9751-98f0039fe069 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:51.785925 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868942cf-0b36-4ab8-9751-98f0039fe069 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:51.786203 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868942cf-0b36-4ab8-9751-98f0039fe069 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:51.812798 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868942cf-0b36-4ab8-9751-98f0039fe069 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:51.827350 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-868942cf-0b36-4ab8-9751-98f0039fe069 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:50:51.827350 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:51.827350 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:51.827350 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:51.827350 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:51.827350 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:51.827350 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:51.827350 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:51.827350 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:51.827350 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:51.827350 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:51.827350 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:51.827350 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:51.827350 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:51.827350 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:51.827350 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:51.828204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:51.828204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:51.828204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:51.828204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:51.828204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:51.828204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:51.828204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:51.828204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:51.828204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:51.828204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:51.828204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:51.828204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:50:51.828204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:51.828204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:51.828204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:51.828204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:51.828955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:51.828955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:51.828955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:51.828955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:51.828955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:51.828955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:51.828955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:51.828955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:51.828955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:51.828955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:51.828955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:50:51.828955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:50:51.832720 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 12/26] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:50:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:50:51.841548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868942cf-0b36-4ab8-9751-98f0039fe069 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:51.954123 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:52.000387 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f833ae-2a49-49a7-b914-e7912de9c93a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:52.058223 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868942cf-0b36-4ab8-9751-98f0039fe069 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:52.063913 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4d856-12e2-436d-8e61-39dba5d8ea25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:52.064953 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4d856-12e2-436d-8e61-39dba5d8ea25 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:52.065425 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4d856-12e2-436d-8e61-39dba5d8ea25 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:52.065961 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4d856-12e2-436d-8e61-39dba5d8ea25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:52.070789 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:52.077607 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4d856-12e2-436d-8e61-39dba5d8ea25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:52.079023 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4d856-12e2-436d-8e61-39dba5d8ea25 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:52.117550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-c8c4d856-12e2-436d-8e61-39dba5d8ea25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:50:52.117550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:52.117550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:52.117550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:52.117550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:52.117550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:52.117550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:52.117550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:52.117550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:52.117550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:52.117550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:52.117550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:52.117550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:50:52.117550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:50:52.117550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:50:52.118418 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:50:52.118418 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:52.118418 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:52.118418 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:52.118418 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:52.118418 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:52.118418 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:52.118418 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:52.118418 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:50:52.118418 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:52.118418 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:52.118418 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:52.118418 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:52.118418 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:52.118418 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:52.118418 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:52.118418 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:52.119326 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:50:52.119326 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:50:52.119326 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:50:52.119326 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:50:52.119326 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 15/27] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:50:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:52.126155 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4d856-12e2-436d-8e61-39dba5d8ea25 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:52.168567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661bacf0-3f81-4264-a5d5-573aa2cbf9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:52.169291 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bacf0-3f81-4264-a5d5-573aa2cbf9a9 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:52.169583 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bacf0-3f81-4264-a5d5-573aa2cbf9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:52.169867 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bacf0-3f81-4264-a5d5-573aa2cbf9a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:52.170641 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661bacf0-3f81-4264-a5d5-573aa2cbf9a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:52.170955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661bacf0-3f81-4264-a5d5-573aa2cbf9a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:52.172402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661bacf0-3f81-4264-a5d5-573aa2cbf9a9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:52.194054 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 13/28] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:50:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:52.199123 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661bacf0-3f81-4264-a5d5-573aa2cbf9a9 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:52.323485 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4d856-12e2-436d-8e61-39dba5d8ea25 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:52.393512 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:52.419180 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0904a-d358-4901-9a4b-9cd3c3eeceb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:52.419892 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0904a-d358-4901-9a4b-9cd3c3eeceb5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:52.420166 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0904a-d358-4901-9a4b-9cd3c3eeceb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:52.420446 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0904a-d358-4901-9a4b-9cd3c3eeceb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:52.421189 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0904a-d358-4901-9a4b-9cd3c3eeceb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:52.421500 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0904a-d358-4901-9a4b-9cd3c3eeceb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:52.422900 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0904a-d358-4901-9a4b-9cd3c3eeceb5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:52.451505 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661bacf0-3f81-4264-a5d5-573aa2cbf9a9 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:52.461925 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 16/29] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:52.463111 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6bde7-8cd0-4250-bac0-bc24b601129f None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:52.463423 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6bde7-8cd0-4250-bac0-bc24b601129f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:52.463705 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6bde7-8cd0-4250-bac0-bc24b601129f None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:52.465041 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 17/30] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:52.470417 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53325d72-fd39-4200-a592-9cfd7452054f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:52.470706 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53325d72-fd39-4200-a592-9cfd7452054f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:52.470985 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53325d72-fd39-4200-a592-9cfd7452054f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:52.502419 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-53325d72-fd39-4200-a592-9cfd7452054f None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:52.503730 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-53325d72-fd39-4200-a592-9cfd7452054f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:52.523161 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032940a-bb61-4aa7-a616-c027818221b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:52.524097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032940a-bb61-4aa7-a616-c027818221b3 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:52.524383 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032940a-bb61-4aa7-a616-c027818221b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:52.524662 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032940a-bb61-4aa7-a616-c027818221b3 None admin] PATH_INFO: `/v3/users/83eec44e6acd4004ba2088801e9d8f88` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:52.528588 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032940a-bb61-4aa7-a616-c027818221b3 None admin] RBAC: Authorizing `identity:get_user(user_id=83eec44e6acd4004ba2088801e9d8f88)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:52.530114 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032940a-bb61-4aa7-a616-c027818221b3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:52.532411 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 14/31] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:50:52 2022] GET /identity/v3/users/83eec44e6acd4004ba2088801e9d8f88 => generated 247 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:52.533459 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032940a-bb61-4aa7-a616-c027818221b3 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:52.578177 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:52.639517 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 18/32] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:50:52.640896 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53325d72-fd39-4200-a592-9cfd7452054f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:52.717522 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032940a-bb61-4aa7-a616-c027818221b3 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:52.761483 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53325d72-fd39-4200-a592-9cfd7452054f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:52.762330 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2141bee-2447-4535-b55f-1ce4935fad02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:52.763005 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2141bee-2447-4535-b55f-1ce4935fad02 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:52.763323 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2141bee-2447-4535-b55f-1ce4935fad02 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:52.763859 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2141bee-2447-4535-b55f-1ce4935fad02 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:52.765628 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2141bee-2447-4535-b55f-1ce4935fad02 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:52.767244 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2141bee-2447-4535-b55f-1ce4935fad02 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:52.781426 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:52.801153 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86b27c-99c7-41d5-a2dc-941b581b3ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:52.801972 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86b27c-99c7-41d5-a2dc-941b581b3ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:52.802251 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86b27c-99c7-41d5-a2dc-941b581b3ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:52.802513 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86b27c-99c7-41d5-a2dc-941b581b3ec7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:52.803813 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86b27c-99c7-41d5-a2dc-941b581b3ec7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:52.805303 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86b27c-99c7-41d5-a2dc-941b581b3ec7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:52.811444 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 19/33] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:50:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:52.811444 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86b27c-99c7-41d5-a2dc-941b581b3ec7 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:52.912061 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 15/34] 10.222.0.24 () {60 vars in 1141 bytes} [Thu May 19 14:50:52 2022] POST /identity/v3/projects => generated 301 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:50:52.913600 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197b3d7-72d2-4204-9f2e-448b2a8d8b60 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:52.913897 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197b3d7-72d2-4204-9f2e-448b2a8d8b60 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:52.914234 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197b3d7-72d2-4204-9f2e-448b2a8d8b60 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:52.915540 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 16/35] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:52.916895 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a152dda-06cb-467e-bc2d-2469d9463876 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:52.917327 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a152dda-06cb-467e-bc2d-2469d9463876 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:52.917747 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a152dda-06cb-467e-bc2d-2469d9463876 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:52.919253 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 17/36] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:52.920251 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a152dda-06cb-467e-bc2d-2469d9463876 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:52.928438 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86b27c-99c7-41d5-a2dc-941b581b3ec7 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:52.978114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5326d7c-9a9d-48ec-8662-022aaa723fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:52.979329 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5326d7c-9a9d-48ec-8662-022aaa723fe0 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:52.980236 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5326d7c-9a9d-48ec-8662-022aaa723fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:52.980791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5326d7c-9a9d-48ec-8662-022aaa723fe0 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:52.981821 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5326d7c-9a9d-48ec-8662-022aaa723fe0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:52.984130 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5326d7c-9a9d-48ec-8662-022aaa723fe0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:53.031375 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:53.048085 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a152dda-06cb-467e-bc2d-2469d9463876 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:53.087343 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08302bc0-22ca-4901-b973-2ca61d118326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:53.088236 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08302bc0-22ca-4901-b973-2ca61d118326 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:53.088523 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08302bc0-22ca-4901-b973-2ca61d118326 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:53.088808 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08302bc0-22ca-4901-b973-2ca61d118326 None admin] PATH_INFO: `/v3/domains/default/users/83eec44e6acd4004ba2088801e9d8f88/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:53.091079 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08302bc0-22ca-4901-b973-2ca61d118326 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=83eec44e6acd4004ba2088801e9d8f88, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:53.092712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08302bc0-22ca-4901-b973-2ca61d118326 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:53.110271 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 18/37] 10.222.0.24 () {58 vars in 1361 bytes} [Thu May 19 14:50:52 2022] PUT /identity/v3/domains/default/users/83eec44e6acd4004ba2088801e9d8f88/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:50:53.113037 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df227d-4fef-4c45-a0ab-743716a5314b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:53.113333 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df227d-4fef-4c45-a0ab-743716a5314b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:53.113615 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df227d-4fef-4c45-a0ab-743716a5314b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:53.119732 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 20/38] 10.222.0.24 () {60 vars in 1131 bytes} [Thu May 19 14:50:52 2022] POST /identity/v3/roles => generated 219 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:50:53.121357 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf838cea-9ec5-41d5-910f-46f56b02291d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:53.121656 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf838cea-9ec5-41d5-910f-46f56b02291d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:53.121943 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf838cea-9ec5-41d5-910f-46f56b02291d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:53.144188 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-bf838cea-9ec5-41d5-910f-46f56b02291d None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:53.145114 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b1df227d-4fef-4c45-a0ab-743716a5314b None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:53.145835 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bf838cea-9ec5-41d5-910f-46f56b02291d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:53.146890 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b1df227d-4fef-4c45-a0ab-743716a5314b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:53.211368 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:53.252162 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 19/39] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:53.253884 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c7c4b-1f09-4894-b5cf-82762a43b93e None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:53.254178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c7c4b-1f09-4894-b5cf-82762a43b93e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:53.254530 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c7c4b-1f09-4894-b5cf-82762a43b93e None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:53.255838 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 20/40] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:53.256232 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 21/41] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:53.261261 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc87f6-dc53-425d-aee5-95fecd456bd8 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:53.261563 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc87f6-dc53-425d-aee5-95fecd456bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:53.261849 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc87f6-dc53-425d-aee5-95fecd456bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:53.281832 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf838cea-9ec5-41d5-910f-46f56b02291d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:53.284265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-01bc87f6-dc53-425d-aee5-95fecd456bd8 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:53.285591 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-01bc87f6-dc53-425d-aee5-95fecd456bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:53.386188 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 21/42] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:53.387038 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc87f6-dc53-425d-aee5-95fecd456bd8 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:53.403375 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:53.423987 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf838cea-9ec5-41d5-910f-46f56b02291d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:53.469543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e865c4-fbeb-410c-852f-5cd2caff4bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:53.470876 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e865c4-fbeb-410c-852f-5cd2caff4bf2 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:53.471182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e865c4-fbeb-410c-852f-5cd2caff4bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:53.472361 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e865c4-fbeb-410c-852f-5cd2caff4bf2 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:53.473329 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e865c4-fbeb-410c-852f-5cd2caff4bf2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:53.474884 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e865c4-fbeb-410c-852f-5cd2caff4bf2 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:53.489036 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 22/43] 10.222.0.24 () {60 vars in 1131 bytes} [Thu May 19 14:50:53 2022] POST /identity/v3/roles => generated 223 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:50:53.489862 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e865c4-fbeb-410c-852f-5cd2caff4bf2 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:53.519128 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc87f6-dc53-425d-aee5-95fecd456bd8 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:53.552373 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:53.557761 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532a7ac-e46c-47c4-a757-a5eadebc3b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:53.558472 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532a7ac-e46c-47c4-a757-a5eadebc3b19 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:53.558828 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532a7ac-e46c-47c4-a757-a5eadebc3b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:53.559117 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532a7ac-e46c-47c4-a757-a5eadebc3b19 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:53.560003 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532a7ac-e46c-47c4-a757-a5eadebc3b19 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:53.561469 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532a7ac-e46c-47c4-a757-a5eadebc3b19 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:53.584303 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 22/44] 10.222.0.24 () {60 vars in 1131 bytes} [Thu May 19 14:50:53 2022] POST /identity/v3/roles => generated 225 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:50:53.648875 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e865c4-fbeb-410c-852f-5cd2caff4bf2 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:53.701611 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba184228-fc89-4797-8003-a5495001ec05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:53.702443 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba184228-fc89-4797-8003-a5495001ec05 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:53.702748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba184228-fc89-4797-8003-a5495001ec05 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:53.703042 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba184228-fc89-4797-8003-a5495001ec05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:53.705253 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba184228-fc89-4797-8003-a5495001ec05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:53.707375 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba184228-fc89-4797-8003-a5495001ec05 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:53.709133 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 23/45] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:50:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:53.714851 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532a7ac-e46c-47c4-a757-a5eadebc3b19 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:53.791152 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:53.827520 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532a7ac-e46c-47c4-a757-a5eadebc3b19 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:53.861971 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d06b3c0-68fb-4ad7-a676-3caa356c012e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:53.863160 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06b3c0-68fb-4ad7-a676-3caa356c012e None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:53.863484 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06b3c0-68fb-4ad7-a676-3caa356c012e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:53.863821 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d06b3c0-68fb-4ad7-a676-3caa356c012e None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:53.864490 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d06b3c0-68fb-4ad7-a676-3caa356c012e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:53.865960 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d06b3c0-68fb-4ad7-a676-3caa356c012e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:53.892114 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 23/46] 10.222.0.24 () {60 vars in 1141 bytes} [Thu May 19 14:50:53 2022] POST /identity/v3/projects => generated 312 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:50:55.437595 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3ba96-dd6e-4929-9b25-3eae6fb42ce0 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:55.438098 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3ba96-dd6e-4929-9b25-3eae6fb42ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:55.438226 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3ba96-dd6e-4929-9b25-3eae6fb42ce0 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:55.439641 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 24/47] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:55.445443 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fc7ae-37ba-46eb-bd36-9eb1b93a30a4 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:55.445854 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fc7ae-37ba-46eb-bd36-9eb1b93a30a4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:55.446134 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fc7ae-37ba-46eb-bd36-9eb1b93a30a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:55.462478 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-1c3fc7ae-37ba-46eb-bd36-9eb1b93a30a4 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:55.463703 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1c3fc7ae-37ba-46eb-bd36-9eb1b93a30a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:55.528580 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 24/48] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:50:55.551911 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3ba96-dd6e-4929-9b25-3eae6fb42ce0 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:55.655579 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3ba96-dd6e-4929-9b25-3eae6fb42ce0 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:55.657088 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:55.689601 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2620d7c-c76e-4949-9229-5ab1f6fff14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:55.690964 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2620d7c-c76e-4949-9229-5ab1f6fff14d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:55.691290 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2620d7c-c76e-4949-9229-5ab1f6fff14d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:55.691576 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2620d7c-c76e-4949-9229-5ab1f6fff14d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:55.701351 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2620d7c-c76e-4949-9229-5ab1f6fff14d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:50:55.709017 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-b2620d7c-c76e-4949-9229-5ab1f6fff14d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:50:55.709017 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:50:55.709017 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:50:55.709017 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:50:55.709017 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:50:55.709017 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:50:55.709017 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:50:55.709017 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:50:55.709017 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:50:55.709017 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:50:55.709017 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:50:55.709017 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:50:55.709017 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:50:55.709017 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:50:55.709017 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:50:55.709017 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:50:55.709986 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:50:55.709986 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:50:55.709986 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:50:55.709986 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:50:55.709986 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:50:55.709986 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:50:55.709986 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:50:55.709986 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:50:55.709986 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:50:55.709986 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:50:55.709986 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:50:55.709986 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:50:55.709986 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:50:55.709986 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:50:55.709986 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:50:55.709986 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:50:55.711110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:50:55.711110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:50:55.711110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:50:55.711110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:50:55.711110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:50:55.711110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:50:55.711110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:50:55.711110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:50:55.711110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:50:55.711110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:50:55.711110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:50:55.711110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:50:55.711110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 25/49] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:50:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:50:55.715919 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fc7ae-37ba-46eb-bd36-9eb1b93a30a4 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:55.770019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:55.818419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fc7ae-37ba-46eb-bd36-9eb1b93a30a4 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:55.850848 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c9741-f329-43dc-b781-757cbc413ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:55.851562 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c9741-f329-43dc-b781-757cbc413ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:55.851848 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c9741-f329-43dc-b781-757cbc413ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:55.852126 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c9741-f329-43dc-b781-757cbc413ff4 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:55.852876 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c9741-f329-43dc-b781-757cbc413ff4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:55.853186 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c9741-f329-43dc-b781-757cbc413ff4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:55.854576 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c9741-f329-43dc-b781-757cbc413ff4 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:55.863146 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 25/50] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:50:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:55.868621 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2620d7c-c76e-4949-9229-5ab1f6fff14d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:55.968258 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2620d7c-c76e-4949-9229-5ab1f6fff14d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:56.001841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761044e-35fb-4099-956c-0a4e32d74b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:56.002788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761044e-35fb-4099-956c-0a4e32d74b7b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:56.003028 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761044e-35fb-4099-956c-0a4e32d74b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:56.003338 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761044e-35fb-4099-956c-0a4e32d74b7b None admin] PATH_INFO: `/v3/users/83eec44e6acd4004ba2088801e9d8f88` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:56.004563 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761044e-35fb-4099-956c-0a4e32d74b7b None admin] RBAC: Authorizing `identity:get_user(user_id=83eec44e6acd4004ba2088801e9d8f88)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:56.006009 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761044e-35fb-4099-956c-0a4e32d74b7b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:56.007830 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 26/51] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:50:55 2022] GET /identity/v3/users/83eec44e6acd4004ba2088801e9d8f88 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:56.013119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c9741-f329-43dc-b781-757cbc413ff4 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:56.112084 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c9741-f329-43dc-b781-757cbc413ff4 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:56.125231 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb52c6-b4e6-453c-96b9-e0bb6e359dd8 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:56.125615 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb52c6-b4e6-453c-96b9-e0bb6e359dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:56.125772 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:56.125965 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb52c6-b4e6-453c-96b9-e0bb6e359dd8 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:56.127373 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 27/52] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:50:56.132429 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd819b-272e-495f-b176-ce907e31dee1 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:56.132731 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd819b-272e-495f-b176-ce907e31dee1 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:56.133022 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd819b-272e-495f-b176-ce907e31dee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:56.148346 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d5f4a-4313-4c62-8916-df25c6d5bc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:56.149139 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d5f4a-4313-4c62-8916-df25c6d5bc3f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:56.149431 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d5f4a-4313-4c62-8916-df25c6d5bc3f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:56.149606 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-02dd819b-272e-495f-b176-ce907e31dee1 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:56.149715 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d5f4a-4313-4c62-8916-df25c6d5bc3f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:56.150808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-02dd819b-272e-495f-b176-ce907e31dee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:56.150894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d5f4a-4313-4c62-8916-df25c6d5bc3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:56.152356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d5f4a-4313-4c62-8916-df25c6d5bc3f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:56.153976 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 26/53] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:50:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:56.160059 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d5f4a-4313-4c62-8916-df25c6d5bc3f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:56.175396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:56.218886 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 28/54] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:56.241987 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd819b-272e-495f-b176-ce907e31dee1 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:56.256339 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d5f4a-4313-4c62-8916-df25c6d5bc3f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:56.290187 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f985be2-5032-43d3-b555-f52d00dc3d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:56.290849 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f985be2-5032-43d3-b555-f52d00dc3d6a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:56.291139 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f985be2-5032-43d3-b555-f52d00dc3d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:56.291455 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f985be2-5032-43d3-b555-f52d00dc3d6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:56.292302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f985be2-5032-43d3-b555-f52d00dc3d6a None admin] RBAC: Adding query filter params (role.id=ec4b73b709ca4cdc983e35e955aed57a, scope.domain.id=default, user.id=83eec44e6acd4004ba2088801e9d8f88) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:50:56.292622 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f985be2-5032-43d3-b555-f52d00dc3d6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:56.294066 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f985be2-5032-43d3-b555-f52d00dc3d6a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:56.301959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 27/55] 10.222.0.24 () {56 vars in 1322 bytes} [Thu May 19 14:50:56 2022] GET /identity/v3/role_assignments?user.id=83eec44e6acd4004ba2088801e9d8f88&scope.domain.id=default&role.id=ec4b73b709ca4cdc983e35e955aed57a => generated 530 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:56.342684 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd819b-272e-495f-b176-ce907e31dee1 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:56.380035 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173187a1-acd5-4d8a-9022-acb54118e8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:56.380858 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173187a1-acd5-4d8a-9022-acb54118e8fd None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:56.381149 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173187a1-acd5-4d8a-9022-acb54118e8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:56.381431 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173187a1-acd5-4d8a-9022-acb54118e8fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:56.382687 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173187a1-acd5-4d8a-9022-acb54118e8fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:56.384229 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173187a1-acd5-4d8a-9022-acb54118e8fd None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:56.385916 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 29/56] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:50:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:50:56.391602 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f985be2-5032-43d3-b555-f52d00dc3d6a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:56.440258 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:56.496330 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f985be2-5032-43d3-b555-f52d00dc3d6a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:56.530683 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84d893-3af4-448a-acdb-d45a5d3ce1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:56.531389 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84d893-3af4-448a-acdb-d45a5d3ce1a3 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:56.531678 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84d893-3af4-448a-acdb-d45a5d3ce1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:56.531959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84d893-3af4-448a-acdb-d45a5d3ce1a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:56.532675 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec84d893-3af4-448a-acdb-d45a5d3ce1a3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:56.534173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec84d893-3af4-448a-acdb-d45a5d3ce1a3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:56.558641 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 28/57] 10.222.0.24 () {60 vars in 1140 bytes} [Thu May 19 14:50:56 2022] POST /identity/v3/projects => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:50:58.743677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c2bfd-2d82-4e5f-afbf-0e4cd8b4613b None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:58.744168 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c2bfd-2d82-4e5f-afbf-0e4cd8b4613b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:58.744248 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c2bfd-2d82-4e5f-afbf-0e4cd8b4613b None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:58.745612 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 30/58] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:50:58.750938 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a5308-e38e-445e-8341-e32917865ce4 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:58.751489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a5308-e38e-445e-8341-e32917865ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:58.751571 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a5308-e38e-445e-8341-e32917865ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:58.768359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-709a5308-e38e-445e-8341-e32917865ce4 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:50:58.769540 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-709a5308-e38e-445e-8341-e32917865ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:50:58.834388 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 29/59] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:50:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:50:58.858406 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c2bfd-2d82-4e5f-afbf-0e4cd8b4613b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:58.895008 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:58.965638 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c2bfd-2d82-4e5f-afbf-0e4cd8b4613b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:59.007276 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3e1f3-070c-47f5-9d06-0c4e065c3148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:59.008007 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3e1f3-070c-47f5-9d06-0c4e065c3148 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:59.008299 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3e1f3-070c-47f5-9d06-0c4e065c3148 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:59.008580 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3e1f3-070c-47f5-9d06-0c4e065c3148 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:59.009759 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3e1f3-070c-47f5-9d06-0c4e065c3148 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:59.011256 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3e1f3-070c-47f5-9d06-0c4e065c3148 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:59.012877 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 31/60] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:50:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:50:59.018580 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a5308-e38e-445e-8341-e32917865ce4 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:50:59.044866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:50:59.115537 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a5308-e38e-445e-8341-e32917865ce4 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:50:59.148426 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032005e-8dfb-4e7f-9c2f-944b28a73ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:50:59.149085 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032005e-8dfb-4e7f-9c2f-944b28a73ea3 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:50:59.149365 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032005e-8dfb-4e7f-9c2f-944b28a73ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:50:59.149638 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032005e-8dfb-4e7f-9c2f-944b28a73ea3 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:50:59.150339 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032005e-8dfb-4e7f-9c2f-944b28a73ea3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:50:59.151807 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032005e-8dfb-4e7f-9c2f-944b28a73ea3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:50:59.175991 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 30/61] 10.222.0.24 () {60 vars in 1132 bytes} [Thu May 19 14:50:59 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:51:02.472856 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa3b9e-efa0-486c-a6b3-4c01ae54a367 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:02.473897 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa3b9e-efa0-486c-a6b3-4c01ae54a367 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:02.474391 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa3b9e-efa0-486c-a6b3-4c01ae54a367 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:02.476031 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 32/62] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:02.481785 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf075d7-92a7-4284-b36c-1d6a47a790a8 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:02.482627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf075d7-92a7-4284-b36c-1d6a47a790a8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:02.483122 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf075d7-92a7-4284-b36c-1d6a47a790a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:02.506220 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7bf075d7-92a7-4284-b36c-1d6a47a790a8 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:02.507744 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7bf075d7-92a7-4284-b36c-1d6a47a790a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:02.614397 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 31/63] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:02.656684 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa3b9e-efa0-486c-a6b3-4c01ae54a367 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:02.754831 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92b8f3-1165-456b-8315-56c730c2e9d6 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:02.755480 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92b8f3-1165-456b-8315-56c730c2e9d6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:02.755960 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92b8f3-1165-456b-8315-56c730c2e9d6 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:02.757538 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 32/64] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:51:02.762824 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef608d6-f105-488e-8868-3a6caa75fbf3 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:02.763379 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef608d6-f105-488e-8868-3a6caa75fbf3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:02.763856 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef608d6-f105-488e-8868-3a6caa75fbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:02.781242 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-bef608d6-f105-488e-8868-3a6caa75fbf3 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:02.782738 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-bef608d6-f105-488e-8868-3a6caa75fbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:02.791760 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:02.801037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:02.817065 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa3b9e-efa0-486c-a6b3-4c01ae54a367 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:02.855634 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 33/65] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:51:02.888456 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2401f7c-10a8-44a1-a334-35daf2ed8344 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:02.889122 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2401f7c-10a8-44a1-a334-35daf2ed8344 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:02.889602 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2401f7c-10a8-44a1-a334-35daf2ed8344 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:02.891573 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 34/66] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:51:02.895666 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2401f7c-10a8-44a1-a334-35daf2ed8344 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:02.904651 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff6963-1e77-4094-bf06-23a4ee928be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:02.906623 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff6963-1e77-4094-bf06-23a4ee928be1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:02.907154 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff6963-1e77-4094-bf06-23a4ee928be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:02.907709 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff6963-1e77-4094-bf06-23a4ee928be1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:02.925128 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aff6963-1e77-4094-bf06-23a4ee928be1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:02.936717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-6aff6963-1e77-4094-bf06-23a4ee928be1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:02.936717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:02.936717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:02.936717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:02.936717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:02.936717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:02.936717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:02.936717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:02.936717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:02.936717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:02.936717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:02.936717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:02.936717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:02.936717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:02.936717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:02.936717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:02.937639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:02.937639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:02.937639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:02.937639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:02.937639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:02.937639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:02.937639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:02.937639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:02.937639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:02.937639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:02.937639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:02.937639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:51:02.937639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:02.937639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:02.937639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:02.937639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:02.938406 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:02.938406 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:02.938406 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:02.938406 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:02.938406 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:02.938406 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:02.938406 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:02.938406 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:02.938406 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:02.938406 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:02.938406 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:02.938406 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:51:02.941681 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 33/67] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:02.950781 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa959266-12f9-416e-a99f-000ec4d91984 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:02.951082 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa959266-12f9-416e-a99f-000ec4d91984 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:02.953017 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa959266-12f9-416e-a99f-000ec4d91984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:02.979170 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-aa959266-12f9-416e-a99f-000ec4d91984 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:02.981000 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-aa959266-12f9-416e-a99f-000ec4d91984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:03.019530 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2401f7c-10a8-44a1-a334-35daf2ed8344 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:03.056870 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0f7b8-a54d-442b-876b-e207390e62c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:03.057733 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0f7b8-a54d-442b-876b-e207390e62c3 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:03.058026 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0f7b8-a54d-442b-876b-e207390e62c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:03.058308 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0f7b8-a54d-442b-876b-e207390e62c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:03.070957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd0f7b8-a54d-442b-876b-e207390e62c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:03.079217 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 34/68] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:03.079217 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa959266-12f9-416e-a99f-000ec4d91984 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:03.086860 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-9bd0f7b8-a54d-442b-876b-e207390e62c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:03.086860 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:03.086860 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:03.086860 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:03.086860 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:03.086860 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:03.086860 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:03.086860 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:03.086860 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:03.086860 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:03.086860 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:03.086860 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:03.086860 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:03.086860 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:03.086860 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:03.086860 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:03.087741 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:03.087741 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:03.087741 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:03.087741 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:03.087741 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:03.087741 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:03.087741 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:03.087741 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:03.087741 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:03.087741 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:03.087741 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:03.087741 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:51:03.087741 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:03.087741 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:03.087741 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:03.087741 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:03.089334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:03.089334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:03.089334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:03.089334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:03.089334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:03.089334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:03.089334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:03.089334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:03.089334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:03.089334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:03.089334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:03.089334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:51:03.089334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 35/69] 10.222.0.24 () {56 vars in 1114 bytes} [Thu May 19 14:51:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:03.089958 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9812b6f-893b-4513-a948-12153c038c05 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:03.089958 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9812b6f-893b-4513-a948-12153c038c05 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:03.090080 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9812b6f-893b-4513-a948-12153c038c05 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:03.092597 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 36/70] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:03.100400 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9812b6f-893b-4513-a948-12153c038c05 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:03.104252 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:03.171170 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:03.188318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa959266-12f9-416e-a99f-000ec4d91984 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:03.209517 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9812b6f-893b-4513-a948-12153c038c05 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:03.221667 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2dc03-c1f6-4eeb-9415-38bf4aaaf191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:03.222336 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2dc03-c1f6-4eeb-9415-38bf4aaaf191 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:03.222619 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2dc03-c1f6-4eeb-9415-38bf4aaaf191 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:03.222901 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2dc03-c1f6-4eeb-9415-38bf4aaaf191 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:03.223674 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a2dc03-c1f6-4eeb-9415-38bf4aaaf191 None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:03.223985 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a2dc03-c1f6-4eeb-9415-38bf4aaaf191 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:03.225352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a2dc03-c1f6-4eeb-9415-38bf4aaaf191 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:03.233190 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 35/71] 10.222.0.24 () {56 vars in 1101 bytes} [Thu May 19 14:51:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:03.234255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff246e57-27c1-4734-aeb8-e916b8488a03 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:03.234547 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff246e57-27c1-4734-aeb8-e916b8488a03 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:03.234829 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff246e57-27c1-4734-aeb8-e916b8488a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:03.245377 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd316da2-ec6e-45ce-bd38-46484b563fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:03.246299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd316da2-ec6e-45ce-bd38-46484b563fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:03.246582 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd316da2-ec6e-45ce-bd38-46484b563fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:03.246862 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd316da2-ec6e-45ce-bd38-46484b563fd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:03.247651 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd316da2-ec6e-45ce-bd38-46484b563fd1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:03.247963 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd316da2-ec6e-45ce-bd38-46484b563fd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:03.249354 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd316da2-ec6e-45ce-bd38-46484b563fd1 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:03.250914 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ff246e57-27c1-4734-aeb8-e916b8488a03 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:03.252126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ff246e57-27c1-4734-aeb8-e916b8488a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:03.257919 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 37/72] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:51:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:03.258712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd316da2-ec6e-45ce-bd38-46484b563fd1 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:03.320655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 36/73] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:03.321641 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:03.321976 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6e203-e6cc-4177-9af7-86d3a4f28c44 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:03.322278 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6e203-e6cc-4177-9af7-86d3a4f28c44 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:03.324912 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6e203-e6cc-4177-9af7-86d3a4f28c44 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:03.324912 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 37/74] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:03.329389 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6e203-e6cc-4177-9af7-86d3a4f28c44 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:03.361983 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd316da2-ec6e-45ce-bd38-46484b563fd1 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:03.395849 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a8988-832a-4561-8394-10b0eaa315ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:03.396645 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a8988-832a-4561-8394-10b0eaa315ab None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:03.396925 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a8988-832a-4561-8394-10b0eaa315ab None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:03.397203 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a8988-832a-4561-8394-10b0eaa315ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:03.407407 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a8988-832a-4561-8394-10b0eaa315ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:03.407858 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:03.414984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-2b4a8988-832a-4561-8394-10b0eaa315ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:03.414984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:03.414984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:03.414984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:03.414984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:03.414984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:03.414984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:03.414984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:03.414984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:03.414984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:03.414984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:03.414984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:03.414984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:03.414984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:03.414984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:03.414984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:03.415893 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:03.415893 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:03.415893 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:03.415893 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:03.415893 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:03.415893 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:03.415893 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:03.415893 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:03.415893 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:03.415893 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:03.415893 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:03.415893 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:51:03.415893 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:03.415893 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:03.415893 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:03.415893 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:03.416638 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:03.416638 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:03.416638 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:03.416638 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:03.416638 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:03.416638 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:03.416638 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:03.416638 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:03.416638 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:03.416638 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:03.416638 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:03.416638 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:51:03.416638 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 38/75] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:51:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:03.417259 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a8988-832a-4561-8394-10b0eaa315ab None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:03.433662 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6e203-e6cc-4177-9af7-86d3a4f28c44 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:03.468019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1f24e-172b-4d70-b0e3-3cefb706de01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:03.468895 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1f24e-172b-4d70-b0e3-3cefb706de01 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:03.469178 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1f24e-172b-4d70-b0e3-3cefb706de01 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:03.469457 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1f24e-172b-4d70-b0e3-3cefb706de01 None admin] PATH_INFO: `/v3/users/c1ed4d1479484c11a4d2682af24a7155` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:03.482233 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1f24e-172b-4d70-b0e3-3cefb706de01 None admin] RBAC: Authorizing `identity:get_user(user_id=c1ed4d1479484c11a4d2682af24a7155)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:03.483763 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1f24e-172b-4d70-b0e3-3cefb706de01 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:03.485622 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 38/76] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:03 2022] GET /identity/v3/users/c1ed4d1479484c11a4d2682af24a7155 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:03.486606 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abaebd-b739-4b5c-b2c4-29fd398ed392 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:03.486932 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abaebd-b739-4b5c-b2c4-29fd398ed392 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:03.487243 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abaebd-b739-4b5c-b2c4-29fd398ed392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:03.503448 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-75abaebd-b739-4b5c-b2c4-29fd398ed392 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:03.504635 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-75abaebd-b739-4b5c-b2c4-29fd398ed392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:03.525897 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a8988-832a-4561-8394-10b0eaa315ab None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:03.548292 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:03.560293 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80016a-479a-4045-823e-a4f1faf13804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:03.561172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80016a-479a-4045-823e-a4f1faf13804 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:03.561462 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80016a-479a-4045-823e-a4f1faf13804 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:03.561749 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80016a-479a-4045-823e-a4f1faf13804 None admin] PATH_INFO: `/v3/users/c1ed4d1479484c11a4d2682af24a7155` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:03.563336 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80016a-479a-4045-823e-a4f1faf13804 None admin] RBAC: Authorizing `identity:get_user(user_id=c1ed4d1479484c11a4d2682af24a7155)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:03.564809 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80016a-479a-4045-823e-a4f1faf13804 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:03.566956 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 39/77] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:03 2022] GET /identity/v3/users/c1ed4d1479484c11a4d2682af24a7155 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:03.567753 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80016a-479a-4045-823e-a4f1faf13804 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:03.578383 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 39/78] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:03.578383 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abaebd-b739-4b5c-b2c4-29fd398ed392 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:03.640090 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:03.670078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80016a-479a-4045-823e-a4f1faf13804 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:03.673380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abaebd-b739-4b5c-b2c4-29fd398ed392 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:03.703582 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0f7d8-1718-4f41-ac1b-7fad9d2843fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:03.704312 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0f7d8-1718-4f41-ac1b-7fad9d2843fe None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:03.704599 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0f7d8-1718-4f41-ac1b-7fad9d2843fe None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:03.704879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0f7d8-1718-4f41-ac1b-7fad9d2843fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:03.706082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0f7d8-1718-4f41-ac1b-7fad9d2843fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:03.707408 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c0ea0-1d88-4654-8c2f-25dec044363d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:03.707563 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0f7d8-1718-4f41-ac1b-7fad9d2843fe None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:03.708083 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c0ea0-1d88-4654-8c2f-25dec044363d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:03.708378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c0ea0-1d88-4654-8c2f-25dec044363d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:03.708663 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c0ea0-1d88-4654-8c2f-25dec044363d None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:03.713773 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 40/79] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:51:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:03.713896 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c0ea0-1d88-4654-8c2f-25dec044363d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:03.713896 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c0ea0-1d88-4654-8c2f-25dec044363d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:03.714048 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0f7d8-1718-4f41-ac1b-7fad9d2843fe None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:03.714144 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c0ea0-1d88-4654-8c2f-25dec044363d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:03.719161 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 40/80] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:03.719988 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c0ea0-1d88-4654-8c2f-25dec044363d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:03.772633 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:03.813090 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0f7d8-1718-4f41-ac1b-7fad9d2843fe None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:03.819830 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c0ea0-1d88-4654-8c2f-25dec044363d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:03.844719 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:03.846872 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2255c-9030-4df9-be8b-e74495018de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:03.847624 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2255c-9030-4df9-be8b-e74495018de0 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:03.847911 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2255c-9030-4df9-be8b-e74495018de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:03.848184 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2255c-9030-4df9-be8b-e74495018de0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:03.853131 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10453da0-51ec-47aa-8b07-4423fbb12d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:03.853781 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10453da0-51ec-47aa-8b07-4423fbb12d19 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:03.854076 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10453da0-51ec-47aa-8b07-4423fbb12d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:03.854360 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10453da0-51ec-47aa-8b07-4423fbb12d19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:03.914218 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2255c-9030-4df9-be8b-e74495018de0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:03.915712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2255c-9030-4df9-be8b-e74495018de0 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:03.919815 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10453da0-51ec-47aa-8b07-4423fbb12d19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:03.921273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10453da0-51ec-47aa-8b07-4423fbb12d19 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:03.971833 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:04.015287 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 41/81] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:51:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:04.015921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2255c-9030-4df9-be8b-e74495018de0 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:04.021881 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 41/82] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:51:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:04.022712 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10453da0-51ec-47aa-8b07-4423fbb12d19 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:04.048984 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:04.118392 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2255c-9030-4df9-be8b-e74495018de0 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:04.119051 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10453da0-51ec-47aa-8b07-4423fbb12d19 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:04.154337 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e179a0-38db-47cf-9c2c-fc38964ec196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:04.154984 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023da798-2fa4-4a8f-b1d9-4055c61f412b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:04.155142 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e179a0-38db-47cf-9c2c-fc38964ec196 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:04.155454 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e179a0-38db-47cf-9c2c-fc38964ec196 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:04.155683 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023da798-2fa4-4a8f-b1d9-4055c61f412b None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:04.155775 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e179a0-38db-47cf-9c2c-fc38964ec196 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:04.155967 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023da798-2fa4-4a8f-b1d9-4055c61f412b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:04.156244 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023da798-2fa4-4a8f-b1d9-4055c61f412b None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:04.156953 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023da798-2fa4-4a8f-b1d9-4055c61f412b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:04.158608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023da798-2fa4-4a8f-b1d9-4055c61f412b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:04.166197 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e179a0-38db-47cf-9c2c-fc38964ec196 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:04.173804 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-b7e179a0-38db-47cf-9c2c-fc38964ec196 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:04.173804 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:04.173804 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:04.173804 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:04.173804 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:04.173804 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:04.173804 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:04.173804 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:04.173804 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:04.173804 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:04.173804 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:04.173804 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:04.173804 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:04.173804 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:04.173804 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:04.173804 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:04.175465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:04.175465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:04.175465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:04.175465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:04.175465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:04.175465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:04.175465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:04.175465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:04.175465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:04.175465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:04.175465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:04.175465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:51:04.175465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:04.175465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:04.175465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:04.175465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:04.176285 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:04.176285 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:04.176285 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:04.176285 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:04.176285 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:04.176285 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:04.176285 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:04.176285 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:04.176285 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:04.176285 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:04.176285 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:04.176285 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:51:04.176285 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 42/83] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:04.176905 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e179a0-38db-47cf-9c2c-fc38964ec196 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:04.188930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 42/84] 10.222.0.24 () {60 vars in 1132 bytes} [Thu May 19 14:51:04 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:51:04.189765 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023da798-2fa4-4a8f-b1d9-4055c61f412b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:04.201235 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:04.292113 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:04.293707 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e179a0-38db-47cf-9c2c-fc38964ec196 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:04.312697 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023da798-2fa4-4a8f-b1d9-4055c61f412b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:04.343019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76f220-fba0-4fad-82bd-b5dd019bd2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:04.343977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76f220-fba0-4fad-82bd-b5dd019bd2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:04.344255 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76f220-fba0-4fad-82bd-b5dd019bd2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:04.344781 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76f220-fba0-4fad-82bd-b5dd019bd2f2 None admin] PATH_INFO: `/v3/users/83eec44e6acd4004ba2088801e9d8f88` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:04.345792 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76f220-fba0-4fad-82bd-b5dd019bd2f2 None admin] RBAC: Authorizing `identity:get_user(user_id=83eec44e6acd4004ba2088801e9d8f88)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:04.347376 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76f220-fba0-4fad-82bd-b5dd019bd2f2 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:04.349069 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 43/85] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:04 2022] GET /identity/v3/users/83eec44e6acd4004ba2088801e9d8f88 => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:04.353977 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f15c1a-8b5f-4975-80e4-73f75fbaf8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:04.354089 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76f220-fba0-4fad-82bd-b5dd019bd2f2 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:04.354171 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f15c1a-8b5f-4975-80e4-73f75fbaf8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:04.354171 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f15c1a-8b5f-4975-80e4-73f75fbaf8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:04.354171 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f15c1a-8b5f-4975-80e4-73f75fbaf8f9 None admin] PATH_INFO: `/v3/projects/824de15367424616b3588eca8e09020e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:04.354171 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f15c1a-8b5f-4975-80e4-73f75fbaf8f9 None admin] RBAC: Authorizing `identity:get_project(project_id=824de15367424616b3588eca8e09020e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:04.354171 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f15c1a-8b5f-4975-80e4-73f75fbaf8f9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:04.360700 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 43/86] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:04 2022] GET /identity/v3/projects/824de15367424616b3588eca8e09020e => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:04.361455 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f15c1a-8b5f-4975-80e4-73f75fbaf8f9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:04.462900 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:04.479528 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76f220-fba0-4fad-82bd-b5dd019bd2f2 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:04.483434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f15c1a-8b5f-4975-80e4-73f75fbaf8f9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:04.522223 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f3847-7ee9-42b7-85e8-f6817c03fa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:04.523108 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f3847-7ee9-42b7-85e8-f6817c03fa9e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:04.523425 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f3847-7ee9-42b7-85e8-f6817c03fa9e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:04.523708 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f3847-7ee9-42b7-85e8-f6817c03fa9e None admin] PATH_INFO: `/v3/projects/824de15367424616b3588eca8e09020e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:04.524923 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f3847-7ee9-42b7-85e8-f6817c03fa9e None admin] RBAC: Authorizing `identity:get_project(project_id=824de15367424616b3588eca8e09020e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:04.526384 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f3847-7ee9-42b7-85e8-f6817c03fa9e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:04.528420 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 44/87] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:04 2022] GET /identity/v3/projects/824de15367424616b3588eca8e09020e => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:04.528982 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f3847-7ee9-42b7-85e8-f6817c03fa9e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:04.529601 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37043ea9-bcc7-44a6-ba3e-4b7ed6277dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:04.530280 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37043ea9-bcc7-44a6-ba3e-4b7ed6277dae None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:04.530573 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37043ea9-bcc7-44a6-ba3e-4b7ed6277dae None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:04.530857 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37043ea9-bcc7-44a6-ba3e-4b7ed6277dae None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:04.531656 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37043ea9-bcc7-44a6-ba3e-4b7ed6277dae None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:04.531970 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37043ea9-bcc7-44a6-ba3e-4b7ed6277dae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:04.534478 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37043ea9-bcc7-44a6-ba3e-4b7ed6277dae None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:04.545484 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 44/88] 10.222.0.24 () {56 vars in 1101 bytes} [Thu May 19 14:51:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:04.546628 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37043ea9-bcc7-44a6-ba3e-4b7ed6277dae None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:04.565792 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:04.651215 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f3847-7ee9-42b7-85e8-f6817c03fa9e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:04.679490 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37043ea9-bcc7-44a6-ba3e-4b7ed6277dae None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:04.687102 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2842fb4-3f51-415d-b8b6-9607ae8a9f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:04.687805 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2842fb4-3f51-415d-b8b6-9607ae8a9f81 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:04.688091 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2842fb4-3f51-415d-b8b6-9607ae8a9f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:04.688371 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2842fb4-3f51-415d-b8b6-9607ae8a9f81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:04.714718 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:04.718432 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a2977-dcc4-437f-98a8-76d8b121e15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:04.719094 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a2977-dcc4-437f-98a8-76d8b121e15c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:04.719417 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a2977-dcc4-437f-98a8-76d8b121e15c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:04.719713 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a2977-dcc4-437f-98a8-76d8b121e15c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:04.720538 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a2977-dcc4-437f-98a8-76d8b121e15c None admin] RBAC: Adding query filter params (role.id=fd5043dc9e3e4ec49e035ee01fc68854, scope.project.id=824de15367424616b3588eca8e09020e, user.id=c1ed4d1479484c11a4d2682af24a7155) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:04.720856 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a2977-dcc4-437f-98a8-76d8b121e15c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:04.722703 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a2977-dcc4-437f-98a8-76d8b121e15c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:04.729606 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 45/89] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:51:04 2022] GET /identity/v3/role_assignments?user.id=c1ed4d1479484c11a4d2682af24a7155&scope.project.id=824de15367424616b3588eca8e09020e&role.id=fd5043dc9e3e4ec49e035ee01fc68854 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:04.730523 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a2977-dcc4-437f-98a8-76d8b121e15c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:04.762770 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2842fb4-3f51-415d-b8b6-9607ae8a9f81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:04.764365 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2842fb4-3f51-415d-b8b6-9607ae8a9f81 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:04.821183 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:04.847267 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a2977-dcc4-437f-98a8-76d8b121e15c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:04.879618 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 45/90] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:51:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:04.880376 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2842fb4-3f51-415d-b8b6-9607ae8a9f81 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:04.913834 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982e36d-6bb1-44db-91df-ae3227b1e8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:04.914518 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982e36d-6bb1-44db-91df-ae3227b1e8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:04.914811 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982e36d-6bb1-44db-91df-ae3227b1e8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:04.915089 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982e36d-6bb1-44db-91df-ae3227b1e8a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:04.924819 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982e36d-6bb1-44db-91df-ae3227b1e8a5 None admin] RBAC: Adding query filter params (role.id=9d41dc09d0f646b1994526fcbd8d3622, scope.project.id=824de15367424616b3588eca8e09020e, user.id=c1ed4d1479484c11a4d2682af24a7155) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:04.925164 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982e36d-6bb1-44db-91df-ae3227b1e8a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:04.926664 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982e36d-6bb1-44db-91df-ae3227b1e8a5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:04.939742 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 46/91] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:51:04 2022] GET /identity/v3/role_assignments?user.id=c1ed4d1479484c11a4d2682af24a7155&scope.project.id=824de15367424616b3588eca8e09020e&role.id=9d41dc09d0f646b1994526fcbd8d3622 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:04.940786 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982e36d-6bb1-44db-91df-ae3227b1e8a5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:04.952732 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:04.992536 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2842fb4-3f51-415d-b8b6-9607ae8a9f81 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:05.032387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb415d-8650-499e-9ba3-82175e1854f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:05.033270 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb415d-8650-499e-9ba3-82175e1854f5 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:05.034074 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb415d-8650-499e-9ba3-82175e1854f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:05.034364 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cb415d-8650-499e-9ba3-82175e1854f5 None admin] PATH_INFO: `/v3/users/c1ed4d1479484c11a4d2682af24a7155` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:05.035624 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb415d-8650-499e-9ba3-82175e1854f5 None admin] RBAC: Authorizing `identity:get_user(user_id=c1ed4d1479484c11a4d2682af24a7155)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:05.037100 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cb415d-8650-499e-9ba3-82175e1854f5 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:05.038922 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 46/92] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:04 2022] GET /identity/v3/users/c1ed4d1479484c11a4d2682af24a7155 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:05.045612 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb415d-8650-499e-9ba3-82175e1854f5 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:05.150437 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982e36d-6bb1-44db-91df-ae3227b1e8a5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:05.216019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cb415d-8650-499e-9ba3-82175e1854f5 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:05.219999 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef9939-b479-44a0-9297-5deb049c19c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:05.220898 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef9939-b479-44a0-9297-5deb049c19c1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:05.221796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef9939-b479-44a0-9297-5deb049c19c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:05.222074 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef9939-b479-44a0-9297-5deb049c19c1 None admin] PATH_INFO: `/v3/projects/824de15367424616b3588eca8e09020e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:05.228212 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef9939-b479-44a0-9297-5deb049c19c1 None admin] RBAC: Authorizing `identity:get_project(project_id=824de15367424616b3588eca8e09020e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:05.229712 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef9939-b479-44a0-9297-5deb049c19c1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:05.232164 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 47/93] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:04 2022] GET /identity/v3/projects/824de15367424616b3588eca8e09020e => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:05.252291 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef9939-b479-44a0-9297-5deb049c19c1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:05.255571 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:05.268648 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956f8e2-26a7-4942-ab24-51dac58c6c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:05.269313 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956f8e2-26a7-4942-ab24-51dac58c6c67 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:05.269603 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956f8e2-26a7-4942-ab24-51dac58c6c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:05.269887 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956f8e2-26a7-4942-ab24-51dac58c6c67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:05.281985 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:05.344751 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956f8e2-26a7-4942-ab24-51dac58c6c67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:05.346828 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956f8e2-26a7-4942-ab24-51dac58c6c67 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:05.469177 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef9939-b479-44a0-9297-5deb049c19c1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:05.508115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 47/94] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:51:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:05.513804 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956f8e2-26a7-4942-ab24-51dac58c6c67 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:05.530245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b61d4f-0f74-499b-b2fc-6b68546022c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:05.531233 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b61d4f-0f74-499b-b2fc-6b68546022c4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:05.531705 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b61d4f-0f74-499b-b2fc-6b68546022c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:05.532138 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b61d4f-0f74-499b-b2fc-6b68546022c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:05.532991 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b61d4f-0f74-499b-b2fc-6b68546022c4 None admin] RBAC: Adding query filter params (role.id=ec4b73b709ca4cdc983e35e955aed57a, scope.project.id=824de15367424616b3588eca8e09020e, user.id=83eec44e6acd4004ba2088801e9d8f88) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:05.533310 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b61d4f-0f74-499b-b2fc-6b68546022c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:05.534796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b61d4f-0f74-499b-b2fc-6b68546022c4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:05.541049 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 48/95] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:51:05 2022] GET /identity/v3/role_assignments?user.id=83eec44e6acd4004ba2088801e9d8f88&scope.project.id=824de15367424616b3588eca8e09020e&role.id=ec4b73b709ca4cdc983e35e955aed57a => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:05.560132 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:05.676372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956f8e2-26a7-4942-ab24-51dac58c6c67 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:05.713892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5d66c-322c-47fa-a2ab-1bf452df7407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:05.714900 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5d66c-322c-47fa-a2ab-1bf452df7407 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:05.715180 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5d66c-322c-47fa-a2ab-1bf452df7407 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:05.715477 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5d66c-322c-47fa-a2ab-1bf452df7407 None admin] PATH_INFO: `/v3/projects/79cbeffd8afa428395c1dc80fc054a7e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:05.716699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5d66c-322c-47fa-a2ab-1bf452df7407 None admin] RBAC: Authorizing `identity:get_project(project_id=79cbeffd8afa428395c1dc80fc054a7e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:05.718153 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5d66c-322c-47fa-a2ab-1bf452df7407 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:05.720129 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 48/96] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:05 2022] GET /identity/v3/projects/79cbeffd8afa428395c1dc80fc054a7e => generated 312 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:05.726532 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b61d4f-0f74-499b-b2fc-6b68546022c4 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:05.816137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:05.842822 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b61d4f-0f74-499b-b2fc-6b68546022c4 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:05.879580 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e7e99-24a4-4d1a-92b0-9d32c335f456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:05.880320 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e7e99-24a4-4d1a-92b0-9d32c335f456 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:05.880608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e7e99-24a4-4d1a-92b0-9d32c335f456 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:05.880886 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e7e99-24a4-4d1a-92b0-9d32c335f456 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:05.881733 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e7e99-24a4-4d1a-92b0-9d32c335f456 None admin] RBAC: Adding query filter params (role.id=fd5043dc9e3e4ec49e035ee01fc68854, scope.project.id=79cbeffd8afa428395c1dc80fc054a7e, user.id=c1ed4d1479484c11a4d2682af24a7155) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:05.882052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e7e99-24a4-4d1a-92b0-9d32c335f456 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:05.883660 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e7e99-24a4-4d1a-92b0-9d32c335f456 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:05.890582 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 49/97] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:51:05 2022] GET /identity/v3/role_assignments?user.id=c1ed4d1479484c11a4d2682af24a7155&scope.project.id=79cbeffd8afa428395c1dc80fc054a7e&role.id=fd5043dc9e3e4ec49e035ee01fc68854 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:06.811529 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618605c-367b-4ae2-811b-d66c3149eda8 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:06.812571 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618605c-367b-4ae2-811b-d66c3149eda8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:06.813111 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618605c-367b-4ae2-811b-d66c3149eda8 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:06.815542 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 49/98] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:06.821180 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d0708-db09-4228-852b-86401e4749f7 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:06.821985 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d0708-db09-4228-852b-86401e4749f7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:06.822461 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d0708-db09-4228-852b-86401e4749f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:06.843950 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f68d0708-db09-4228-852b-86401e4749f7 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:06.845450 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f68d0708-db09-4228-852b-86401e4749f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:06.930105 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 50/99] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:06.953840 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618605c-367b-4ae2-811b-d66c3149eda8 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:07.075060 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:07.089454 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618605c-367b-4ae2-811b-d66c3149eda8 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:07.133557 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b17d04-03bb-48a7-ad53-bc0b5210dd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:07.134339 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b17d04-03bb-48a7-ad53-bc0b5210dd0a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:07.134623 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b17d04-03bb-48a7-ad53-bc0b5210dd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:07.134898 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b17d04-03bb-48a7-ad53-bc0b5210dd0a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:07.151826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b17d04-03bb-48a7-ad53-bc0b5210dd0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:07.160306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-75b17d04-03bb-48a7-ad53-bc0b5210dd0a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:51:07.160306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:07.160306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:07.160306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:07.160306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:07.160306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:07.160306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:07.160306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:07.160306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:07.160306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:07.160306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:07.160306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:07.160306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:07.160306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:07.160306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:07.160306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:07.161213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:07.161213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:07.161213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:07.161213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:07.161213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:07.161213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:07.161213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:07.161213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:07.161213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:07.161213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:07.161213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:07.161213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:51:07.161213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:07.161213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:07.161213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:07.161213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:07.161947 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:07.161947 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:07.161947 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:07.161947 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:07.161947 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:07.161947 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:07.161947 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:07.161947 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:07.161947 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:07.161947 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:07.161947 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:51:07.161947 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:51:07.161947 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 50/100] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:07.168695 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d0708-db09-4228-852b-86401e4749f7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:07.244886 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:07.284420 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d0708-db09-4228-852b-86401e4749f7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:07.328378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc9dd3-b7b0-40a4-b9b7-e7600293afb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:07.329007 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc9dd3-b7b0-40a4-b9b7-e7600293afb8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:07.329305 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc9dd3-b7b0-40a4-b9b7-e7600293afb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:07.329596 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc9dd3-b7b0-40a4-b9b7-e7600293afb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:07.330407 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cc9dd3-b7b0-40a4-b9b7-e7600293afb8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:07.330726 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cc9dd3-b7b0-40a4-b9b7-e7600293afb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:07.332154 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cc9dd3-b7b0-40a4-b9b7-e7600293afb8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:07.341223 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 51/101] 10.222.0.24 () {56 vars in 1101 bytes} [Thu May 19 14:51:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:07.352298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b17d04-03bb-48a7-ad53-bc0b5210dd0a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:07.496293 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b17d04-03bb-48a7-ad53-bc0b5210dd0a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:07.534464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447ee38-d409-4a8d-b001-01230d821892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:07.535721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447ee38-d409-4a8d-b001-01230d821892 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:07.536211 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447ee38-d409-4a8d-b001-01230d821892 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:07.536689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447ee38-d409-4a8d-b001-01230d821892 None admin] PATH_INFO: `/v3/users/d26b504ccdc846ccad497028c783a508` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:07.552636 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447ee38-d409-4a8d-b001-01230d821892 None admin] RBAC: Authorizing `identity:get_user(user_id=d26b504ccdc846ccad497028c783a508)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:07.554399 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447ee38-d409-4a8d-b001-01230d821892 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:07.556642 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 51/102] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:07 2022] GET /identity/v3/users/d26b504ccdc846ccad497028c783a508 => generated 289 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:07.561876 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc9dd3-b7b0-40a4-b9b7-e7600293afb8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:07.713236 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc9dd3-b7b0-40a4-b9b7-e7600293afb8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:07.756673 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:07.768725 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bdc2a-8e66-4eac-90fa-e08e2878b3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:07.769428 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bdc2a-8e66-4eac-90fa-e08e2878b3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:07.770206 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bdc2a-8e66-4eac-90fa-e08e2878b3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:07.770503 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bdc2a-8e66-4eac-90fa-e08e2878b3a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:07.853337 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50bdc2a-8e66-4eac-90fa-e08e2878b3a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:07.854828 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50bdc2a-8e66-4eac-90fa-e08e2878b3a1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:07.978052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 52/103] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:51:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:07.983705 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447ee38-d409-4a8d-b001-01230d821892 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:07.999764 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:08.122387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447ee38-d409-4a8d-b001-01230d821892 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:08.144849 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd91476-9e1c-439c-aa0f-cdb6edb32ae4 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:08.145522 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd91476-9e1c-439c-aa0f-cdb6edb32ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:08.146002 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd91476-9e1c-439c-aa0f-cdb6edb32ae4 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:08.147721 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 53/104] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:08.156521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc125d7e-f454-4944-acf1-6709d8c0dd74 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:08.157079 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc125d7e-f454-4944-acf1-6709d8c0dd74 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:08.157568 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc125d7e-f454-4944-acf1-6709d8c0dd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:08.163228 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cee4f8-c854-4469-9eaf-63321d92f5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:08.163228 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cee4f8-c854-4469-9eaf-63321d92f5db None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:08.163228 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cee4f8-c854-4469-9eaf-63321d92f5db None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:08.163228 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cee4f8-c854-4469-9eaf-63321d92f5db None admin] PATH_INFO: `/v3/projects/824de15367424616b3588eca8e09020e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:08.163554 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cee4f8-c854-4469-9eaf-63321d92f5db None admin] RBAC: Authorizing `identity:get_project(project_id=824de15367424616b3588eca8e09020e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:08.163554 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cee4f8-c854-4469-9eaf-63321d92f5db None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:08.165489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 52/105] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:07 2022] GET /identity/v3/projects/824de15367424616b3588eca8e09020e => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:08.172087 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cee4f8-c854-4469-9eaf-63321d92f5db None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:08.196260 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-fc125d7e-f454-4944-acf1-6709d8c0dd74 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:08.197837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fc125d7e-f454-4944-acf1-6709d8c0dd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:08.250036 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:08.323266 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:08.381691 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 54/106] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:51:08.382880 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262d9e0-60fc-4c8c-89ed-8b50c2b8c11e None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:08.383175 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262d9e0-60fc-4c8c-89ed-8b50c2b8c11e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:08.386066 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cee4f8-c854-4469-9eaf-63321d92f5db None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:08.387654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262d9e0-60fc-4c8c-89ed-8b50c2b8c11e None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:08.389027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 55/107] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:08.395439 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3e39b-7c19-4ba6-9ebf-3142b691785d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:08.395730 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3e39b-7c19-4ba6-9ebf-3142b691785d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:08.396017 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3e39b-7c19-4ba6-9ebf-3142b691785d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:08.425455 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d1a3e39b-7c19-4ba6-9ebf-3142b691785d None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:08.426649 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d1a3e39b-7c19-4ba6-9ebf-3142b691785d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:08.449387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d92b25-5508-498c-8d97-ca31f1ea61f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:08.451436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d92b25-5508-498c-8d97-ca31f1ea61f0 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:08.452265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d92b25-5508-498c-8d97-ca31f1ea61f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:08.452928 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d92b25-5508-498c-8d97-ca31f1ea61f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:08.454532 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d92b25-5508-498c-8d97-ca31f1ea61f0 None admin] RBAC: Adding query filter params (role.id=1e1d2d30ba484c3f80d3cbb6f407a716, scope.project.id=824de15367424616b3588eca8e09020e, user.id=d26b504ccdc846ccad497028c783a508) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:08.455462 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d92b25-5508-498c-8d97-ca31f1ea61f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:08.457874 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d92b25-5508-498c-8d97-ca31f1ea61f0 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:08.470493 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 53/108] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:51:08 2022] GET /identity/v3/role_assignments?user.id=d26b504ccdc846ccad497028c783a508&scope.project.id=824de15367424616b3588eca8e09020e&role.id=1e1d2d30ba484c3f80d3cbb6f407a716 => generated 259 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:08.473199 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d92b25-5508-498c-8d97-ca31f1ea61f0 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:08.573764 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 56/109] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:51:08.616082 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3e39b-7c19-4ba6-9ebf-3142b691785d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:08.676108 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d92b25-5508-498c-8d97-ca31f1ea61f0 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:08.747572 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e659fa-de67-4b04-9ed4-4e06ab554050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:08.748946 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e659fa-de67-4b04-9ed4-4e06ab554050 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:08.751811 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e659fa-de67-4b04-9ed4-4e06ab554050 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:08.752480 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e659fa-de67-4b04-9ed4-4e06ab554050 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:08.754167 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e659fa-de67-4b04-9ed4-4e06ab554050 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:08.756945 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e659fa-de67-4b04-9ed4-4e06ab554050 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:08.762836 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 54/110] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:51:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:08.770661 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e659fa-de67-4b04-9ed4-4e06ab554050 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:08.797232 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:08.804856 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:08.814961 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3e39b-7c19-4ba6-9ebf-3142b691785d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:08.865927 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890442f-e978-4d8c-82e8-7050c61d4252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:08.866696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890442f-e978-4d8c-82e8-7050c61d4252 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:08.866985 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890442f-e978-4d8c-82e8-7050c61d4252 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:08.867294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890442f-e978-4d8c-82e8-7050c61d4252 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:08.882389 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890442f-e978-4d8c-82e8-7050c61d4252 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:08.893443 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-d890442f-e978-4d8c-82e8-7050c61d4252 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:08.893443 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:08.893443 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:08.893443 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:08.893443 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:08.893443 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:08.893443 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:08.893443 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:08.893443 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:08.893443 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:08.893443 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:08.893443 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:08.893443 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:08.893443 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:08.893443 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:08.893443 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:08.894361 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:08.894361 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:08.894361 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:08.894361 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:08.894361 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:08.894361 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:08.894361 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:08.894361 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:08.894361 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:08.894361 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:08.894361 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:08.894361 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:51:08.894361 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:08.894361 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:08.894361 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:08.894361 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:08.895126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:08.895126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:08.895126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:08.895126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:08.895126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:08.895126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:08.895126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:08.895126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:08.895126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:08.895126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:08.895126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:08.895126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:51:08.895126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 57/111] 10.222.0.24 () {56 vars in 1114 bytes} [Thu May 19 14:51:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:51:08.900779 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3d0b4-1fc2-40ec-bed5-c6b42dd3494a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:08.901083 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3d0b4-1fc2-40ec-bed5-c6b42dd3494a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:08.901386 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3d0b4-1fc2-40ec-bed5-c6b42dd3494a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:08.902913 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 58/112] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:08.909065 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3d0b4-1fc2-40ec-bed5-c6b42dd3494a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:08.955215 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e659fa-de67-4b04-9ed4-4e06ab554050 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:08.992516 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0646cf1-8bd4-493c-be83-0283a3d858b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:08.994135 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0646cf1-8bd4-493c-be83-0283a3d858b5 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:08.994640 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0646cf1-8bd4-493c-be83-0283a3d858b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:08.995301 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0646cf1-8bd4-493c-be83-0283a3d858b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:08.996479 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0646cf1-8bd4-493c-be83-0283a3d858b5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:08.998155 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0646cf1-8bd4-493c-be83-0283a3d858b5 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:09.029211 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 55/113] 10.222.0.24 () {60 vars in 1141 bytes} [Thu May 19 14:51:08 2022] POST /identity/v3/projects => generated 302 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:51:09.030847 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386afba-500a-4ee9-93ed-af13605b8149 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:09.031447 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386afba-500a-4ee9-93ed-af13605b8149 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:09.031733 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386afba-500a-4ee9-93ed-af13605b8149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:09.051450 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9386afba-500a-4ee9-93ed-af13605b8149 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:09.052984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9386afba-500a-4ee9-93ed-af13605b8149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:09.093021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3d0b4-1fc2-40ec-bed5-c6b42dd3494a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:09.146164 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:09.153418 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49fe77d-746d-4df5-b9b5-29b08eecd506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:09.154135 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fe77d-746d-4df5-b9b5-29b08eecd506 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:09.154430 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fe77d-746d-4df5-b9b5-29b08eecd506 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:09.154716 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fe77d-746d-4df5-b9b5-29b08eecd506 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:09.155759 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49fe77d-746d-4df5-b9b5-29b08eecd506 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:09.156085 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49fe77d-746d-4df5-b9b5-29b08eecd506 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:09.158306 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49fe77d-746d-4df5-b9b5-29b08eecd506 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:09.163373 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 56/114] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:09.165518 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6517ca6-d960-4c06-a0bf-f18128f01308 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:09.166014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6517ca6-d960-4c06-a0bf-f18128f01308 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:09.166505 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6517ca6-d960-4c06-a0bf-f18128f01308 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:09.173001 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 57/115] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:09.175868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb462f7-be07-4c92-98da-051f16f45fcc None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:09.176431 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb462f7-be07-4c92-98da-051f16f45fcc None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:09.177075 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 59/116] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:51:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:09.177447 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb462f7-be07-4c92-98da-051f16f45fcc None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:09.179291 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 58/117] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:09.182648 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb462f7-be07-4c92-98da-051f16f45fcc None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:09.183137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e6aaf-99ba-453b-a0cc-4468b1299003 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:09.183509 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e6aaf-99ba-453b-a0cc-4468b1299003 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:09.183758 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e6aaf-99ba-453b-a0cc-4468b1299003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:09.226970 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ae1e6aaf-99ba-453b-a0cc-4468b1299003 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:09.228451 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ae1e6aaf-99ba-453b-a0cc-4468b1299003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:09.239020 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:09.320311 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 60/118] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:09.326004 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb462f7-be07-4c92-98da-051f16f45fcc None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:09.326239 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1f8ea-92e7-4bf2-89d4-27050bb237ba None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:09.326492 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1f8ea-92e7-4bf2-89d4-27050bb237ba None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:09.326826 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1f8ea-92e7-4bf2-89d4-27050bb237ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:09.350721 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0ec1f8ea-92e7-4bf2-89d4-27050bb237ba None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:09.351958 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0ec1f8ea-92e7-4bf2-89d4-27050bb237ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:09.376005 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36750fec-91a7-4b1b-94ab-5d8e5effad92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:09.377754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36750fec-91a7-4b1b-94ab-5d8e5effad92 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:09.378235 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36750fec-91a7-4b1b-94ab-5d8e5effad92 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:09.378705 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36750fec-91a7-4b1b-94ab-5d8e5effad92 None admin] PATH_INFO: `/v3/users/c1ed4d1479484c11a4d2682af24a7155` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:09.380228 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36750fec-91a7-4b1b-94ab-5d8e5effad92 None admin] RBAC: Authorizing `identity:get_user(user_id=c1ed4d1479484c11a4d2682af24a7155)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:09.381934 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36750fec-91a7-4b1b-94ab-5d8e5effad92 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:09.383825 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 59/119] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:09 2022] GET /identity/v3/users/c1ed4d1479484c11a4d2682af24a7155 => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:09.385015 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36750fec-91a7-4b1b-94ab-5d8e5effad92 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:09.424363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 61/120] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:09.424992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1f8ea-92e7-4bf2-89d4-27050bb237ba None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:09.449074 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:09.494483 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36750fec-91a7-4b1b-94ab-5d8e5effad92 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:09.507532 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:09.534989 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e160c-f603-4ddb-bce4-e0cdc84bb943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:09.535994 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e160c-f603-4ddb-bce4-e0cdc84bb943 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:09.536381 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e160c-f603-4ddb-bce4-e0cdc84bb943 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:09.536778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e160c-f603-4ddb-bce4-e0cdc84bb943 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:09.540830 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1f8ea-92e7-4bf2-89d4-27050bb237ba None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:09.548091 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e160c-f603-4ddb-bce4-e0cdc84bb943 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:09.556359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-813e160c-f603-4ddb-bce4-e0cdc84bb943 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:09.556359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:09.556359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:09.556359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:09.556359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:09.556359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:09.556359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:09.556359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:09.556359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:09.556359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:09.556359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:09.556359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:09.556359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:09.556359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:09.556359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:09.556359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:09.557267 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:09.557267 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:09.557267 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:09.557267 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:09.557267 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:09.557267 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:09.557267 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:09.557267 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:09.557267 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:09.557267 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:09.557267 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:09.557267 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:51:09.557267 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:09.557267 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:09.557267 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:09.557267 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:09.558004 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:09.558004 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:09.558004 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:09.558004 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:09.558004 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:09.558004 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:09.558004 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:09.558004 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:09.558004 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:09.558004 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:09.558004 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:09.558004 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:51:09.558004 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 60/121] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:09.558635 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e160c-f603-4ddb-bce4-e0cdc84bb943 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:09.581403 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786aea8-fbbc-4084-87ae-dfb860f0e5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:09.583067 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786aea8-fbbc-4084-87ae-dfb860f0e5bf None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:09.583613 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786aea8-fbbc-4084-87ae-dfb860f0e5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:09.584060 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786aea8-fbbc-4084-87ae-dfb860f0e5bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:09.595354 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786aea8-fbbc-4084-87ae-dfb860f0e5bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:09.603749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-9786aea8-fbbc-4084-87ae-dfb860f0e5bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:09.603749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:09.603749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:09.603749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:09.603749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:09.603749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:09.603749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:09.603749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:09.603749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:09.603749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:09.603749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:09.603749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:09.603749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:09.603749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:09.603749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:09.603749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:09.604582 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:09.604582 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:09.604582 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:09.604582 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:09.604582 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:09.604582 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:09.604582 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:09.604582 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:09.604582 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:09.604582 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:09.604582 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:09.604582 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:51:09.604582 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:09.604582 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:09.604582 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:09.604582 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:09.605334 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:09.605334 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:09.605334 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:09.605334 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:09.605334 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:09.605334 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:09.605334 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:09.605334 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:09.605334 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:09.605334 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:09.605334 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:09.605334 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:51:09.607819 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 62/122] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:09.608779 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786aea8-fbbc-4084-87ae-dfb860f0e5bf None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:09.670929 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e160c-f603-4ddb-bce4-e0cdc84bb943 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:09.692700 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:09.707774 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1955857-ca75-4c97-a67b-c4f1e4d9d8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:09.708729 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1955857-ca75-4c97-a67b-c4f1e4d9d8cb None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:09.709090 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1955857-ca75-4c97-a67b-c4f1e4d9d8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:09.709464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1955857-ca75-4c97-a67b-c4f1e4d9d8cb None admin] PATH_INFO: `/v3/projects/824de15367424616b3588eca8e09020e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:09.710743 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1955857-ca75-4c97-a67b-c4f1e4d9d8cb None admin] RBAC: Authorizing `identity:get_project(project_id=824de15367424616b3588eca8e09020e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:09.712352 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1955857-ca75-4c97-a67b-c4f1e4d9d8cb None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:09.714191 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 61/123] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:09 2022] GET /identity/v3/projects/824de15367424616b3588eca8e09020e => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:09.715174 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1955857-ca75-4c97-a67b-c4f1e4d9d8cb None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:09.732143 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786aea8-fbbc-4084-87ae-dfb860f0e5bf None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:09.771810 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:09.777235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f4823-8afa-468c-aa30-4952dd5f06b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:09.778128 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f4823-8afa-468c-aa30-4952dd5f06b9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:09.778513 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f4823-8afa-468c-aa30-4952dd5f06b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:09.778883 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f4823-8afa-468c-aa30-4952dd5f06b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:09.790381 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f4823-8afa-468c-aa30-4952dd5f06b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:09.798409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-373f4823-8afa-468c-aa30-4952dd5f06b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:09.798409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:09.798409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:09.798409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:09.798409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:09.798409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:09.798409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:09.798409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:09.798409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:09.798409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:09.798409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:09.798409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:09.798409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:09.798409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:09.798409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:09.798409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:09.799897 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:09.799897 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:09.799897 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:09.799897 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:09.799897 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:09.799897 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:09.799897 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:09.799897 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:09.799897 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:09.799897 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:09.799897 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:09.799897 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:51:09.799897 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:09.799897 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:09.799897 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:09.799897 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:09.800689 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:09.800689 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:09.800689 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:09.800689 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:09.800689 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:09.800689 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:09.800689 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:09.800689 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:09.800689 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:09.800689 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:09.800689 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:09.800689 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:51:09.800689 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 63/124] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:51:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:09.802024 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f4823-8afa-468c-aa30-4952dd5f06b9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:09.838676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1955857-ca75-4c97-a67b-c4f1e4d9d8cb None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:09.873826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a648f-fe8b-4b0e-a0d5-269efd9f0d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:09.874643 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a648f-fe8b-4b0e-a0d5-269efd9f0d18 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:09.875032 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a648f-fe8b-4b0e-a0d5-269efd9f0d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:09.875450 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a648f-fe8b-4b0e-a0d5-269efd9f0d18 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:09.876304 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a648f-fe8b-4b0e-a0d5-269efd9f0d18 None admin] RBAC: Adding query filter params (name=member) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:09.876716 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a648f-fe8b-4b0e-a0d5-269efd9f0d18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:09.878834 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a648f-fe8b-4b0e-a0d5-269efd9f0d18 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:09.887425 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 62/125] 10.222.0.24 () {56 vars in 1101 bytes} [Thu May 19 14:51:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:09.888395 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a648f-fe8b-4b0e-a0d5-269efd9f0d18 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:09.942164 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:09.945044 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f4823-8afa-468c-aa30-4952dd5f06b9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:09.998681 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ea458-21e0-43cf-8eb6-d3694c3f0c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:09.999882 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ea458-21e0-43cf-8eb6-d3694c3f0c7c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:10.000312 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ea458-21e0-43cf-8eb6-d3694c3f0c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:10.000751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ea458-21e0-43cf-8eb6-d3694c3f0c7c None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:10.001615 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a648f-fe8b-4b0e-a0d5-269efd9f0d18 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:10.002775 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ea458-21e0-43cf-8eb6-d3694c3f0c7c None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:10.003525 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ea458-21e0-43cf-8eb6-d3694c3f0c7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:10.006501 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ea458-21e0-43cf-8eb6-d3694c3f0c7c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:10.018124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 64/126] 10.222.0.24 () {56 vars in 1101 bytes} [Thu May 19 14:51:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:10.019182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ea458-21e0-43cf-8eb6-d3694c3f0c7c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:10.045213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047af604-1c86-4af3-845c-6c31183bd563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:10.046336 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047af604-1c86-4af3-845c-6c31183bd563 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:10.046719 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047af604-1c86-4af3-845c-6c31183bd563 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:10.047096 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047af604-1c86-4af3-845c-6c31183bd563 None admin] PATH_INFO: `/v3/projects/824de15367424616b3588eca8e09020e/users/c1ed4d1479484c11a4d2682af24a7155/roles/9d41dc09d0f646b1994526fcbd8d3622` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:10.050431 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047af604-1c86-4af3-845c-6c31183bd563 None admin] RBAC: Authorizing `identity:create_grant(project_id=824de15367424616b3588eca8e09020e, user_id=c1ed4d1479484c11a4d2682af24a7155, role_id=9d41dc09d0f646b1994526fcbd8d3622)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:10.052029 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047af604-1c86-4af3-845c-6c31183bd563 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:10.069402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 63/127] 10.222.0.24 () {58 vars in 1439 bytes} [Thu May 19 14:51:09 2022] PUT /identity/v3/projects/824de15367424616b3588eca8e09020e/users/c1ed4d1479484c11a4d2682af24a7155/roles/9d41dc09d0f646b1994526fcbd8d3622 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:51:10.074714 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047af604-1c86-4af3-845c-6c31183bd563 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:10.107834 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:10.197706 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ea458-21e0-43cf-8eb6-d3694c3f0c7c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:10.259032 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047af604-1c86-4af3-845c-6c31183bd563 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:10.263073 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b591e16-b35b-4c72-b060-58b73deea525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:10.263799 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b591e16-b35b-4c72-b060-58b73deea525 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:10.264088 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b591e16-b35b-4c72-b060-58b73deea525 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:10.264369 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b591e16-b35b-4c72-b060-58b73deea525 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:10.265144 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b591e16-b35b-4c72-b060-58b73deea525 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:10.265460 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b591e16-b35b-4c72-b060-58b73deea525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:10.266900 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b591e16-b35b-4c72-b060-58b73deea525 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:10.282080 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:10.286707 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 65/128] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:10.287670 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b591e16-b35b-4c72-b060-58b73deea525 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:10.329932 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e25612-cd0a-4cb1-b0ed-769947e26c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:10.332658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e25612-cd0a-4cb1-b0ed-769947e26c0a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:10.333000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e25612-cd0a-4cb1-b0ed-769947e26c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:10.333287 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e25612-cd0a-4cb1-b0ed-769947e26c0a None admin] PATH_INFO: `/v3/users/c1ed4d1479484c11a4d2682af24a7155` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:10.334663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e25612-cd0a-4cb1-b0ed-769947e26c0a None admin] RBAC: Authorizing `identity:get_user(user_id=c1ed4d1479484c11a4d2682af24a7155)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:10.337188 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e25612-cd0a-4cb1-b0ed-769947e26c0a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:10.339431 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 64/129] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:10 2022] GET /identity/v3/users/c1ed4d1479484c11a4d2682af24a7155 => generated 275 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:10.340556 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e25612-cd0a-4cb1-b0ed-769947e26c0a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:10.426205 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b591e16-b35b-4c72-b060-58b73deea525 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:10.444677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:10.464297 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77bfa1d-76de-4f35-9a34-c8892ae47d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:10.465206 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bfa1d-76de-4f35-9a34-c8892ae47d99 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:10.465502 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bfa1d-76de-4f35-9a34-c8892ae47d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:10.465783 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bfa1d-76de-4f35-9a34-c8892ae47d99 None admin] PATH_INFO: `/v3/users/c1ed4d1479484c11a4d2682af24a7155` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:10.467102 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77bfa1d-76de-4f35-9a34-c8892ae47d99 None admin] RBAC: Authorizing `identity:get_user(user_id=c1ed4d1479484c11a4d2682af24a7155)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:10.468743 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77bfa1d-76de-4f35-9a34-c8892ae47d99 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:10.473228 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e25612-cd0a-4cb1-b0ed-769947e26c0a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:10.475835 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 66/130] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:10 2022] GET /identity/v3/users/c1ed4d1479484c11a4d2682af24a7155 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:10.476684 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77bfa1d-76de-4f35-9a34-c8892ae47d99 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:10.516702 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4ceb1-5061-4ef8-aca7-05b8bf482221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:10.517635 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4ceb1-5061-4ef8-aca7-05b8bf482221 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:10.517998 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4ceb1-5061-4ef8-aca7-05b8bf482221 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:10.518676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4ceb1-5061-4ef8-aca7-05b8bf482221 None admin] PATH_INFO: `/v3/users/83eec44e6acd4004ba2088801e9d8f88` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:10.519910 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4ceb1-5061-4ef8-aca7-05b8bf482221 None admin] RBAC: Authorizing `identity:get_user(user_id=83eec44e6acd4004ba2088801e9d8f88)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:10.522043 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4ceb1-5061-4ef8-aca7-05b8bf482221 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:10.524530 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 65/131] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:10 2022] GET /identity/v3/users/83eec44e6acd4004ba2088801e9d8f88 => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:10.525351 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4ceb1-5061-4ef8-aca7-05b8bf482221 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:10.589185 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77bfa1d-76de-4f35-9a34-c8892ae47d99 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:10.589829 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:10.625280 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03419426-ebf3-4d37-a03e-e26ad8ebbb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:10.626214 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03419426-ebf3-4d37-a03e-e26ad8ebbb6c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:10.626510 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03419426-ebf3-4d37-a03e-e26ad8ebbb6c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:10.626794 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03419426-ebf3-4d37-a03e-e26ad8ebbb6c None admin] PATH_INFO: `/v3/projects/824de15367424616b3588eca8e09020e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:10.628180 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03419426-ebf3-4d37-a03e-e26ad8ebbb6c None admin] RBAC: Authorizing `identity:get_project(project_id=824de15367424616b3588eca8e09020e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:10.629746 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03419426-ebf3-4d37-a03e-e26ad8ebbb6c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:10.635314 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 67/132] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:10 2022] GET /identity/v3/projects/824de15367424616b3588eca8e09020e => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:10.637187 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03419426-ebf3-4d37-a03e-e26ad8ebbb6c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:10.659885 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4ceb1-5061-4ef8-aca7-05b8bf482221 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:10.694511 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a8430-0c91-418b-adee-0784138e00d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:10.695435 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a8430-0c91-418b-adee-0784138e00d3 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:10.695719 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a8430-0c91-418b-adee-0784138e00d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:10.696001 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a8430-0c91-418b-adee-0784138e00d3 None admin] PATH_INFO: `/v3/projects/79cbeffd8afa428395c1dc80fc054a7e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:10.697189 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a8430-0c91-418b-adee-0784138e00d3 None admin] RBAC: Authorizing `identity:get_project(project_id=79cbeffd8afa428395c1dc80fc054a7e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:10.698703 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a8430-0c91-418b-adee-0784138e00d3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:10.700724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 66/133] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:10 2022] GET /identity/v3/projects/79cbeffd8afa428395c1dc80fc054a7e => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:10.701580 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a8430-0c91-418b-adee-0784138e00d3 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:10.711663 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:10.779896 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03419426-ebf3-4d37-a03e-e26ad8ebbb6c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:10.808049 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a8430-0c91-418b-adee-0784138e00d3 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:10.826899 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf250d-7587-44b6-9a7e-19dd268eedbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:10.829831 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf250d-7587-44b6-9a7e-19dd268eedbc None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:10.830085 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf250d-7587-44b6-9a7e-19dd268eedbc None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:10.830916 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf250d-7587-44b6-9a7e-19dd268eedbc None admin] PATH_INFO: `/v3/projects/824de15367424616b3588eca8e09020e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:10.832883 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:10.833000 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf250d-7587-44b6-9a7e-19dd268eedbc None admin] RBAC: Authorizing `identity:get_project(project_id=824de15367424616b3588eca8e09020e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:10.836002 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf250d-7587-44b6-9a7e-19dd268eedbc None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:10.841980 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 68/134] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:10 2022] GET /identity/v3/projects/824de15367424616b3588eca8e09020e => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:10.842572 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf250d-7587-44b6-9a7e-19dd268eedbc None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:10.865255 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e97bf9-ae3c-40c0-acea-3f443b576fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:10.866147 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e97bf9-ae3c-40c0-acea-3f443b576fae None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:10.866425 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e97bf9-ae3c-40c0-acea-3f443b576fae None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:10.866701 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e97bf9-ae3c-40c0-acea-3f443b576fae None admin] PATH_INFO: `/v3/projects/824de15367424616b3588eca8e09020e/users/c1ed4d1479484c11a4d2682af24a7155/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:10.875455 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e97bf9-ae3c-40c0-acea-3f443b576fae None admin] RBAC: Authorizing `identity:create_grant(project_id=824de15367424616b3588eca8e09020e, user_id=c1ed4d1479484c11a4d2682af24a7155, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:10.876950 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e97bf9-ae3c-40c0-acea-3f443b576fae None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:10.914364 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 67/135] 10.222.0.24 () {58 vars in 1439 bytes} [Thu May 19 14:51:10 2022] PUT /identity/v3/projects/824de15367424616b3588eca8e09020e/users/c1ed4d1479484c11a4d2682af24a7155/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:51:10.916010 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e97bf9-ae3c-40c0-acea-3f443b576fae None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:11.036266 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf250d-7587-44b6-9a7e-19dd268eedbc None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:11.076807 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:11.111346 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fdfaff-fe04-4c01-92e5-1b598d08ed18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:11.112812 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdfaff-fe04-4c01-92e5-1b598d08ed18 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:11.113101 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdfaff-fe04-4c01-92e5-1b598d08ed18 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:11.113382 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdfaff-fe04-4c01-92e5-1b598d08ed18 None admin] PATH_INFO: `/v3/projects/79cbeffd8afa428395c1dc80fc054a7e/users/c1ed4d1479484c11a4d2682af24a7155/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:11.115484 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fdfaff-fe04-4c01-92e5-1b598d08ed18 None admin] RBAC: Authorizing `identity:create_grant(project_id=79cbeffd8afa428395c1dc80fc054a7e, user_id=c1ed4d1479484c11a4d2682af24a7155, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:11.116958 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fdfaff-fe04-4c01-92e5-1b598d08ed18 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:11.135297 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e97bf9-ae3c-40c0-acea-3f443b576fae None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:11.160382 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 69/136] 10.222.0.24 () {58 vars in 1439 bytes} [Thu May 19 14:51:10 2022] PUT /identity/v3/projects/79cbeffd8afa428395c1dc80fc054a7e/users/c1ed4d1479484c11a4d2682af24a7155/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:51:11.173620 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5bb0f9-841c-481a-acfc-e40c8c7df785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:11.175349 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bb0f9-841c-481a-acfc-e40c8c7df785 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:11.175648 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bb0f9-841c-481a-acfc-e40c8c7df785 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:11.175940 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bb0f9-841c-481a-acfc-e40c8c7df785 None admin] PATH_INFO: `/v3/projects/824de15367424616b3588eca8e09020e/users/83eec44e6acd4004ba2088801e9d8f88/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:11.178045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5bb0f9-841c-481a-acfc-e40c8c7df785 None admin] RBAC: Authorizing `identity:create_grant(project_id=824de15367424616b3588eca8e09020e, user_id=83eec44e6acd4004ba2088801e9d8f88, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:11.179679 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5bb0f9-841c-481a-acfc-e40c8c7df785 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:11.195994 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 68/137] 10.222.0.24 () {58 vars in 1439 bytes} [Thu May 19 14:51:10 2022] PUT /identity/v3/projects/824de15367424616b3588eca8e09020e/users/83eec44e6acd4004ba2088801e9d8f88/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:51:11.196822 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d91dc-72bf-4f76-bddc-c451b0b23ff5 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:11.197123 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d91dc-72bf-4f76-bddc-c451b0b23ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:11.197571 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d91dc-72bf-4f76-bddc-c451b0b23ff5 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:11.199085 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 70/138] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:11.204855 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39663c0c-b802-4ad5-87b6-142cbb4b0d8c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:11.205639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39663c0c-b802-4ad5-87b6-142cbb4b0d8c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:11.206206 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39663c0c-b802-4ad5-87b6-142cbb4b0d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:11.228231 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-39663c0c-b802-4ad5-87b6-142cbb4b0d8c None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:11.229805 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-39663c0c-b802-4ad5-87b6-142cbb4b0d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:11.267607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:11.315457 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 69/139] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:51:11.339106 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d91dc-72bf-4f76-bddc-c451b0b23ff5 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:11.500425 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d91dc-72bf-4f76-bddc-c451b0b23ff5 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:11.540056 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd3831-cbdd-40b4-bcb6-9beadf4489e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:11.541168 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd3831-cbdd-40b4-bcb6-9beadf4489e6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:11.541666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd3831-cbdd-40b4-bcb6-9beadf4489e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:11.542096 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd3831-cbdd-40b4-bcb6-9beadf4489e6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:11.554322 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd3831-cbdd-40b4-bcb6-9beadf4489e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:11.562420 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-c1cd3831-cbdd-40b4-bcb6-9beadf4489e6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:51:11.562420 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:11.562420 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:11.562420 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:11.562420 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:11.562420 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:11.562420 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:11.562420 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:11.562420 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:11.562420 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:11.562420 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:11.562420 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:11.562420 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:11.562420 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:11.562420 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:11.562420 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:11.563571 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:11.563571 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:11.563571 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:11.563571 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:11.563571 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:11.563571 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:11.563571 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:11.563571 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:11.563571 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:11.563571 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:11.563571 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:11.563571 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:51:11.563571 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:11.563571 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:11.563571 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:11.563571 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:11.564623 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:11.564623 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:11.564623 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:11.564623 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:11.564623 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:11.564623 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:11.564623 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:11.564623 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:11.564623 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:11.564623 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:11.564623 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:51:11.564623 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:51:11.566863 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 71/140] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:11.572879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39663c0c-b802-4ad5-87b6-142cbb4b0d8c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:11.706988 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39663c0c-b802-4ad5-87b6-142cbb4b0d8c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:11.758725 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a326bf5-a8ac-406c-a2b1-5e4372619bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:11.759446 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a326bf5-a8ac-406c-a2b1-5e4372619bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:11.759739 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a326bf5-a8ac-406c-a2b1-5e4372619bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:11.760019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a326bf5-a8ac-406c-a2b1-5e4372619bb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:11.760798 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a326bf5-a8ac-406c-a2b1-5e4372619bb1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:11.761111 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a326bf5-a8ac-406c-a2b1-5e4372619bb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:11.762514 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a326bf5-a8ac-406c-a2b1-5e4372619bb1 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:11.772711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 70/141] 10.222.0.24 () {56 vars in 1101 bytes} [Thu May 19 14:51:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:11.779897 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd3831-cbdd-40b4-bcb6-9beadf4489e6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:11.847875 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:11.912995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd3831-cbdd-40b4-bcb6-9beadf4489e6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:11.948464 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcdd3d-2a24-452a-95f7-9fc2213aacf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:11.949848 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcdd3d-2a24-452a-95f7-9fc2213aacf2 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:11.950375 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcdd3d-2a24-452a-95f7-9fc2213aacf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:11.950848 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcdd3d-2a24-452a-95f7-9fc2213aacf2 None admin] PATH_INFO: `/v3/users/d26b504ccdc846ccad497028c783a508` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:11.952315 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcdd3d-2a24-452a-95f7-9fc2213aacf2 None admin] RBAC: Authorizing `identity:get_user(user_id=d26b504ccdc846ccad497028c783a508)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:11.953992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcdd3d-2a24-452a-95f7-9fc2213aacf2 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:11.956396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 72/142] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:11 2022] GET /identity/v3/users/d26b504ccdc846ccad497028c783a508 => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:11.961950 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a326bf5-a8ac-406c-a2b1-5e4372619bb1 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:12.009892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:12.086157 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8355ab-f2fd-4902-9094-64fbdcf75c3c None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:12.087133 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8355ab-f2fd-4902-9094-64fbdcf75c3c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:12.087694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8355ab-f2fd-4902-9094-64fbdcf75c3c None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:12.089560 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 73/143] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:12.106597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddd988-d2a1-4a10-a5a8-3ca4ae98a8af None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:12.107163 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddd988-d2a1-4a10-a5a8-3ca4ae98a8af None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:12.107693 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddd988-d2a1-4a10-a5a8-3ca4ae98a8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:12.108399 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a326bf5-a8ac-406c-a2b1-5e4372619bb1 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:12.144308 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0cddd988-d2a1-4a10-a5a8-3ca4ae98a8af None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:12.145866 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0cddd988-d2a1-4a10-a5a8-3ca4ae98a8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:12.160467 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280b3b4-ce1b-4785-9cc5-8f50ec03939a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:12.161350 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280b3b4-ce1b-4785-9cc5-8f50ec03939a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:12.161637 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280b3b4-ce1b-4785-9cc5-8f50ec03939a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:12.162016 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280b3b4-ce1b-4785-9cc5-8f50ec03939a None admin] PATH_INFO: `/v3/projects/824de15367424616b3588eca8e09020e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:12.168065 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280b3b4-ce1b-4785-9cc5-8f50ec03939a None admin] RBAC: Authorizing `identity:get_project(project_id=824de15367424616b3588eca8e09020e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:12.169562 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280b3b4-ce1b-4785-9cc5-8f50ec03939a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:12.171635 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 71/144] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:11 2022] GET /identity/v3/projects/824de15367424616b3588eca8e09020e => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:12.177130 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280b3b4-ce1b-4785-9cc5-8f50ec03939a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:12.245593 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 74/145] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:12.282413 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddd988-d2a1-4a10-a5a8-3ca4ae98a8af None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:12.382462 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:12.410750 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:12.429447 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280b3b4-ce1b-4785-9cc5-8f50ec03939a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:12.487022 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5f204-c65f-4f04-88b8-af032ce20eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:12.487956 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5f204-c65f-4f04-88b8-af032ce20eb5 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:12.488237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5f204-c65f-4f04-88b8-af032ce20eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:12.488513 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5f204-c65f-4f04-88b8-af032ce20eb5 None admin] PATH_INFO: `/v3/projects/824de15367424616b3588eca8e09020e/users/d26b504ccdc846ccad497028c783a508/roles/1e1d2d30ba484c3f80d3cbb6f407a716` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:12.491460 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5f204-c65f-4f04-88b8-af032ce20eb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=824de15367424616b3588eca8e09020e, user_id=d26b504ccdc846ccad497028c783a508, role_id=1e1d2d30ba484c3f80d3cbb6f407a716)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:12.492927 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5f204-c65f-4f04-88b8-af032ce20eb5 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:12.522555 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddd988-d2a1-4a10-a5a8-3ca4ae98a8af None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:12.528067 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 72/146] 10.222.0.24 () {58 vars in 1439 bytes} [Thu May 19 14:51:12 2022] PUT /identity/v3/projects/824de15367424616b3588eca8e09020e/users/d26b504ccdc846ccad497028c783a508/roles/1e1d2d30ba484c3f80d3cbb6f407a716 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 14:51:12.580141 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666479b7-8f55-4658-a2a0-289defc8cfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:12.581512 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666479b7-8f55-4658-a2a0-289defc8cfbf None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:12.581874 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666479b7-8f55-4658-a2a0-289defc8cfbf None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:12.582157 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666479b7-8f55-4658-a2a0-289defc8cfbf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:12.588191 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666479b7-8f55-4658-a2a0-289defc8cfbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:12.589749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666479b7-8f55-4658-a2a0-289defc8cfbf None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:12.591566 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 75/147] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:51:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:12.597101 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5f204-c65f-4f04-88b8-af032ce20eb5 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:12.741524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5f204-c65f-4f04-88b8-af032ce20eb5 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:12.787077 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1622e-445a-414f-9b22-a5b46bb8e6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:12.787880 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1622e-445a-414f-9b22-a5b46bb8e6c4 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:12.788173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1622e-445a-414f-9b22-a5b46bb8e6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:12.788455 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1622e-445a-414f-9b22-a5b46bb8e6c4 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:12.789233 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1622e-445a-414f-9b22-a5b46bb8e6c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:12.790783 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1622e-445a-414f-9b22-a5b46bb8e6c4 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:12.833354 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 73/148] 10.222.0.24 () {60 vars in 1132 bytes} [Thu May 19 14:51:12 2022] POST /identity/v3/users => generated 283 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:51:13.269352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443ae23-5ac0-41aa-b724-d7904d621538 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:13.269880 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443ae23-5ac0-41aa-b724-d7904d621538 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:13.269957 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443ae23-5ac0-41aa-b724-d7904d621538 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:13.271441 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 76/149] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:13.276812 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce8f54-9ec1-4a8d-8a4a-0c7bda51e49b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:13.277330 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce8f54-9ec1-4a8d-8a4a-0c7bda51e49b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:13.277503 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce8f54-9ec1-4a8d-8a4a-0c7bda51e49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:13.304226 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-5bce8f54-9ec1-4a8d-8a4a-0c7bda51e49b None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:13.305430 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5bce8f54-9ec1-4a8d-8a4a-0c7bda51e49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:13.308539 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:13.393968 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 74/150] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:13.434931 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443ae23-5ac0-41aa-b724-d7904d621538 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:13.568566 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443ae23-5ac0-41aa-b724-d7904d621538 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:13.581279 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:13.616913 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8272f-caa2-48ce-976c-42fd0210230a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:13.617794 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8272f-caa2-48ce-976c-42fd0210230a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:13.618084 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8272f-caa2-48ce-976c-42fd0210230a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:13.618411 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8272f-caa2-48ce-976c-42fd0210230a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:13.634208 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8272f-caa2-48ce-976c-42fd0210230a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:13.642514 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-e7c8272f-caa2-48ce-976c-42fd0210230a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:13.642514 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:13.642514 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:13.642514 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:13.642514 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:13.642514 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:13.642514 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:13.642514 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:13.642514 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:13.642514 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:13.642514 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:13.642514 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:13.642514 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:13.642514 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:13.642514 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:13.642514 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:13.643909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:13.643909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:13.643909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:13.643909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:13.643909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:13.643909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:13.643909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:13.643909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:13.643909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:13.643909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:13.643909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:13.643909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:51:13.643909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:13.643909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:13.643909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:13.643909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:13.644671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:13.644671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:13.644671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:13.644671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:13.644671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:13.644671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:13.644671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:13.644671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:13.644671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:13.644671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:13.644671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:13.644671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:51:13.644671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 77/151] 10.222.0.24 () {56 vars in 1114 bytes} [Thu May 19 14:51:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:13.651342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce8f54-9ec1-4a8d-8a4a-0c7bda51e49b None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:13.773827 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce8f54-9ec1-4a8d-8a4a-0c7bda51e49b None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:13.818479 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e08f8b-d201-42ff-9b89-922faff07a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:13.819257 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e08f8b-d201-42ff-9b89-922faff07a32 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:13.819485 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e08f8b-d201-42ff-9b89-922faff07a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:13.819761 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e08f8b-d201-42ff-9b89-922faff07a32 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:13.820595 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e08f8b-d201-42ff-9b89-922faff07a32 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:13.820906 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e08f8b-d201-42ff-9b89-922faff07a32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:13.822347 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e08f8b-d201-42ff-9b89-922faff07a32 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:13.838171 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 75/152] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:51:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:13.843697 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8272f-caa2-48ce-976c-42fd0210230a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:13.968971 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8272f-caa2-48ce-976c-42fd0210230a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:14.006605 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bd0ef-e0e9-4fe3-99d0-63a8f48e0d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:14.007541 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bd0ef-e0e9-4fe3-99d0-63a8f48e0d2a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:14.007833 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bd0ef-e0e9-4fe3-99d0-63a8f48e0d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:14.008116 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bd0ef-e0e9-4fe3-99d0-63a8f48e0d2a None admin] PATH_INFO: `/v3/users/c1ed4d1479484c11a4d2682af24a7155` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:14.009406 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495bd0ef-e0e9-4fe3-99d0-63a8f48e0d2a None admin] RBAC: Authorizing `identity:get_user(user_id=c1ed4d1479484c11a4d2682af24a7155)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:14.010900 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495bd0ef-e0e9-4fe3-99d0-63a8f48e0d2a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:14.012768 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 78/153] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:13 2022] GET /identity/v3/users/c1ed4d1479484c11a4d2682af24a7155 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:14.019324 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e08f8b-d201-42ff-9b89-922faff07a32 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:14.022329 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:14.091047 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11d4aa-8e38-4006-a897-a81ae164d8d5 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:14.091303 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11d4aa-8e38-4006-a897-a81ae164d8d5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:14.091582 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11d4aa-8e38-4006-a897-a81ae164d8d5 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:14.093104 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 79/154] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:14.099398 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d6ce5-dca8-42ce-a792-338a663fc22b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:14.099694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d6ce5-dca8-42ce-a792-338a663fc22b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:14.099982 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d6ce5-dca8-42ce-a792-338a663fc22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:14.126836 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c05d6ce5-dca8-42ce-a792-338a663fc22b None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:14.128629 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c05d6ce5-dca8-42ce-a792-338a663fc22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:14.154687 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e08f8b-d201-42ff-9b89-922faff07a32 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:14.184420 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:14.220308 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49ad1f-3773-404b-8a40-232ae1af9410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:14.221008 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49ad1f-3773-404b-8a40-232ae1af9410 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:14.221293 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49ad1f-3773-404b-8a40-232ae1af9410 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:14.221743 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49ad1f-3773-404b-8a40-232ae1af9410 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:14.260065 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 80/155] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:51:14.312849 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49ad1f-3773-404b-8a40-232ae1af9410 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:14.312849 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49ad1f-3773-404b-8a40-232ae1af9410 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:14.315766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:14.330468 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d6ce5-dca8-42ce-a792-338a663fc22b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:14.526273 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 76/156] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:51:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:14.535616 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49ad1f-3773-404b-8a40-232ae1af9410 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:14.565128 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d6ce5-dca8-42ce-a792-338a663fc22b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:14.627918 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbeeb8e-62d9-444a-9571-ff7429e76212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:14.628853 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbeeb8e-62d9-444a-9571-ff7429e76212 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:14.629144 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbeeb8e-62d9-444a-9571-ff7429e76212 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:14.629424 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbeeb8e-62d9-444a-9571-ff7429e76212 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:14.645032 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbeeb8e-62d9-444a-9571-ff7429e76212 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:14.653346 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-dfbeeb8e-62d9-444a-9571-ff7429e76212 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:14.653346 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:14.653346 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:14.653346 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:14.653346 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:14.653346 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:14.653346 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:14.653346 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:14.653346 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:14.653346 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:14.653346 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:14.653346 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:14.653346 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:14.653346 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:14.653346 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:14.653346 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:14.654444 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:14.654444 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:14.654444 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:14.654444 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:14.654444 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:14.654444 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:14.654444 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:14.654444 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:14.654444 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:14.654444 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:14.654444 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:14.654444 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:51:14.654444 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:14.654444 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:14.654444 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:14.654444 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:14.655328 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:14.655328 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:14.655328 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:14.655328 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:14.655328 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:14.655328 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:14.655328 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:14.655328 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:14.655328 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:14.655328 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:14.655328 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:14.655328 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:51:14.655927 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49ad1f-3773-404b-8a40-232ae1af9410 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:14.658082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:14.659638 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 81/157] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:51:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:51:14.680604 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbeeb8e-62d9-444a-9571-ff7429e76212 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:14.697929 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1394e1f-aa1d-43c5-a929-205e18862684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:14.698805 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1394e1f-aa1d-43c5-a929-205e18862684 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:14.699088 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1394e1f-aa1d-43c5-a929-205e18862684 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:14.699473 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1394e1f-aa1d-43c5-a929-205e18862684 None admin] PATH_INFO: `/v3/projects/824de15367424616b3588eca8e09020e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:14.700714 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1394e1f-aa1d-43c5-a929-205e18862684 None admin] RBAC: Authorizing `identity:get_project(project_id=824de15367424616b3588eca8e09020e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:14.702208 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1394e1f-aa1d-43c5-a929-205e18862684 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:14.704309 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 77/158] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:14 2022] GET /identity/v3/projects/824de15367424616b3588eca8e09020e => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:14.710394 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1394e1f-aa1d-43c5-a929-205e18862684 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:14.727033 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:14.825772 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1394e1f-aa1d-43c5-a929-205e18862684 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:14.869939 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885aa8d5-702a-4634-9cb4-bb87a272e3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:14.870612 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aa8d5-702a-4634-9cb4-bb87a272e3f4 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:14.871150 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aa8d5-702a-4634-9cb4-bb87a272e3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:14.871473 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885aa8d5-702a-4634-9cb4-bb87a272e3f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:14.872630 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885aa8d5-702a-4634-9cb4-bb87a272e3f4 None admin] RBAC: Adding query filter params (role.id=9d41dc09d0f646b1994526fcbd8d3622, scope.project.id=824de15367424616b3588eca8e09020e, user.id=c1ed4d1479484c11a4d2682af24a7155) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:14.872948 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885aa8d5-702a-4634-9cb4-bb87a272e3f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:14.874585 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885aa8d5-702a-4634-9cb4-bb87a272e3f4 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:14.890610 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 78/159] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:51:14 2022] GET /identity/v3/role_assignments?user.id=c1ed4d1479484c11a4d2682af24a7155&scope.project.id=824de15367424616b3588eca8e09020e&role.id=9d41dc09d0f646b1994526fcbd8d3622 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:14.893454 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad476a-93f8-48f8-8b19-19fe58127b68 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:14.894132 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad476a-93f8-48f8-8b19-19fe58127b68 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:14.895836 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad476a-93f8-48f8-8b19-19fe58127b68 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:14.898261 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 79/160] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:14.904912 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16a004-da4a-48ab-8bfe-b87e6a926931 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:14.905753 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16a004-da4a-48ab-8bfe-b87e6a926931 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:14.907734 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16a004-da4a-48ab-8bfe-b87e6a926931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:14.914418 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbeeb8e-62d9-444a-9571-ff7429e76212 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:14.947965 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-fc16a004-da4a-48ab-8bfe-b87e6a926931 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:14.949761 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-fc16a004-da4a-48ab-8bfe-b87e6a926931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:15.002446 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30083f1e-9bb5-4560-8284-cfe65c9ede3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:15.003531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30083f1e-9bb5-4560-8284-cfe65c9ede3b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:15.007456 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30083f1e-9bb5-4560-8284-cfe65c9ede3b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:15.007456 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30083f1e-9bb5-4560-8284-cfe65c9ede3b None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:15.007456 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30083f1e-9bb5-4560-8284-cfe65c9ede3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:15.007456 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30083f1e-9bb5-4560-8284-cfe65c9ede3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:15.007456 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30083f1e-9bb5-4560-8284-cfe65c9ede3b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:15.023695 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:15.025533 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 82/161] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:15.032737 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30083f1e-9bb5-4560-8284-cfe65c9ede3b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:15.118455 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 80/162] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:15.179048 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16a004-da4a-48ab-8bfe-b87e6a926931 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:15.216387 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:15.246613 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30083f1e-9bb5-4560-8284-cfe65c9ede3b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:15.352007 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941655f-36b8-45e7-abc4-437ae56d4bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:15.353611 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941655f-36b8-45e7-abc4-437ae56d4bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:15.354053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941655f-36b8-45e7-abc4-437ae56d4bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:15.354533 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941655f-36b8-45e7-abc4-437ae56d4bb8 None admin] PATH_INFO: `/v3/users/83eec44e6acd4004ba2088801e9d8f88` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:15.355992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941655f-36b8-45e7-abc4-437ae56d4bb8 None admin] RBAC: Authorizing `identity:get_user(user_id=83eec44e6acd4004ba2088801e9d8f88)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:15.357616 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941655f-36b8-45e7-abc4-437ae56d4bb8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:15.359342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16a004-da4a-48ab-8bfe-b87e6a926931 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:15.360151 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 83/163] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:15 2022] GET /identity/v3/users/83eec44e6acd4004ba2088801e9d8f88 => generated 247 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:15.361540 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f418b-c0d2-464d-a9ae-7bc13f07f943 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:15.361993 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f418b-c0d2-464d-a9ae-7bc13f07f943 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:15.362417 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f418b-c0d2-464d-a9ae-7bc13f07f943 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:15.364075 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 84/164] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:15.369492 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31d686-adf7-44c6-ba7e-a2df34195bf5 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:15.369970 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31d686-adf7-44c6-ba7e-a2df34195bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:15.370402 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31d686-adf7-44c6-ba7e-a2df34195bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:15.410620 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ea31d686-adf7-44c6-ba7e-a2df34195bf5 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:15.412074 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ea31d686-adf7-44c6-ba7e-a2df34195bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:15.417625 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a243f-ed77-41ab-90ab-8f642e48755a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:15.418442 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a243f-ed77-41ab-90ab-8f642e48755a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:15.418725 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a243f-ed77-41ab-90ab-8f642e48755a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:15.419004 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a243f-ed77-41ab-90ab-8f642e48755a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:15.430096 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a243f-ed77-41ab-90ab-8f642e48755a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:15.438323 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-001a243f-ed77-41ab-90ab-8f642e48755a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:15.438323 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:15.438323 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:15.438323 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:15.438323 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:15.438323 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:15.438323 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:15.438323 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:15.438323 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:15.438323 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:15.438323 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:15.438323 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:15.438323 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:15.438323 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:15.438323 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:15.438323 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:15.439952 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:15.439952 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:15.439952 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:15.439952 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:15.439952 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:15.439952 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:15.439952 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:15.439952 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:15.439952 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:15.439952 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:15.439952 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:15.439952 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:51:15.439952 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:15.439952 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:15.439952 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:15.439952 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:15.440853 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:15.440853 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:15.440853 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:15.440853 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:15.440853 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:15.440853 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:15.440853 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:15.440853 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:15.440853 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:15.440853 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:15.440853 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:15.440853 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:51:15.443050 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 81/165] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:15.444252 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a243f-ed77-41ab-90ab-8f642e48755a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:15.475772 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:15.552986 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a243f-ed77-41ab-90ab-8f642e48755a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:15.595279 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee692ba-ec53-4cf9-b2c3-708512a54199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:15.596599 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee692ba-ec53-4cf9-b2c3-708512a54199 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:15.597221 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee692ba-ec53-4cf9-b2c3-708512a54199 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:15.597943 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee692ba-ec53-4cf9-b2c3-708512a54199 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:15.613091 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 85/166] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:15.613978 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31d686-adf7-44c6-ba7e-a2df34195bf5 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:15.686029 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee692ba-ec53-4cf9-b2c3-708512a54199 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:15.687670 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee692ba-ec53-4cf9-b2c3-708512a54199 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:15.719582 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:15.796861 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 82/167] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:51:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:15.802950 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee692ba-ec53-4cf9-b2c3-708512a54199 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:15.827156 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:15.851148 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31d686-adf7-44c6-ba7e-a2df34195bf5 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:15.911961 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf251d6-cdd4-49f4-9b92-3239f7e2c397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:15.912887 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf251d6-cdd4-49f4-9b92-3239f7e2c397 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:15.913349 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf251d6-cdd4-49f4-9b92-3239f7e2c397 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:15.913767 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf251d6-cdd4-49f4-9b92-3239f7e2c397 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:15.914671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf251d6-cdd4-49f4-9b92-3239f7e2c397 None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:15.915129 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf251d6-cdd4-49f4-9b92-3239f7e2c397 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:15.916707 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee692ba-ec53-4cf9-b2c3-708512a54199 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:15.916875 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf251d6-cdd4-49f4-9b92-3239f7e2c397 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:15.926447 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 86/168] 10.222.0.24 () {56 vars in 1101 bytes} [Thu May 19 14:51:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:15.927517 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf251d6-cdd4-49f4-9b92-3239f7e2c397 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:15.955690 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:15.969518 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729c129-4a00-4dd4-a186-f9233f90446c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:15.970884 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729c129-4a00-4dd4-a186-f9233f90446c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:15.972809 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729c129-4a00-4dd4-a186-f9233f90446c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:15.973251 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729c129-4a00-4dd4-a186-f9233f90446c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:16.013431 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0729c129-4a00-4dd4-a186-f9233f90446c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:16.026169 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-0729c129-4a00-4dd4-a186-f9233f90446c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:16.026169 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:16.026169 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:16.026169 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:16.026169 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:16.026169 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:16.026169 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:16.026169 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:16.026169 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:16.026169 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:16.026169 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:16.026169 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:16.026169 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:16.026169 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:16.026169 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:16.026169 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:16.027172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:16.027172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:16.027172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:16.027172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:16.027172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:16.027172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:16.027172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:16.027172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:16.027172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:16.027172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:16.027172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:16.027172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:51:16.027172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:16.027172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:16.027172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:16.027172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:16.027984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:16.027984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:16.027984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:16.027984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:16.027984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:16.027984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:16.027984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:16.027984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:16.027984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:16.027984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:16.027984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:16.027984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:51:16.027984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 83/169] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:16.028628 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729c129-4a00-4dd4-a186-f9233f90446c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:16.094390 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf251d6-cdd4-49f4-9b92-3239f7e2c397 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:16.161444 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5ca9a-cd51-4305-8b38-02cef3efb27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:16.162477 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5ca9a-cd51-4305-8b38-02cef3efb27e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:16.162774 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5ca9a-cd51-4305-8b38-02cef3efb27e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:16.163056 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5ca9a-cd51-4305-8b38-02cef3efb27e None admin] PATH_INFO: `/v3/projects/824de15367424616b3588eca8e09020e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:16.164621 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc5ca9a-cd51-4305-8b38-02cef3efb27e None admin] RBAC: Authorizing `identity:get_project(project_id=824de15367424616b3588eca8e09020e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:16.166253 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc5ca9a-cd51-4305-8b38-02cef3efb27e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:16.168194 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 87/170] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:15 2022] GET /identity/v3/projects/824de15367424616b3588eca8e09020e => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:16.169075 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5ca9a-cd51-4305-8b38-02cef3efb27e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:16.188207 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:16.288178 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5ca9a-cd51-4305-8b38-02cef3efb27e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:16.290298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729c129-4a00-4dd4-a186-f9233f90446c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:16.339490 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0481b2-8c4e-4ce5-b6e0-e23bf5726355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:16.340298 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0481b2-8c4e-4ce5-b6e0-e23bf5726355 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:16.340604 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0481b2-8c4e-4ce5-b6e0-e23bf5726355 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:16.340884 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0481b2-8c4e-4ce5-b6e0-e23bf5726355 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:16.342267 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0481b2-8c4e-4ce5-b6e0-e23bf5726355 None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:16.342594 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0481b2-8c4e-4ce5-b6e0-e23bf5726355 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:16.344223 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0481b2-8c4e-4ce5-b6e0-e23bf5726355 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:16.357284 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 88/171] 10.222.0.24 () {56 vars in 1101 bytes} [Thu May 19 14:51:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:16.358211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0481b2-8c4e-4ce5-b6e0-e23bf5726355 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:16.415962 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92aeda-5f9e-4f29-b7ab-32433f97b6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:16.417636 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92aeda-5f9e-4f29-b7ab-32433f97b6cc None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:16.418119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92aeda-5f9e-4f29-b7ab-32433f97b6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:16.418601 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92aeda-5f9e-4f29-b7ab-32433f97b6cc None admin] PATH_INFO: `/v3/users/c1ed4d1479484c11a4d2682af24a7155` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:16.420108 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a92aeda-5f9e-4f29-b7ab-32433f97b6cc None admin] RBAC: Authorizing `identity:get_user(user_id=c1ed4d1479484c11a4d2682af24a7155)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:16.421850 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a92aeda-5f9e-4f29-b7ab-32433f97b6cc None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:16.427997 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 84/172] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:16 2022] GET /identity/v3/users/c1ed4d1479484c11a4d2682af24a7155 => generated 275 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:16.429078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92aeda-5f9e-4f29-b7ab-32433f97b6cc None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:16.483683 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:16.507373 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0481b2-8c4e-4ce5-b6e0-e23bf5726355 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:16.541618 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:16.570633 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80868f-fff4-40f2-9c09-327205af39bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:16.571786 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80868f-fff4-40f2-9c09-327205af39bb None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:16.572220 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80868f-fff4-40f2-9c09-327205af39bb None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:16.572643 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80868f-fff4-40f2-9c09-327205af39bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:16.573640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80868f-fff4-40f2-9c09-327205af39bb None admin] RBAC: Adding query filter params (role.id=ec4b73b709ca4cdc983e35e955aed57a, scope.project.id=824de15367424616b3588eca8e09020e, user.id=83eec44e6acd4004ba2088801e9d8f88) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:16.574127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80868f-fff4-40f2-9c09-327205af39bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:16.575758 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80868f-fff4-40f2-9c09-327205af39bb None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:16.588763 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 89/173] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:51:16 2022] GET /identity/v3/role_assignments?user.id=83eec44e6acd4004ba2088801e9d8f88&scope.project.id=824de15367424616b3588eca8e09020e&role.id=ec4b73b709ca4cdc983e35e955aed57a => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:16.590550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80868f-fff4-40f2-9c09-327205af39bb None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:16.628835 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92aeda-5f9e-4f29-b7ab-32433f97b6cc None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:16.707924 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc7864-805e-404e-b775-2153b10bdfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:16.709133 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc7864-805e-404e-b775-2153b10bdfd6 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:16.709565 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc7864-805e-404e-b775-2153b10bdfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:16.709987 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc7864-805e-404e-b775-2153b10bdfd6 None admin] PATH_INFO: `/v3/users/c1ed4d1479484c11a4d2682af24a7155` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:16.711550 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc7864-805e-404e-b775-2153b10bdfd6 None admin] RBAC: Authorizing `identity:get_user(user_id=c1ed4d1479484c11a4d2682af24a7155)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:16.713208 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc7864-805e-404e-b775-2153b10bdfd6 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:16.715086 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 85/174] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:16 2022] GET /identity/v3/users/c1ed4d1479484c11a4d2682af24a7155 => generated 275 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:16.716558 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878f2f5-f7c4-4dcc-adc2-d6198ae78979 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:16.716990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878f2f5-f7c4-4dcc-adc2-d6198ae78979 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:16.717432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878f2f5-f7c4-4dcc-adc2-d6198ae78979 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:16.718866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 86/175] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:16.728310 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878f2f5-f7c4-4dcc-adc2-d6198ae78979 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:16.736782 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80868f-fff4-40f2-9c09-327205af39bb None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:16.774863 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b71fb-90bb-439c-9740-c519288d47b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:16.775883 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b71fb-90bb-439c-9740-c519288d47b1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:16.777039 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b71fb-90bb-439c-9740-c519288d47b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:16.777636 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b71fb-90bb-439c-9740-c519288d47b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:16.799666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:16.891116 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b71fb-90bb-439c-9740-c519288d47b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:16.893767 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b71fb-90bb-439c-9740-c519288d47b1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:16.961149 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878f2f5-f7c4-4dcc-adc2-d6198ae78979 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:16.985005 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:17.013875 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd1bad-0038-41fb-afeb-2c982556ac27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:17.014756 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd1bad-0038-41fb-afeb-2c982556ac27 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:17.016124 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd1bad-0038-41fb-afeb-2c982556ac27 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:17.017234 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd1bad-0038-41fb-afeb-2c982556ac27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:17.114509 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 90/176] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:51:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:17.115759 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b00390-e8ef-4b8c-8515-ab0a0ef9c9aa None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:17.116221 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b00390-e8ef-4b8c-8515-ab0a0ef9c9aa None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:17.116644 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b00390-e8ef-4b8c-8515-ab0a0ef9c9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:17.121008 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd1bad-0038-41fb-afeb-2c982556ac27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:17.123021 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd1bad-0038-41fb-afeb-2c982556ac27 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:17.149930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-62b00390-e8ef-4b8c-8515-ab0a0ef9c9aa None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:17.151145 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-62b00390-e8ef-4b8c-8515-ab0a0ef9c9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:17.215499 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:17.272147 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 91/177] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:17.273007 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b00390-e8ef-4b8c-8515-ab0a0ef9c9aa None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:17.309459 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 87/178] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:51:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:17.315364 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd1efc-b8af-4c03-a23d-87e9e785c3f2 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:17.315651 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd1efc-b8af-4c03-a23d-87e9e785c3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:17.315930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd1efc-b8af-4c03-a23d-87e9e785c3f2 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:17.317278 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 88/179] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:17.317978 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd1efc-b8af-4c03-a23d-87e9e785c3f2 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:17.347166 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:17.436193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd1efc-b8af-4c03-a23d-87e9e785c3f2 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:17.438547 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b00390-e8ef-4b8c-8515-ab0a0ef9c9aa None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:17.472995 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f5c01-8f79-4bdf-a2a2-dd9b1eaa465d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:17.474218 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f5c01-8f79-4bdf-a2a2-dd9b1eaa465d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:17.474658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f5c01-8f79-4bdf-a2a2-dd9b1eaa465d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:17.475064 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f5c01-8f79-4bdf-a2a2-dd9b1eaa465d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:17.476090 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082e36c-ffb6-4ae2-ae89-3b5c44761283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:17.477231 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082e36c-ffb6-4ae2-ae89-3b5c44761283 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:17.477713 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082e36c-ffb6-4ae2-ae89-3b5c44761283 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:17.478181 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082e36c-ffb6-4ae2-ae89-3b5c44761283 None admin] PATH_INFO: `/v3/projects/79cbeffd8afa428395c1dc80fc054a7e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:17.479619 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082e36c-ffb6-4ae2-ae89-3b5c44761283 None admin] RBAC: Authorizing `identity:get_project(project_id=79cbeffd8afa428395c1dc80fc054a7e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:17.481359 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082e36c-ffb6-4ae2-ae89-3b5c44761283 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:17.483334 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 92/180] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:17 2022] GET /identity/v3/projects/79cbeffd8afa428395c1dc80fc054a7e => generated 312 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:17.484358 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082e36c-ffb6-4ae2-ae89-3b5c44761283 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:17.486330 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f5c01-8f79-4bdf-a2a2-dd9b1eaa465d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:17.494083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-666f5c01-8f79-4bdf-a2a2-dd9b1eaa465d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:51:17.494083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:17.494083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:17.494083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:17.494083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:17.494083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:17.494083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:17.494083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:17.494083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:17.494083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:17.494083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:17.494083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:17.494083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:17.494083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:17.494083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:17.494083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:17.494996 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:17.494996 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:17.494996 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:17.494996 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:17.494996 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:17.494996 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:17.494996 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:17.494996 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:17.494996 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:17.494996 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:17.494996 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:17.494996 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:51:17.494996 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:17.494996 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:17.494996 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:17.494996 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:17.496060 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:17.496060 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:17.496060 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:17.496060 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:17.496060 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:17.496060 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:17.496060 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:17.496060 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:17.496060 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:17.496060 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:17.496060 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:51:17.496060 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:51:17.496060 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 89/181] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:17.497183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd529f-32b5-4deb-8250-5fd2bdf17aa3 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:17.497183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd529f-32b5-4deb-8250-5fd2bdf17aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:17.497332 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd529f-32b5-4deb-8250-5fd2bdf17aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:17.519650 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-26dd529f-32b5-4deb-8250-5fd2bdf17aa3 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:17.520838 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-26dd529f-32b5-4deb-8250-5fd2bdf17aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:17.532130 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:17.592370 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 90/182] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:17.593217 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd529f-32b5-4deb-8250-5fd2bdf17aa3 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:17.597908 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082e36c-ffb6-4ae2-ae89-3b5c44761283 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:17.605088 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:17.636154 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed5f47-eeba-4106-8c4d-4787f7144e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:17.637392 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed5f47-eeba-4106-8c4d-4787f7144e5e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:17.637970 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed5f47-eeba-4106-8c4d-4787f7144e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:17.638451 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed5f47-eeba-4106-8c4d-4787f7144e5e None admin] PATH_INFO: `/v3/projects/824de15367424616b3588eca8e09020e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:17.639958 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed5f47-eeba-4106-8c4d-4787f7144e5e None admin] RBAC: Authorizing `identity:get_project(project_id=824de15367424616b3588eca8e09020e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:17.641660 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed5f47-eeba-4106-8c4d-4787f7144e5e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:17.643782 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 93/183] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:17 2022] GET /identity/v3/projects/824de15367424616b3588eca8e09020e => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:17.644859 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed5f47-eeba-4106-8c4d-4787f7144e5e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:17.697655 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd529f-32b5-4deb-8250-5fd2bdf17aa3 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:17.732984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2db24b-1e6b-4cf1-82eb-11b684d7ba9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:17.733696 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2db24b-1e6b-4cf1-82eb-11b684d7ba9a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:17.733980 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2db24b-1e6b-4cf1-82eb-11b684d7ba9a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:17.734257 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2db24b-1e6b-4cf1-82eb-11b684d7ba9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:17.735121 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2db24b-1e6b-4cf1-82eb-11b684d7ba9a None admin] RBAC: Adding query filter params (role.id=fd5043dc9e3e4ec49e035ee01fc68854, scope.project.id=79cbeffd8afa428395c1dc80fc054a7e, user.id=c1ed4d1479484c11a4d2682af24a7155) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:17.735475 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2db24b-1e6b-4cf1-82eb-11b684d7ba9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:17.737858 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2db24b-1e6b-4cf1-82eb-11b684d7ba9a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:17.744824 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 91/184] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:51:17 2022] GET /identity/v3/role_assignments?user.id=c1ed4d1479484c11a4d2682af24a7155&scope.project.id=79cbeffd8afa428395c1dc80fc054a7e&role.id=fd5043dc9e3e4ec49e035ee01fc68854 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:17.745525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2db24b-1e6b-4cf1-82eb-11b684d7ba9a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:17.756145 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed5f47-eeba-4106-8c4d-4787f7144e5e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:17.765125 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:17.797001 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fd54c-55f4-4268-baf4-86106309c898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:17.798114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fd54c-55f4-4268-baf4-86106309c898 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:17.798694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fd54c-55f4-4268-baf4-86106309c898 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:17.799853 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fd54c-55f4-4268-baf4-86106309c898 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:17.800889 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57fd54c-55f4-4268-baf4-86106309c898 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:17.801412 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57fd54c-55f4-4268-baf4-86106309c898 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:17.803063 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57fd54c-55f4-4268-baf4-86106309c898 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:17.812619 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 94/185] 10.222.0.24 () {56 vars in 1101 bytes} [Thu May 19 14:51:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:17.813835 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fd54c-55f4-4268-baf4-86106309c898 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:17.836548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:17.867470 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2db24b-1e6b-4cf1-82eb-11b684d7ba9a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:17.907182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4324ba6-05f4-4d9a-aaa3-845b30ba80a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:17.908945 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4324ba6-05f4-4d9a-aaa3-845b30ba80a7 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:17.909450 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4324ba6-05f4-4d9a-aaa3-845b30ba80a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:17.909934 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4324ba6-05f4-4d9a-aaa3-845b30ba80a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:17.922166 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4324ba6-05f4-4d9a-aaa3-845b30ba80a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:17.926204 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fd54c-55f4-4268-baf4-86106309c898 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:17.930685 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-b4324ba6-05f4-4d9a-aaa3-845b30ba80a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:17.930685 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:17.930685 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:17.930685 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:17.930685 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:17.930685 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:17.930685 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:17.930685 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:17.930685 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:17.930685 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:17.930685 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:17.930685 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:17.930685 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:17.930685 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:17.930685 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:17.930685 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:17.931627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:17.931627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:17.931627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:17.931627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:17.931627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:17.931627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:17.931627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:17.931627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:17.931627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:17.931627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:17.931627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:17.931627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:51:17.931627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:17.931627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:17.931627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:17.931627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:17.932481 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:17.932481 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:17.932481 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:17.932481 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:17.932481 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:17.932481 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:17.932481 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:17.932481 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:17.932481 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:17.932481 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:17.932481 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:17.932481 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:51:17.934900 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 92/186] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:51:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:17.936038 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4324ba6-05f4-4d9a-aaa3-845b30ba80a7 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:17.963883 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc546d-e7d0-48db-8beb-7ec5af1a7cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:17.964393 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc546d-e7d0-48db-8beb-7ec5af1a7cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:17.964686 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc546d-e7d0-48db-8beb-7ec5af1a7cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:17.964969 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc546d-e7d0-48db-8beb-7ec5af1a7cd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:17.965915 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc546d-e7d0-48db-8beb-7ec5af1a7cd4 None admin] RBAC: Adding query filter params (role.id=fd5043dc9e3e4ec49e035ee01fc68854, scope.project.id=824de15367424616b3588eca8e09020e, user.id=c1ed4d1479484c11a4d2682af24a7155) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:17.966124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc546d-e7d0-48db-8beb-7ec5af1a7cd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:17.967643 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc546d-e7d0-48db-8beb-7ec5af1a7cd4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:17.974632 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 95/187] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:51:17 2022] GET /identity/v3/role_assignments?user.id=c1ed4d1479484c11a4d2682af24a7155&scope.project.id=824de15367424616b3588eca8e09020e&role.id=fd5043dc9e3e4ec49e035ee01fc68854 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:17.975506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc546d-e7d0-48db-8beb-7ec5af1a7cd4 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:18.015312 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:18.088119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4324ba6-05f4-4d9a-aaa3-845b30ba80a7 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:18.136567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79010f-c326-449e-8555-8f4876f62506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:18.137460 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79010f-c326-449e-8555-8f4876f62506 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:18.137751 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79010f-c326-449e-8555-8f4876f62506 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:18.138031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79010f-c326-449e-8555-8f4876f62506 None admin] PATH_INFO: `/v3/users/d26b504ccdc846ccad497028c783a508` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:18.139370 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79010f-c326-449e-8555-8f4876f62506 None admin] RBAC: Authorizing `identity:get_user(user_id=d26b504ccdc846ccad497028c783a508)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:18.140987 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79010f-c326-449e-8555-8f4876f62506 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:18.143281 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 93/188] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:17 2022] GET /identity/v3/users/d26b504ccdc846ccad497028c783a508 => generated 289 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:18.144736 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfdd56-1ad0-4b86-93ae-ac9a3653ac4a None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:18.145029 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfdd56-1ad0-4b86-93ae-ac9a3653ac4a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:18.145310 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfdd56-1ad0-4b86-93ae-ac9a3653ac4a None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:18.146856 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 94/189] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:18.148043 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ef26c-680a-40a0-b057-d5ca873bda69 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:18.148319 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ef26c-680a-40a0-b057-d5ca873bda69 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:18.148916 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ef26c-680a-40a0-b057-d5ca873bda69 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:18.150248 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 95/190] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:18.155362 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ef26c-680a-40a0-b057-d5ca873bda69 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:18.159920 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:18.162856 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc546d-e7d0-48db-8beb-7ec5af1a7cd4 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:18.206770 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca151ee-2d2d-4e45-96de-d64512649b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:18.207835 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca151ee-2d2d-4e45-96de-d64512649b3e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:18.207835 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca151ee-2d2d-4e45-96de-d64512649b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:18.208109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca151ee-2d2d-4e45-96de-d64512649b3e None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:18.209449 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca151ee-2d2d-4e45-96de-d64512649b3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:18.209767 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca151ee-2d2d-4e45-96de-d64512649b3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:18.211695 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca151ee-2d2d-4e45-96de-d64512649b3e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:18.223295 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 96/191] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:18.224395 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6be90-9c44-4c4e-8fd6-ca0b5c663e6b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:18.224704 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6be90-9c44-4c4e-8fd6-ca0b5c663e6b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:18.225021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6be90-9c44-4c4e-8fd6-ca0b5c663e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:18.242622 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1ba6be90-9c44-4c4e-8fd6-ca0b5c663e6b None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:18.243845 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1ba6be90-9c44-4c4e-8fd6-ca0b5c663e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:18.286322 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ef26c-680a-40a0-b057-d5ca873bda69 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:18.325854 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cd9a0-c783-4028-b328-5fa8b385f0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:18.326510 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cd9a0-c783-4028-b328-5fa8b385f0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:18.326796 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cd9a0-c783-4028-b328-5fa8b385f0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:18.327072 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cd9a0-c783-4028-b328-5fa8b385f0c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:18.329098 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 97/192] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:18.330943 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9d266-5560-4209-8605-441ac8e7a337 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:18.331301 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9d266-5560-4209-8605-441ac8e7a337 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:18.331579 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9d266-5560-4209-8605-441ac8e7a337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:18.352317 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-51b9d266-5560-4209-8605-441ac8e7a337 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:18.353499 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-51b9d266-5560-4209-8605-441ac8e7a337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:18.370505 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:18.396770 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317cd9a0-c783-4028-b328-5fa8b385f0c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:18.398250 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317cd9a0-c783-4028-b328-5fa8b385f0c9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:18.400120 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:18.420168 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 98/193] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:18.420988 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9d266-5560-4209-8605-441ac8e7a337 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:18.498796 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 96/194] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:51:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:18.499591 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cd9a0-c783-4028-b328-5fa8b385f0c9 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:18.521130 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9d266-5560-4209-8605-441ac8e7a337 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:18.553789 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a0946-0405-491f-9321-8cf339ae11f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:18.554663 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a0946-0405-491f-9321-8cf339ae11f3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:18.554944 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a0946-0405-491f-9321-8cf339ae11f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:18.555254 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a0946-0405-491f-9321-8cf339ae11f3 None admin] PATH_INFO: `/v3/users/ace8344d94d34f7aa136a7838fb51704` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:18.568512 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a0946-0405-491f-9321-8cf339ae11f3 None admin] RBAC: Authorizing `identity:get_user(user_id=ace8344d94d34f7aa136a7838fb51704)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:18.569969 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a0946-0405-491f-9321-8cf339ae11f3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:18.571676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 99/195] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:18 2022] GET /identity/v3/users/ace8344d94d34f7aa136a7838fb51704 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:18.572434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a0946-0405-491f-9321-8cf339ae11f3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:18.589955 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:18.598317 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cd9a0-c783-4028-b328-5fa8b385f0c9 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:18.599863 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:18.633398 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8164c6-ac29-48c3-9778-2e1da651027b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:18.634196 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8164c6-ac29-48c3-9778-2e1da651027b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:18.634478 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8164c6-ac29-48c3-9778-2e1da651027b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:18.634750 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8164c6-ac29-48c3-9778-2e1da651027b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:18.644533 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8164c6-ac29-48c3-9778-2e1da651027b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:18.652799 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-2e8164c6-ac29-48c3-9778-2e1da651027b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:18.652799 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:18.652799 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:18.652799 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:18.652799 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:18.652799 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:18.652799 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:18.652799 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:18.652799 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:18.652799 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:18.652799 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:18.652799 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:18.652799 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:18.652799 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:18.652799 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:18.652799 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:18.653826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:18.653826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:18.653826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:18.653826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:18.653826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:18.653826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:18.653826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:18.653826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:18.653826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:18.653826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:18.653826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:18.653826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:51:18.653826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:18.653826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:18.653826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:18.653826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:18.654613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:18.654613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:18.654613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:18.654613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:18.654613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:18.654613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:18.654613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:18.654613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:18.654613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:18.654613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:18.654613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:18.654613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:51:18.654613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 97/196] 10.222.0.24 () {56 vars in 1114 bytes} [Thu May 19 14:51:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:18.654613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8164c6-ac29-48c3-9778-2e1da651027b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:18.679658 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a0946-0405-491f-9321-8cf339ae11f3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:18.713369 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a0a17-7c22-450c-881c-c59040933f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:18.714150 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a0a17-7c22-450c-881c-c59040933f9a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:18.714429 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a0a17-7c22-450c-881c-c59040933f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:18.714702 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a0a17-7c22-450c-881c-c59040933f9a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:18.715870 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a0a17-7c22-450c-881c-c59040933f9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:18.717312 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a0a17-7c22-450c-881c-c59040933f9a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:18.718898 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 100/197] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:51:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:18.719683 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a0a17-7c22-450c-881c-c59040933f9a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:18.761477 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8164c6-ac29-48c3-9778-2e1da651027b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:18.794043 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a3d88-8449-4ff6-8706-5efe3e24ef58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:18.794890 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a3d88-8449-4ff6-8706-5efe3e24ef58 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:18.795168 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a3d88-8449-4ff6-8706-5efe3e24ef58 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:18.795481 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a3d88-8449-4ff6-8706-5efe3e24ef58 None admin] PATH_INFO: `/v3/projects/824de15367424616b3588eca8e09020e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:18.796648 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a3d88-8449-4ff6-8706-5efe3e24ef58 None admin] RBAC: Authorizing `identity:get_project(project_id=824de15367424616b3588eca8e09020e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:18.797862 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:18.798077 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a3d88-8449-4ff6-8706-5efe3e24ef58 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:18.800324 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 98/198] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:18 2022] GET /identity/v3/projects/824de15367424616b3588eca8e09020e => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:18.801049 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a3d88-8449-4ff6-8706-5efe3e24ef58 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:18.818617 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a0a17-7c22-450c-881c-c59040933f9a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:18.833964 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:18.851745 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a5c0b-bcf5-42c3-9b55-461f875aee25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:18.852390 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a5c0b-bcf5-42c3-9b55-461f875aee25 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:18.852670 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a5c0b-bcf5-42c3-9b55-461f875aee25 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:18.852948 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a5c0b-bcf5-42c3-9b55-461f875aee25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:18.902412 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a3d88-8449-4ff6-8706-5efe3e24ef58 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:18.918630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a5c0b-bcf5-42c3-9b55-461f875aee25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:18.920141 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a5c0b-bcf5-42c3-9b55-461f875aee25 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:18.935537 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c931ba7-0407-4cb0-a5af-90af9f406194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:18.936195 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c931ba7-0407-4cb0-a5af-90af9f406194 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:18.936474 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c931ba7-0407-4cb0-a5af-90af9f406194 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:18.936756 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c931ba7-0407-4cb0-a5af-90af9f406194 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:18.937508 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c931ba7-0407-4cb0-a5af-90af9f406194 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:18.937818 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c931ba7-0407-4cb0-a5af-90af9f406194 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:18.939256 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c931ba7-0407-4cb0-a5af-90af9f406194 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:18.947766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 99/199] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:51:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:18.948616 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c931ba7-0407-4cb0-a5af-90af9f406194 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:19.000735 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:19.020430 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 101/200] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:51:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:19.021183 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a5c0b-bcf5-42c3-9b55-461f875aee25 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:19.040677 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:19.049949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c931ba7-0407-4cb0-a5af-90af9f406194 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:19.083436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d1ba2-3b70-4f76-8aca-e6176f0fb8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:19.084101 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d1ba2-3b70-4f76-8aca-e6176f0fb8c3 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:19.084381 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d1ba2-3b70-4f76-8aca-e6176f0fb8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:19.084649 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d1ba2-3b70-4f76-8aca-e6176f0fb8c3 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:19.085359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d1ba2-3b70-4f76-8aca-e6176f0fb8c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:19.086795 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d1ba2-3b70-4f76-8aca-e6176f0fb8c3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:19.105508 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 100/201] 10.222.0.24 () {60 vars in 1132 bytes} [Thu May 19 14:51:18 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:51:19.105508 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d1ba2-3b70-4f76-8aca-e6176f0fb8c3 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:19.120969 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a5c0b-bcf5-42c3-9b55-461f875aee25 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:19.160995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afaf285-28f2-458e-a398-965ae6a71adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:19.161675 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afaf285-28f2-458e-a398-965ae6a71adc None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:19.161971 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afaf285-28f2-458e-a398-965ae6a71adc None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:19.162255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afaf285-28f2-458e-a398-965ae6a71adc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:19.163687 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afaf285-28f2-458e-a398-965ae6a71adc None admin] RBAC: Adding query filter params (role.id=1e1d2d30ba484c3f80d3cbb6f407a716, scope.project.id=824de15367424616b3588eca8e09020e, user.id=d26b504ccdc846ccad497028c783a508) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:19.164038 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afaf285-28f2-458e-a398-965ae6a71adc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:19.165647 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afaf285-28f2-458e-a398-965ae6a71adc None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:19.172624 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 102/202] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:51:19 2022] GET /identity/v3/role_assignments?user.id=d26b504ccdc846ccad497028c783a508&scope.project.id=824de15367424616b3588eca8e09020e&role.id=1e1d2d30ba484c3f80d3cbb6f407a716 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:19.173501 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afaf285-28f2-458e-a398-965ae6a71adc None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:19.235264 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d1ba2-3b70-4f76-8aca-e6176f0fb8c3 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:19.256824 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:19.284365 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb276dd-90ba-4f63-b760-8c066105613b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:19.285170 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb276dd-90ba-4f63-b760-8c066105613b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:19.285453 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb276dd-90ba-4f63-b760-8c066105613b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:19.285729 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb276dd-90ba-4f63-b760-8c066105613b None admin] PATH_INFO: `/v3/users/ace8344d94d34f7aa136a7838fb51704` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:19.287772 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb276dd-90ba-4f63-b760-8c066105613b None admin] RBAC: Authorizing `identity:get_user(user_id=ace8344d94d34f7aa136a7838fb51704)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:19.289303 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb276dd-90ba-4f63-b760-8c066105613b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:19.291087 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 101/203] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:19 2022] GET /identity/v3/users/ace8344d94d34f7aa136a7838fb51704 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:19.297160 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb276dd-90ba-4f63-b760-8c066105613b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:19.328800 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:19.340870 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afaf285-28f2-458e-a398-965ae6a71adc None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:19.389828 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ec6ff-c1f5-4304-b567-7d88a3ce8f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:19.390942 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ec6ff-c1f5-4304-b567-7d88a3ce8f09 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:19.391286 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ec6ff-c1f5-4304-b567-7d88a3ce8f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:19.391575 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ec6ff-c1f5-4304-b567-7d88a3ce8f09 None admin] PATH_INFO: `/v3/projects/08189b6976bc4ea785ac0de443ab36e3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:19.393527 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ec6ff-c1f5-4304-b567-7d88a3ce8f09 None admin] RBAC: Authorizing `identity:get_project(project_id=08189b6976bc4ea785ac0de443ab36e3)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:19.394985 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ec6ff-c1f5-4304-b567-7d88a3ce8f09 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:19.397103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 103/204] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:19 2022] GET /identity/v3/projects/08189b6976bc4ea785ac0de443ab36e3 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:19.403352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ec6ff-c1f5-4304-b567-7d88a3ce8f09 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:19.444182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb276dd-90ba-4f63-b760-8c066105613b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:19.491252 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4a4bb-ebf4-40b7-a62c-de7ff86488bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:19.492261 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4a4bb-ebf4-40b7-a62c-de7ff86488bd None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:19.492749 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4a4bb-ebf4-40b7-a62c-de7ff86488bd None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:19.493082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4a4bb-ebf4-40b7-a62c-de7ff86488bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:19.537308 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ec6ff-c1f5-4304-b567-7d88a3ce8f09 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:19.553148 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:19.572983 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e4a4bb-ebf4-40b7-a62c-de7ff86488bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:19.574434 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e4a4bb-ebf4-40b7-a62c-de7ff86488bd None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:19.576083 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e67c7a-9279-4e07-83b7-aafaa20a5805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:19.576751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e67c7a-9279-4e07-83b7-aafaa20a5805 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:19.577042 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e67c7a-9279-4e07-83b7-aafaa20a5805 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:19.577323 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e67c7a-9279-4e07-83b7-aafaa20a5805 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:19.578168 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e67c7a-9279-4e07-83b7-aafaa20a5805 None admin] RBAC: Adding query filter params (role.id=ec4b73b709ca4cdc983e35e955aed57a, scope.project.id=08189b6976bc4ea785ac0de443ab36e3, user.id=ace8344d94d34f7aa136a7838fb51704) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:19.578491 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e67c7a-9279-4e07-83b7-aafaa20a5805 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:19.580535 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e67c7a-9279-4e07-83b7-aafaa20a5805 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:19.586281 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 104/205] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:51:19 2022] GET /identity/v3/role_assignments?user.id=ace8344d94d34f7aa136a7838fb51704&scope.project.id=08189b6976bc4ea785ac0de443ab36e3&role.id=ec4b73b709ca4cdc983e35e955aed57a => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:19.599738 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:19.697406 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 102/206] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:51:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:51:19.703045 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e67c7a-9279-4e07-83b7-aafaa20a5805 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:19.821899 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e67c7a-9279-4e07-83b7-aafaa20a5805 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:19.856140 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c606d-9b9e-4b03-9412-90a5c82993ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:19.857007 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c606d-9b9e-4b03-9412-90a5c82993ea None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:19.857287 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c606d-9b9e-4b03-9412-90a5c82993ea None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:19.857558 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c606d-9b9e-4b03-9412-90a5c82993ea None admin] PATH_INFO: `/v3/projects/08189b6976bc4ea785ac0de443ab36e3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:19.858802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c606d-9b9e-4b03-9412-90a5c82993ea None admin] RBAC: Authorizing `identity:get_project(project_id=08189b6976bc4ea785ac0de443ab36e3)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:19.860290 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c606d-9b9e-4b03-9412-90a5c82993ea None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:19.862029 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 105/207] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:19 2022] GET /identity/v3/projects/08189b6976bc4ea785ac0de443ab36e3 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:19.868078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4a4bb-ebf4-40b7-a62c-de7ff86488bd None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:19.974903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4a4bb-ebf4-40b7-a62c-de7ff86488bd None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:19.992438 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:20.012999 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac746367-8c27-487c-8755-51c81b2b7e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:20.013660 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac746367-8c27-487c-8755-51c81b2b7e99 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:20.013945 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac746367-8c27-487c-8755-51c81b2b7e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:20.014222 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac746367-8c27-487c-8755-51c81b2b7e99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:20.015274 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac746367-8c27-487c-8755-51c81b2b7e99 None admin] RBAC: Adding query filter params (role.id=9d41dc09d0f646b1994526fcbd8d3622, scope.project.id=08189b6976bc4ea785ac0de443ab36e3, user.id=ace8344d94d34f7aa136a7838fb51704) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:20.015594 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac746367-8c27-487c-8755-51c81b2b7e99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:20.017154 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac746367-8c27-487c-8755-51c81b2b7e99 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:20.023941 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 103/208] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:51:19 2022] GET /identity/v3/role_assignments?user.id=ace8344d94d34f7aa136a7838fb51704&scope.project.id=08189b6976bc4ea785ac0de443ab36e3&role.id=9d41dc09d0f646b1994526fcbd8d3622 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:21.533543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094be422-6e31-453a-9fd6-4c46a84aa89c None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:21.534619 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094be422-6e31-453a-9fd6-4c46a84aa89c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:21.535106 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094be422-6e31-453a-9fd6-4c46a84aa89c None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:21.536813 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 106/209] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:21.542873 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b089cb3-3a46-49a2-b180-f9c8c074dc54 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:21.543452 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b089cb3-3a46-49a2-b180-f9c8c074dc54 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:21.543452 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b089cb3-3a46-49a2-b180-f9c8c074dc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:21.562467 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-6b089cb3-3a46-49a2-b180-f9c8c074dc54 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:21.563699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6b089cb3-3a46-49a2-b180-f9c8c074dc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:21.634755 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 104/210] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:51:21.657894 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094be422-6e31-453a-9fd6-4c46a84aa89c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:21.709888 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:21.722320 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad8396-5778-4b13-9d17-b127bc665e7e None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:21.722930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad8396-5778-4b13-9d17-b127bc665e7e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:21.723469 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad8396-5778-4b13-9d17-b127bc665e7e None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:21.725086 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 105/211] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:21.730592 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ffabd-6451-436d-aa10-e77ab5d1440f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:21.731160 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ffabd-6451-436d-aa10-e77ab5d1440f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:21.731668 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ffabd-6451-436d-aa10-e77ab5d1440f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:21.749191 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-909ffabd-6451-436d-aa10-e77ab5d1440f None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:21.750678 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-909ffabd-6451-436d-aa10-e77ab5d1440f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:21.784825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094be422-6e31-453a-9fd6-4c46a84aa89c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:21.829022 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 106/212] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:21.829395 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb6207-471c-4f56-89cb-8f2814f5f475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:21.830237 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb6207-471c-4f56-89cb-8f2814f5f475 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:21.830528 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb6207-471c-4f56-89cb-8f2814f5f475 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:21.830809 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb6207-471c-4f56-89cb-8f2814f5f475 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:21.848367 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb6207-471c-4f56-89cb-8f2814f5f475 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:21.853411 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ffabd-6451-436d-aa10-e77ab5d1440f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:21.857505 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-c8cb6207-471c-4f56-89cb-8f2814f5f475 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:21.857505 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:21.857505 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:21.857505 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:21.857505 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:21.857505 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:21.857505 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:21.857505 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:21.857505 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:21.857505 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:21.857505 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:21.857505 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:21.857505 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:21.857505 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:21.857505 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:21.857505 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:21.858396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:21.858396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:21.858396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:21.858396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:21.858396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:21.858396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:21.858396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:21.858396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:21.858396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:21.858396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:21.858396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:21.858396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:51:21.858396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:21.858396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:21.858396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:21.858396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:21.859226 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:21.859226 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:21.859226 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:21.859226 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:21.859226 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:21.859226 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:21.859226 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:21.859226 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:21.859226 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:21.859226 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:21.859226 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:21.859226 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:51:21.859226 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 107/213] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:21.868137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb6207-471c-4f56-89cb-8f2814f5f475 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:21.902976 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:21.964732 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ffabd-6451-436d-aa10-e77ab5d1440f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:21.984725 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb6207-471c-4f56-89cb-8f2814f5f475 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:21.987757 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:22.000976 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d85ca-4852-4a3e-989c-1eb90313f3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:22.002308 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d85ca-4852-4a3e-989c-1eb90313f3e7 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:22.002591 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d85ca-4852-4a3e-989c-1eb90313f3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:22.002869 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d85ca-4852-4a3e-989c-1eb90313f3e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:22.004072 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d85ca-4852-4a3e-989c-1eb90313f3e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:22.005566 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d85ca-4852-4a3e-989c-1eb90313f3e7 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:22.007183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 107/214] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:51:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:22.007183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616edb82-f757-436a-b332-023ee1001c1f None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:22.007183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616edb82-f757-436a-b332-023ee1001c1f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:22.007183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616edb82-f757-436a-b332-023ee1001c1f None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:22.007183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 108/215] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:22.014854 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616edb82-f757-436a-b332-023ee1001c1f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:22.029936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09ceaa-e411-4347-bf3b-46d574ab7646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:22.030864 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09ceaa-e411-4347-bf3b-46d574ab7646 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:22.031247 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09ceaa-e411-4347-bf3b-46d574ab7646 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:22.031631 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09ceaa-e411-4347-bf3b-46d574ab7646 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:22.032388 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09ceaa-e411-4347-bf3b-46d574ab7646 None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:22.032708 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09ceaa-e411-4347-bf3b-46d574ab7646 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:22.034671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09ceaa-e411-4347-bf3b-46d574ab7646 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:22.047926 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 108/216] 10.222.0.24 () {56 vars in 1101 bytes} [Thu May 19 14:51:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:22.047926 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d46380-b298-494d-86f5-df854d4549a5 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:22.047926 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d46380-b298-494d-86f5-df854d4549a5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:22.047926 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d46380-b298-494d-86f5-df854d4549a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:22.063394 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-17d46380-b298-494d-86f5-df854d4549a5 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:22.064907 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-17d46380-b298-494d-86f5-df854d4549a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:22.131030 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616edb82-f757-436a-b332-023ee1001c1f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:22.139260 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 109/217] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:22.139260 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d46380-b298-494d-86f5-df854d4549a5 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:22.147750 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:22.176089 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8379a-581d-4b94-b8e0-4f16db59626f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:22.176692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8379a-581d-4b94-b8e0-4f16db59626f None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:22.176980 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8379a-581d-4b94-b8e0-4f16db59626f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:22.177253 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8379a-581d-4b94-b8e0-4f16db59626f None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:22.177980 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8379a-581d-4b94-b8e0-4f16db59626f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:22.179442 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8379a-581d-4b94-b8e0-4f16db59626f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:22.200664 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 109/218] 10.222.0.24 () {60 vars in 1132 bytes} [Thu May 19 14:51:22 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:51:22.201696 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8379a-581d-4b94-b8e0-4f16db59626f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:22.260166 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:22.270358 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d46380-b298-494d-86f5-df854d4549a5 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:22.313501 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a6e63-abb4-42b9-99c0-db6c158741fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:22.314933 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a6e63-abb4-42b9-99c0-db6c158741fd None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:22.315706 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a6e63-abb4-42b9-99c0-db6c158741fd None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:22.315706 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a6e63-abb4-42b9-99c0-db6c158741fd None admin] PATH_INFO: `/v3/users/1b545d8a23d0483b99e715c1ccfcc172` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:22.323103 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8379a-581d-4b94-b8e0-4f16db59626f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:22.335408 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a6e63-abb4-42b9-99c0-db6c158741fd None admin] RBAC: Authorizing `identity:get_user(user_id=1b545d8a23d0483b99e715c1ccfcc172)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:22.337043 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a6e63-abb4-42b9-99c0-db6c158741fd None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:22.338821 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 110/219] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:22 2022] GET /identity/v3/users/1b545d8a23d0483b99e715c1ccfcc172 => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:22.343354 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abd075-4c3b-4ff1-8d8d-9ee38ed2ea54 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:22.343354 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abd075-4c3b-4ff1-8d8d-9ee38ed2ea54 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:22.343354 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abd075-4c3b-4ff1-8d8d-9ee38ed2ea54 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:22.343354 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 111/220] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:22.347640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335aec53-04ef-455d-aaaf-c9ae3a1dd03a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:22.347938 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335aec53-04ef-455d-aaaf-c9ae3a1dd03a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:22.348222 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335aec53-04ef-455d-aaaf-c9ae3a1dd03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:22.367673 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-335aec53-04ef-455d-aaaf-c9ae3a1dd03a None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:22.368897 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-335aec53-04ef-455d-aaaf-c9ae3a1dd03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:22.371722 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afb112-7ba5-4486-ad97-6ba9299cc275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:22.372954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afb112-7ba5-4486-ad97-6ba9299cc275 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:22.372954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afb112-7ba5-4486-ad97-6ba9299cc275 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:22.373128 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afb112-7ba5-4486-ad97-6ba9299cc275 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:22.384859 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afb112-7ba5-4486-ad97-6ba9299cc275 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:22.392623 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-06afb112-7ba5-4486-ad97-6ba9299cc275 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:22.392623 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:22.392623 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:22.392623 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:22.392623 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:22.392623 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:22.392623 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:22.392623 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:22.392623 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:22.392623 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:22.392623 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:22.392623 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:22.392623 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:22.392623 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:22.392623 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:22.392623 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:22.393696 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:22.393696 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:22.393696 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:22.393696 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:22.393696 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:22.393696 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:22.393696 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:22.393696 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:22.393696 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:22.393696 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:22.393696 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:22.393696 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:51:22.393696 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:22.393696 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:22.393696 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:22.393696 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:22.394770 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:22.394770 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:22.394770 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:22.394770 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:22.394770 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:22.394770 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:22.394770 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:22.394770 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:22.394770 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:22.394770 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:22.394770 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:22.394770 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:51:22.394770 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 110/221] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:51:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:22.394770 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afb112-7ba5-4486-ad97-6ba9299cc275 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:22.427997 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:22.456761 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 112/222] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:22.457630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335aec53-04ef-455d-aaaf-c9ae3a1dd03a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:22.528982 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afb112-7ba5-4486-ad97-6ba9299cc275 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:22.564824 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:22.569973 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfdbaf-1b40-4742-a98d-fd66d561961f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:22.571089 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfdbaf-1b40-4742-a98d-fd66d561961f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:22.571581 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfdbaf-1b40-4742-a98d-fd66d561961f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:22.571995 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfdbaf-1b40-4742-a98d-fd66d561961f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:22.584182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335aec53-04ef-455d-aaaf-c9ae3a1dd03a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:22.632077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051e211-3e44-4bd9-8f00-eca21412b5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:22.632916 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051e211-3e44-4bd9-8f00-eca21412b5ed None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:22.633493 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051e211-3e44-4bd9-8f00-eca21412b5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:22.633782 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051e211-3e44-4bd9-8f00-eca21412b5ed None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:22.634550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051e211-3e44-4bd9-8f00-eca21412b5ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:22.634862 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051e211-3e44-4bd9-8f00-eca21412b5ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:22.636751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051e211-3e44-4bd9-8f00-eca21412b5ed None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:22.647839 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 113/223] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:22.648940 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051e211-3e44-4bd9-8f00-eca21412b5ed None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:22.657444 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfdbaf-1b40-4742-a98d-fd66d561961f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:22.659915 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfdbaf-1b40-4742-a98d-fd66d561961f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:22.692644 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:22.785712 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051e211-3e44-4bd9-8f00-eca21412b5ed None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:22.790639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 111/224] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:51:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:22.791822 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfdbaf-1b40-4742-a98d-fd66d561961f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:22.838011 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938c4d8-bfa9-42f1-92ba-3ad052bb5c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:22.838826 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938c4d8-bfa9-42f1-92ba-3ad052bb5c2d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:22.839116 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938c4d8-bfa9-42f1-92ba-3ad052bb5c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:22.839424 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938c4d8-bfa9-42f1-92ba-3ad052bb5c2d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:22.854419 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938c4d8-bfa9-42f1-92ba-3ad052bb5c2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:22.866755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-7938c4d8-bfa9-42f1-92ba-3ad052bb5c2d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:22.866755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:22.866755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:22.866755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:22.866755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:22.866755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:22.866755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:22.866755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:22.866755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:22.866755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:22.866755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:22.866755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:22.866755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:22.866755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:22.866755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:22.866755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:22.869318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:22.869318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:22.869318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:22.869318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:22.869318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:22.869318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:22.869318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:22.869318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:22.869318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:22.869318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:22.869318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:22.869318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:51:22.869318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:22.869318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:22.869318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:22.869318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:22.871556 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:22.871556 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:22.871556 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:22.871556 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:22.871556 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:22.871556 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:22.871556 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:22.871556 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:22.871556 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:22.871556 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:22.871556 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:22.871556 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:51:22.871556 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 114/225] 10.222.0.24 () {56 vars in 1114 bytes} [Thu May 19 14:51:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:22.871556 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938c4d8-bfa9-42f1-92ba-3ad052bb5c2d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:22.882211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:22.905831 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfdbaf-1b40-4742-a98d-fd66d561961f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:22.933080 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:22.946399 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d277b-902c-4e9c-a21a-ee87e0835d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:22.947654 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d277b-902c-4e9c-a21a-ee87e0835d75 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:22.948118 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d277b-902c-4e9c-a21a-ee87e0835d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:22.948570 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d277b-902c-4e9c-a21a-ee87e0835d75 None admin] PATH_INFO: `/v3/users/ace8344d94d34f7aa136a7838fb51704` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:22.950158 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d277b-902c-4e9c-a21a-ee87e0835d75 None admin] RBAC: Authorizing `identity:get_user(user_id=ace8344d94d34f7aa136a7838fb51704)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:22.951875 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d277b-902c-4e9c-a21a-ee87e0835d75 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:22.954179 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 112/226] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:22 2022] GET /identity/v3/users/ace8344d94d34f7aa136a7838fb51704 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:22.955236 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d277b-902c-4e9c-a21a-ee87e0835d75 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:23.001054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938c4d8-bfa9-42f1-92ba-3ad052bb5c2d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:23.046124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c4a77-a6c4-453b-8263-9512ba5699b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:23.047449 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c4a77-a6c4-453b-8263-9512ba5699b1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:23.047918 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c4a77-a6c4-453b-8263-9512ba5699b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:23.048405 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c4a77-a6c4-453b-8263-9512ba5699b1 None admin] PATH_INFO: `/v3/projects/08189b6976bc4ea785ac0de443ab36e3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:23.050368 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c4a77-a6c4-453b-8263-9512ba5699b1 None admin] RBAC: Authorizing `identity:get_project(project_id=08189b6976bc4ea785ac0de443ab36e3)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:23.052046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c4a77-a6c4-453b-8263-9512ba5699b1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:23.053949 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 115/227] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:22 2022] GET /identity/v3/projects/08189b6976bc4ea785ac0de443ab36e3 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:23.054880 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c4a77-a6c4-453b-8263-9512ba5699b1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:23.082451 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d277b-902c-4e9c-a21a-ee87e0835d75 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:23.121318 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b5f08-19e0-4e87-8d63-e70c603e549a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:23.122292 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b5f08-19e0-4e87-8d63-e70c603e549a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:23.122812 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b5f08-19e0-4e87-8d63-e70c603e549a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:23.123305 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b5f08-19e0-4e87-8d63-e70c603e549a None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:23.124489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b5f08-19e0-4e87-8d63-e70c603e549a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:23.124975 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b5f08-19e0-4e87-8d63-e70c603e549a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:23.126705 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b5f08-19e0-4e87-8d63-e70c603e549a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:23.136315 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 113/228] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:51:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:23.137488 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b5f08-19e0-4e87-8d63-e70c603e549a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:23.146613 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:23.180468 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c4a77-a6c4-453b-8263-9512ba5699b1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:23.201604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:23.229112 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58572b33-2835-42d2-84af-a61ddc339e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:23.230362 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58572b33-2835-42d2-84af-a61ddc339e60 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:23.230865 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58572b33-2835-42d2-84af-a61ddc339e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:23.231375 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58572b33-2835-42d2-84af-a61ddc339e60 None admin] PATH_INFO: `/v3/projects/08189b6976bc4ea785ac0de443ab36e3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:23.232761 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58572b33-2835-42d2-84af-a61ddc339e60 None admin] RBAC: Authorizing `identity:get_project(project_id=08189b6976bc4ea785ac0de443ab36e3)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:23.234427 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58572b33-2835-42d2-84af-a61ddc339e60 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:23.236437 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 116/229] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:23 2022] GET /identity/v3/projects/08189b6976bc4ea785ac0de443ab36e3 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:23.237545 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58572b33-2835-42d2-84af-a61ddc339e60 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:23.261008 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b5f08-19e0-4e87-8d63-e70c603e549a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:23.297261 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c83919-9d3b-4c77-941f-f742f1d03f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:23.298371 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c83919-9d3b-4c77-941f-f742f1d03f42 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:23.298857 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c83919-9d3b-4c77-941f-f742f1d03f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:23.299399 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c83919-9d3b-4c77-941f-f742f1d03f42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:23.300426 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c83919-9d3b-4c77-941f-f742f1d03f42 None admin] RBAC: Adding query filter params (role.id=fd5043dc9e3e4ec49e035ee01fc68854, scope.project.id=08189b6976bc4ea785ac0de443ab36e3, user.id=1b545d8a23d0483b99e715c1ccfcc172) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:23.300951 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c83919-9d3b-4c77-941f-f742f1d03f42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:23.302592 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c83919-9d3b-4c77-941f-f742f1d03f42 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:23.318093 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 114/230] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:51:23 2022] GET /identity/v3/role_assignments?user.id=1b545d8a23d0483b99e715c1ccfcc172&scope.project.id=08189b6976bc4ea785ac0de443ab36e3&role.id=fd5043dc9e3e4ec49e035ee01fc68854 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:23.319415 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c83919-9d3b-4c77-941f-f742f1d03f42 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:23.367230 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58572b33-2835-42d2-84af-a61ddc339e60 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:23.411020 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0a44f-b05a-47fa-974b-501821953cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:23.411943 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0a44f-b05a-47fa-974b-501821953cbd None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:23.413252 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0a44f-b05a-47fa-974b-501821953cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:23.413252 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0a44f-b05a-47fa-974b-501821953cbd None admin] PATH_INFO: `/v3/users/ace8344d94d34f7aa136a7838fb51704` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:23.414173 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0a44f-b05a-47fa-974b-501821953cbd None admin] RBAC: Authorizing `identity:get_user(user_id=ace8344d94d34f7aa136a7838fb51704)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:23.416206 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0a44f-b05a-47fa-974b-501821953cbd None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:23.418112 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 117/231] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:23 2022] GET /identity/v3/users/ace8344d94d34f7aa136a7838fb51704 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:23.423248 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0a44f-b05a-47fa-974b-501821953cbd None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:23.442107 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:23.544743 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0a44f-b05a-47fa-974b-501821953cbd None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:23.555314 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c83919-9d3b-4c77-941f-f742f1d03f42 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:23.591053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d992d68-7417-434d-9232-b94c1c043936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:23.591053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d992d68-7417-434d-9232-b94c1c043936 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:23.591053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d992d68-7417-434d-9232-b94c1c043936 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:23.591053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d992d68-7417-434d-9232-b94c1c043936 None admin] PATH_INFO: `/v3/projects/08189b6976bc4ea785ac0de443ab36e3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:23.593047 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d992d68-7417-434d-9232-b94c1c043936 None admin] RBAC: Authorizing `identity:get_project(project_id=08189b6976bc4ea785ac0de443ab36e3)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:23.594550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d992d68-7417-434d-9232-b94c1c043936 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:23.599332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 118/232] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:23 2022] GET /identity/v3/projects/08189b6976bc4ea785ac0de443ab36e3 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:23.601069 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:23.604762 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d992d68-7417-434d-9232-b94c1c043936 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:23.639545 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5332f0-be54-4442-8d7b-a74c7335ec14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:23.640450 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5332f0-be54-4442-8d7b-a74c7335ec14 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:23.640736 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5332f0-be54-4442-8d7b-a74c7335ec14 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:23.641013 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5332f0-be54-4442-8d7b-a74c7335ec14 None admin] PATH_INFO: `/v3/projects/08189b6976bc4ea785ac0de443ab36e3/users/ace8344d94d34f7aa136a7838fb51704/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:23.651693 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5332f0-be54-4442-8d7b-a74c7335ec14 None admin] RBAC: Authorizing `identity:create_grant(project_id=08189b6976bc4ea785ac0de443ab36e3, user_id=ace8344d94d34f7aa136a7838fb51704, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:23.654676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5332f0-be54-4442-8d7b-a74c7335ec14 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:23.674069 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 115/233] 10.222.0.24 () {58 vars in 1439 bytes} [Thu May 19 14:51:23 2022] PUT /identity/v3/projects/08189b6976bc4ea785ac0de443ab36e3/users/ace8344d94d34f7aa136a7838fb51704/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:51:23.723606 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:23.749204 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d992d68-7417-434d-9232-b94c1c043936 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:23.787732 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0e652-afe5-49a1-a5d9-870c2a16f6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:23.788754 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0e652-afe5-49a1-a5d9-870c2a16f6cf None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:23.789044 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0e652-afe5-49a1-a5d9-870c2a16f6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:23.789321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0e652-afe5-49a1-a5d9-870c2a16f6cf None admin] PATH_INFO: `/v3/projects/08189b6976bc4ea785ac0de443ab36e3/users/ace8344d94d34f7aa136a7838fb51704/roles/9d41dc09d0f646b1994526fcbd8d3622` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:23.791910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0e652-afe5-49a1-a5d9-870c2a16f6cf None admin] RBAC: Authorizing `identity:create_grant(project_id=08189b6976bc4ea785ac0de443ab36e3, user_id=ace8344d94d34f7aa136a7838fb51704, role_id=9d41dc09d0f646b1994526fcbd8d3622)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:23.793496 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0e652-afe5-49a1-a5d9-870c2a16f6cf None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:23.808136 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 119/234] 10.222.0.24 () {58 vars in 1439 bytes} [Thu May 19 14:51:23 2022] PUT /identity/v3/projects/08189b6976bc4ea785ac0de443ab36e3/users/ace8344d94d34f7aa136a7838fb51704/roles/9d41dc09d0f646b1994526fcbd8d3622 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:51:24.802611 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a10e86-408c-4d10-9e08-6b3de76d2db6 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:24.803130 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a10e86-408c-4d10-9e08-6b3de76d2db6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:24.803235 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a10e86-408c-4d10-9e08-6b3de76d2db6 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:24.804830 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 116/235] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:24.816847 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03d696-3555-47ca-8807-b37ffa8a154c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:24.817353 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03d696-3555-47ca-8807-b37ffa8a154c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:24.817501 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03d696-3555-47ca-8807-b37ffa8a154c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:24.838301 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131b0d6-5d35-4b7a-9ff8-ce8926c41216 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:24.838591 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131b0d6-5d35-4b7a-9ff8-ce8926c41216 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:24.838859 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131b0d6-5d35-4b7a-9ff8-ce8926c41216 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:24.840419 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1b03d696-3555-47ca-8807-b37ffa8a154c None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:24.840599 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 117/236] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:51:24.841427 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1b03d696-3555-47ca-8807-b37ffa8a154c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:24.846046 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5996a-4662-4e3a-85b6-6f48e0e6efcb None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:24.846337 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5996a-4662-4e3a-85b6-6f48e0e6efcb None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:24.846618 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5996a-4662-4e3a-85b6-6f48e0e6efcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:24.863459 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-0ee5996a-4662-4e3a-85b6-6f48e0e6efcb None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:24.864667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0ee5996a-4662-4e3a-85b6-6f48e0e6efcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:24.943313 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 118/237] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:51:24.956534 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 120/238] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:51:24.961807 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5996a-4662-4e3a-85b6-6f48e0e6efcb None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:24.995296 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03d696-3555-47ca-8807-b37ffa8a154c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:25.066590 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5996a-4662-4e3a-85b6-6f48e0e6efcb None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:25.076555 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:25.115828 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af363f06-8eaf-45d3-8c0d-3861dfdb9f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:25.116629 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af363f06-8eaf-45d3-8c0d-3861dfdb9f71 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:25.116917 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af363f06-8eaf-45d3-8c0d-3861dfdb9f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:25.117198 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af363f06-8eaf-45d3-8c0d-3861dfdb9f71 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:25.120899 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af363f06-8eaf-45d3-8c0d-3861dfdb9f71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:25.122365 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af363f06-8eaf-45d3-8c0d-3861dfdb9f71 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:25.130724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 119/239] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:51:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:25.131989 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af363f06-8eaf-45d3-8c0d-3861dfdb9f71 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:25.171175 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:25.251102 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03d696-3555-47ca-8807-b37ffa8a154c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:25.297030 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61820f1-4a7a-4f76-a8b9-41614206b231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:25.297839 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61820f1-4a7a-4f76-a8b9-41614206b231 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:25.298128 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61820f1-4a7a-4f76-a8b9-41614206b231 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:25.298445 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61820f1-4a7a-4f76-a8b9-41614206b231 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:25.307453 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af363f06-8eaf-45d3-8c0d-3861dfdb9f71 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:25.317341 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61820f1-4a7a-4f76-a8b9-41614206b231 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:25.331364 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-c61820f1-4a7a-4f76-a8b9-41614206b231 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:51:25.331364 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:25.331364 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:25.331364 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:25.331364 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:25.331364 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:25.331364 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:25.331364 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:25.331364 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:25.331364 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:25.331364 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:25.331364 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:25.331364 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:25.331364 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:25.331364 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:25.331364 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:25.332273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:25.332273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:25.332273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:25.332273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:25.332273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:25.332273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:25.332273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:25.332273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:25.332273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:25.332273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:25.332273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:25.332273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:51:25.332273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:25.332273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:25.332273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:25.332273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:25.333080 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:25.333080 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:25.333080 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:25.333080 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:25.333080 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:25.333080 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:25.333080 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:25.333080 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:25.333080 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:25.333080 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:25.333080 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:51:25.333080 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:51:25.335907 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 121/240] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:25.342257 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61820f1-4a7a-4f76-a8b9-41614206b231 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:25.387181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910c7ce-657a-402c-b141-d02c5c4c6359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:25.389763 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910c7ce-657a-402c-b141-d02c5c4c6359 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:25.390477 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910c7ce-657a-402c-b141-d02c5c4c6359 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:25.391543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910c7ce-657a-402c-b141-d02c5c4c6359 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:25.394371 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910c7ce-657a-402c-b141-d02c5c4c6359 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:25.396827 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910c7ce-657a-402c-b141-d02c5c4c6359 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:25.464407 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 120/241] 10.222.0.24 () {60 vars in 1132 bytes} [Thu May 19 14:51:25 2022] POST /identity/v3/users => generated 293 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:51:25.478374 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61820f1-4a7a-4f76-a8b9-41614206b231 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:25.508105 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:25.526067 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e80e3-9efa-49e5-a8ac-2caa0418b90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:25.526772 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e80e3-9efa-49e5-a8ac-2caa0418b90a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:25.527060 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e80e3-9efa-49e5-a8ac-2caa0418b90a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:25.527376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e80e3-9efa-49e5-a8ac-2caa0418b90a None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:25.528156 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e80e3-9efa-49e5-a8ac-2caa0418b90a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:25.528468 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e80e3-9efa-49e5-a8ac-2caa0418b90a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:25.529913 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e80e3-9efa-49e5-a8ac-2caa0418b90a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:25.545474 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 122/242] 10.222.0.24 () {56 vars in 1101 bytes} [Thu May 19 14:51:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:25.551607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910c7ce-657a-402c-b141-d02c5c4c6359 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:25.590584 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:25.685181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910c7ce-657a-402c-b141-d02c5c4c6359 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:25.729704 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b19e5-0094-484b-85de-6b40d0f37a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:25.730589 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b19e5-0094-484b-85de-6b40d0f37a70 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:25.730877 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b19e5-0094-484b-85de-6b40d0f37a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:25.731159 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b19e5-0094-484b-85de-6b40d0f37a70 None admin] PATH_INFO: `/v3/users/1a6ec8276012455c971b6f4eeb7dccf9` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:25.745028 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b19e5-0094-484b-85de-6b40d0f37a70 None admin] RBAC: Authorizing `identity:get_user(user_id=1a6ec8276012455c971b6f4eeb7dccf9)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:25.746769 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b19e5-0094-484b-85de-6b40d0f37a70 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:25.748864 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 121/243] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:25 2022] GET /identity/v3/users/1a6ec8276012455c971b6f4eeb7dccf9 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:25.756313 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e80e3-9efa-49e5-a8ac-2caa0418b90a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:25.875652 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e80e3-9efa-49e5-a8ac-2caa0418b90a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:25.915023 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94125a63-d16c-49c4-94bd-a477af93a795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:25.915713 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94125a63-d16c-49c4-94bd-a477af93a795 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:25.915994 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94125a63-d16c-49c4-94bd-a477af93a795 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:25.916273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94125a63-d16c-49c4-94bd-a477af93a795 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:25.979244 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:25.990916 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94125a63-d16c-49c4-94bd-a477af93a795 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:25.992519 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94125a63-d16c-49c4-94bd-a477af93a795 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:26.099392 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 123/244] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:51:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:26.104901 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b19e5-0094-484b-85de-6b40d0f37a70 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:26.194130 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ef143-c888-40af-ab5d-7d8d5f72f30a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:26.194704 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ef143-c888-40af-ab5d-7d8d5f72f30a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:26.195149 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ef143-c888-40af-ab5d-7d8d5f72f30a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:26.196715 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 124/245] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:51:26.202242 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f97e7-147f-48db-8b52-2382a02f6713 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:26.202753 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f97e7-147f-48db-8b52-2382a02f6713 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:26.203222 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f97e7-147f-48db-8b52-2382a02f6713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:26.217742 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:26.225563 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a29f97e7-147f-48db-8b52-2382a02f6713 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:26.227042 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a29f97e7-147f-48db-8b52-2382a02f6713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:26.228170 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b19e5-0094-484b-85de-6b40d0f37a70 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:26.269869 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f102a-761c-4bdc-aaec-63550d89650b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:26.270740 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f102a-761c-4bdc-aaec-63550d89650b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:26.271020 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f102a-761c-4bdc-aaec-63550d89650b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:26.271321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f102a-761c-4bdc-aaec-63550d89650b None admin] PATH_INFO: `/v3/projects/08189b6976bc4ea785ac0de443ab36e3` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:26.272611 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f102a-761c-4bdc-aaec-63550d89650b None admin] RBAC: Authorizing `identity:get_project(project_id=08189b6976bc4ea785ac0de443ab36e3)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:26.274060 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f102a-761c-4bdc-aaec-63550d89650b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:26.276076 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 122/246] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:26 2022] GET /identity/v3/projects/08189b6976bc4ea785ac0de443ab36e3 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:26.285186 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f102a-761c-4bdc-aaec-63550d89650b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:26.325668 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 125/247] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:51:26.353931 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f97e7-147f-48db-8b52-2382a02f6713 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:26.396694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:26.436983 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f102a-761c-4bdc-aaec-63550d89650b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:26.479924 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8a014-1b99-45f6-9e44-15c8081671c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:26.481204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8a014-1b99-45f6-9e44-15c8081671c8 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:26.481685 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8a014-1b99-45f6-9e44-15c8081671c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:26.482152 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8a014-1b99-45f6-9e44-15c8081671c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:26.483547 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8a014-1b99-45f6-9e44-15c8081671c8 None admin] RBAC: Adding query filter params (role.id=1e1d2d30ba484c3f80d3cbb6f407a716, scope.project.id=08189b6976bc4ea785ac0de443ab36e3, user.id=1a6ec8276012455c971b6f4eeb7dccf9) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:26.484075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8a014-1b99-45f6-9e44-15c8081671c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:26.485879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8a014-1b99-45f6-9e44-15c8081671c8 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:26.493524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 123/248] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:51:26 2022] GET /identity/v3/role_assignments?user.id=1a6ec8276012455c971b6f4eeb7dccf9&scope.project.id=08189b6976bc4ea785ac0de443ab36e3&role.id=1e1d2d30ba484c3f80d3cbb6f407a716 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:26.544399 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f97e7-147f-48db-8b52-2382a02f6713 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:26.594624 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61df36-c264-46d0-9598-e8e0dfea33f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:26.595875 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61df36-c264-46d0-9598-e8e0dfea33f2 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:26.596353 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61df36-c264-46d0-9598-e8e0dfea33f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:26.596817 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61df36-c264-46d0-9598-e8e0dfea33f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:26.614523 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61df36-c264-46d0-9598-e8e0dfea33f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:26.617001 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7ac3c-b954-4a26-ac89-5f6346bb0259 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:26.617291 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7ac3c-b954-4a26-ac89-5f6346bb0259 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:26.617566 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7ac3c-b954-4a26-ac89-5f6346bb0259 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:26.619270 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 124/249] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:51:26.624409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-ac61df36-c264-46d0-9598-e8e0dfea33f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:26.624409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:26.624409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:26.624409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:26.624409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:26.624409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:26.624409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:26.624409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:26.624409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:26.624409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:26.624409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:26.624409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:26.624409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:26.624409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:26.624409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:26.624409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:26.625271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:26.625271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:26.625271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:26.625271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:26.625271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:26.625271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:26.625271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:26.625271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:26.625271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:26.625271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:26.625271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:26.625271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:51:26.625271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:26.625271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:26.625271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:26.625271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:26.626043 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:26.626043 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:26.626043 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:26.626043 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:26.626043 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:26.626043 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:26.626043 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:26.626043 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:26.626043 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:26.626043 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:26.626043 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:26.626043 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:51:26.627173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba748d-fd47-4e75-8340-5153aa4e5da0 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:26.627173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba748d-fd47-4e75-8340-5153aa4e5da0 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:26.627173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba748d-fd47-4e75-8340-5153aa4e5da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:26.629245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 126/250] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:51:26.635150 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61df36-c264-46d0-9598-e8e0dfea33f2 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:26.676376 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-3bba748d-fd47-4e75-8340-5153aa4e5da0 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:26.677654 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3bba748d-fd47-4e75-8340-5153aa4e5da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:26.730299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:26.738004 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:26.761345 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61df36-c264-46d0-9598-e8e0dfea33f2 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:26.799873 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30426be0-1f0d-49f7-af91-56b50d5089d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:26.800899 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30426be0-1f0d-49f7-af91-56b50d5089d4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:26.801406 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30426be0-1f0d-49f7-af91-56b50d5089d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:26.801876 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30426be0-1f0d-49f7-af91-56b50d5089d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:26.802819 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30426be0-1f0d-49f7-af91-56b50d5089d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:26.803379 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30426be0-1f0d-49f7-af91-56b50d5089d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:26.804977 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30426be0-1f0d-49f7-af91-56b50d5089d4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:26.815776 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 127/251] 10.222.0.24 () {56 vars in 1101 bytes} [Thu May 19 14:51:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:26.822501 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30426be0-1f0d-49f7-af91-56b50d5089d4 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:26.869578 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 125/252] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:26.894891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90a521-8efc-42dc-83cf-bfc9a205c1c6 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:26.895242 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90a521-8efc-42dc-83cf-bfc9a205c1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:26.895529 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90a521-8efc-42dc-83cf-bfc9a205c1c6 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:26.897201 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 126/253] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:51:26.904561 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb0139-a933-48e4-8370-9bcc8e51911f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:26.904847 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb0139-a933-48e4-8370-9bcc8e51911f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:26.905180 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb0139-a933-48e4-8370-9bcc8e51911f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:26.931911 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30426be0-1f0d-49f7-af91-56b50d5089d4 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:26.938712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b9bb0139-a933-48e4-8370-9bcc8e51911f None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:26.940672 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b9bb0139-a933-48e4-8370-9bcc8e51911f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:26.969173 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f8e31-37af-4e88-8be8-ec39ab9d7ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:26.970693 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f8e31-37af-4e88-8be8-ec39ab9d7ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:26.971226 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f8e31-37af-4e88-8be8-ec39ab9d7ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:26.971697 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f8e31-37af-4e88-8be8-ec39ab9d7ef0 None admin] PATH_INFO: `/v3/users/1b545d8a23d0483b99e715c1ccfcc172` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:26.973111 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f8e31-37af-4e88-8be8-ec39ab9d7ef0 None admin] RBAC: Authorizing `identity:get_user(user_id=1b545d8a23d0483b99e715c1ccfcc172)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:26.974758 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f8e31-37af-4e88-8be8-ec39ab9d7ef0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:26.977225 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 128/254] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:26 2022] GET /identity/v3/users/1b545d8a23d0483b99e715c1ccfcc172 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:26.978345 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f8e31-37af-4e88-8be8-ec39ab9d7ef0 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:26.996023 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:27.086264 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f8e31-37af-4e88-8be8-ec39ab9d7ef0 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:27.123866 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2232111-9135-4fd2-a961-68870011a78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:27.125568 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2232111-9135-4fd2-a961-68870011a78b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:27.126372 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2232111-9135-4fd2-a961-68870011a78b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:27.126879 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2232111-9135-4fd2-a961-68870011a78b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:27.137189 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 127/255] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:27.138071 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb0139-a933-48e4-8370-9bcc8e51911f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:27.139342 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2232111-9135-4fd2-a961-68870011a78b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:27.149255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-a2232111-9135-4fd2-a961-68870011a78b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:27.149255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:27.149255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:27.149255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:27.149255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:27.149255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:27.149255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:27.149255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:27.149255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:27.149255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:27.149255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:27.149255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:27.149255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:27.149255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:27.149255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:27.149255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:27.150127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:27.150127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:27.150127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:27.150127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:27.150127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:27.150127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:27.150127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:27.150127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:27.150127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:27.150127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:27.150127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:27.150127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:51:27.150127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:27.150127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:27.150127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:27.150127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:27.150902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:27.150902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:27.150902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:27.150902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:27.150902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:27.150902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:27.150902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:27.150902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:27.150902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:27.150902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:27.150902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:27.150902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:51:27.153937 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 129/256] 10.222.0.24 () {56 vars in 1114 bytes} [Thu May 19 14:51:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:27.161987 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2232111-9135-4fd2-a961-68870011a78b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:27.264952 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:27.281924 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:27.298823 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb0139-a933-48e4-8370-9bcc8e51911f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:27.344806 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2232111-9135-4fd2-a961-68870011a78b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:27.363652 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0392e-7e81-4939-aedf-4b42da9cc22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:27.364527 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0392e-7e81-4939-aedf-4b42da9cc22a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:27.364811 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0392e-7e81-4939-aedf-4b42da9cc22a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:27.365081 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0392e-7e81-4939-aedf-4b42da9cc22a None admin] PATH_INFO: `/v3/projects/08189b6976bc4ea785ac0de443ab36e3` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:27.367012 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f0392e-7e81-4939-aedf-4b42da9cc22a None admin] RBAC: Authorizing `identity:get_project(project_id=08189b6976bc4ea785ac0de443ab36e3)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:27.368620 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f0392e-7e81-4939-aedf-4b42da9cc22a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:27.373145 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 128/257] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:27 2022] GET /identity/v3/projects/08189b6976bc4ea785ac0de443ab36e3 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:27.373938 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0392e-7e81-4939-aedf-4b42da9cc22a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:27.412255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01e586-4b63-4a28-a22a-286a39773341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:27.412927 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01e586-4b63-4a28-a22a-286a39773341 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:27.413215 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01e586-4b63-4a28-a22a-286a39773341 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:27.413493 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01e586-4b63-4a28-a22a-286a39773341 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:27.414242 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01e586-4b63-4a28-a22a-286a39773341 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:27.414553 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01e586-4b63-4a28-a22a-286a39773341 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:27.417022 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01e586-4b63-4a28-a22a-286a39773341 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:27.432720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 130/258] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:51:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:27.436690 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01e586-4b63-4a28-a22a-286a39773341 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:27.527026 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0392e-7e81-4939-aedf-4b42da9cc22a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:27.560969 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5132fe9-f72d-49bf-8db9-8af5937f9f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:27.561760 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5132fe9-f72d-49bf-8db9-8af5937f9f97 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:27.562074 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5132fe9-f72d-49bf-8db9-8af5937f9f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:27.562378 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5132fe9-f72d-49bf-8db9-8af5937f9f97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:27.573729 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5132fe9-f72d-49bf-8db9-8af5937f9f97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:27.582115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-d5132fe9-f72d-49bf-8db9-8af5937f9f97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:27.582115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:27.582115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:27.582115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:27.582115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:27.582115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:27.582115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:27.582115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:27.582115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:27.582115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:27.582115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:27.582115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:27.582115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:27.582115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:27.582115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:27.582115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:27.582955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:27.582955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:27.582955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:27.582955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:27.582955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:27.582955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:27.582955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:27.582955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:27.582955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:27.582955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:27.582955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:27.582955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:51:27.582955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:27.582955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:27.582955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:27.582955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:27.583774 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:27.583774 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:27.583774 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:27.583774 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:27.583774 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:27.583774 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:27.583774 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:27.583774 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:27.583774 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:27.583774 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:27.583774 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:27.583774 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:51:27.583774 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 129/259] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:51:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:27.584416 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5132fe9-f72d-49bf-8db9-8af5937f9f97 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:27.607648 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:27.674855 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01e586-4b63-4a28-a22a-286a39773341 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:27.692627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5132fe9-f72d-49bf-8db9-8af5937f9f97 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:27.727260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559ed57-c5ff-412e-a701-240cb1a9d6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:27.728141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559ed57-c5ff-412e-a701-240cb1a9d6a8 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:27.728419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559ed57-c5ff-412e-a701-240cb1a9d6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:27.728720 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559ed57-c5ff-412e-a701-240cb1a9d6a8 None admin] PATH_INFO: `/v3/users/ace8344d94d34f7aa136a7838fb51704` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:27.730208 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559ed57-c5ff-412e-a701-240cb1a9d6a8 None admin] RBAC: Authorizing `identity:get_user(user_id=ace8344d94d34f7aa136a7838fb51704)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:27.731705 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559ed57-c5ff-412e-a701-240cb1a9d6a8 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:27.732945 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:27.734493 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 130/260] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:27 2022] GET /identity/v3/users/ace8344d94d34f7aa136a7838fb51704 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:27.735312 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559ed57-c5ff-412e-a701-240cb1a9d6a8 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:27.752470 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d694f-69a7-4af0-9f96-89f47c03f084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:27.753385 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d694f-69a7-4af0-9f96-89f47c03f084 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:27.753681 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d694f-69a7-4af0-9f96-89f47c03f084 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:27.753962 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d694f-69a7-4af0-9f96-89f47c03f084 None admin] PATH_INFO: `/v3/projects/08189b6976bc4ea785ac0de443ab36e3/users/1b545d8a23d0483b99e715c1ccfcc172/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:27.764018 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d694f-69a7-4af0-9f96-89f47c03f084 None admin] RBAC: Authorizing `identity:create_grant(project_id=08189b6976bc4ea785ac0de443ab36e3, user_id=1b545d8a23d0483b99e715c1ccfcc172, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:27.765501 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d694f-69a7-4af0-9f96-89f47c03f084 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:27.823458 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:27.829843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 131/261] 10.222.0.24 () {58 vars in 1439 bytes} [Thu May 19 14:51:27 2022] PUT /identity/v3/projects/08189b6976bc4ea785ac0de443ab36e3/users/1b545d8a23d0483b99e715c1ccfcc172/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:51:27.830610 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d694f-69a7-4af0-9f96-89f47c03f084 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:27.848730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559ed57-c5ff-412e-a701-240cb1a9d6a8 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:27.889307 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1e113-1b59-42c3-812b-7ade716334f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:27.890055 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1e113-1b59-42c3-812b-7ade716334f4 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:27.890344 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1e113-1b59-42c3-812b-7ade716334f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:27.890620 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1e113-1b59-42c3-812b-7ade716334f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:27.891576 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1e113-1b59-42c3-812b-7ade716334f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:27.891906 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1e113-1b59-42c3-812b-7ade716334f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:27.893384 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1e113-1b59-42c3-812b-7ade716334f4 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:27.904316 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 131/262] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:27.911891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1e113-1b59-42c3-812b-7ade716334f4 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:28.110170 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1e113-1b59-42c3-812b-7ade716334f4 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:28.125445 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d694f-69a7-4af0-9f96-89f47c03f084 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:28.175082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396e673-7f48-4cb9-8637-7c4ac489ffd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:28.176040 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396e673-7f48-4cb9-8637-7c4ac489ffd8 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:28.177363 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396e673-7f48-4cb9-8637-7c4ac489ffd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:28.177648 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396e673-7f48-4cb9-8637-7c4ac489ffd8 None admin] PATH_INFO: `/v3/users/ace8344d94d34f7aa136a7838fb51704` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:28.179486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396e673-7f48-4cb9-8637-7c4ac489ffd8 None admin] RBAC: Authorizing `identity:get_user(user_id=ace8344d94d34f7aa136a7838fb51704)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:28.180937 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396e673-7f48-4cb9-8637-7c4ac489ffd8 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:28.182580 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 132/263] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:27 2022] GET /identity/v3/users/ace8344d94d34f7aa136a7838fb51704 => generated 283 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:28.188454 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396e673-7f48-4cb9-8637-7c4ac489ffd8 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:28.189557 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ddc96-814f-4f27-8a94-cbe4b4d0d5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:28.190221 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ddc96-814f-4f27-8a94-cbe4b4d0d5fc None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:28.190506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ddc96-814f-4f27-8a94-cbe4b4d0d5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:28.190781 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ddc96-814f-4f27-8a94-cbe4b4d0d5fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:28.211531 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:28.305283 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:28.328203 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ddc96-814f-4f27-8a94-cbe4b4d0d5fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:28.330262 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ddc96-814f-4f27-8a94-cbe4b4d0d5fc None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:28.379000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396e673-7f48-4cb9-8637-7c4ac489ffd8 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:28.428979 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4037f-8b2b-42f2-b6a9-f4a621de67fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:28.429640 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4037f-8b2b-42f2-b6a9-f4a621de67fb None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:28.429928 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4037f-8b2b-42f2-b6a9-f4a621de67fb None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:28.430204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4037f-8b2b-42f2-b6a9-f4a621de67fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:28.503486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4037f-8b2b-42f2-b6a9-f4a621de67fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:28.504985 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4037f-8b2b-42f2-b6a9-f4a621de67fb None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:28.512432 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 132/264] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:51:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:28.515307 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:28.518411 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ddc96-814f-4f27-8a94-cbe4b4d0d5fc None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:28.640901 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 133/265] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:51:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:28.659224 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4037f-8b2b-42f2-b6a9-f4a621de67fb None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:28.766996 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4037f-8b2b-42f2-b6a9-f4a621de67fb None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:28.801797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0558cd5-5f80-4540-ace2-9d03692e83be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:28.802648 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0558cd5-5f80-4540-ace2-9d03692e83be None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:28.802931 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0558cd5-5f80-4540-ace2-9d03692e83be None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:28.803220 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0558cd5-5f80-4540-ace2-9d03692e83be None admin] PATH_INFO: `/v3/projects/08189b6976bc4ea785ac0de443ab36e3` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:28.804490 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0558cd5-5f80-4540-ace2-9d03692e83be None admin] RBAC: Authorizing `identity:get_project(project_id=08189b6976bc4ea785ac0de443ab36e3)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:28.806003 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0558cd5-5f80-4540-ace2-9d03692e83be None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:28.807799 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 134/266] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:28 2022] GET /identity/v3/projects/08189b6976bc4ea785ac0de443ab36e3 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:28.808293 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:28.808947 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:28.817362 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0558cd5-5f80-4540-ace2-9d03692e83be None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:28.853307 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ddc96-814f-4f27-8a94-cbe4b4d0d5fc None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:28.972492 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0558cd5-5f80-4540-ace2-9d03692e83be None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:29.011380 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36f85e-b3d5-4975-aad4-6579d741d3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:29.012384 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36f85e-b3d5-4975-aad4-6579d741d3da None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:29.012863 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36f85e-b3d5-4975-aad4-6579d741d3da None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:29.013358 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36f85e-b3d5-4975-aad4-6579d741d3da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:29.014389 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36f85e-b3d5-4975-aad4-6579d741d3da None admin] RBAC: Adding query filter params (role.id=ec4b73b709ca4cdc983e35e955aed57a, scope.project.id=08189b6976bc4ea785ac0de443ab36e3, user.id=ace8344d94d34f7aa136a7838fb51704) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:29.014909 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36f85e-b3d5-4975-aad4-6579d741d3da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:29.016680 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36f85e-b3d5-4975-aad4-6579d741d3da None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:29.023551 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 135/267] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:51:28 2022] GET /identity/v3/role_assignments?user.id=ace8344d94d34f7aa136a7838fb51704&scope.project.id=08189b6976bc4ea785ac0de443ab36e3&role.id=ec4b73b709ca4cdc983e35e955aed57a => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:29.026013 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992bf30-c936-4ddc-82fa-e4f8b42d3362 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:29.026304 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992bf30-c936-4ddc-82fa-e4f8b42d3362 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:29.026583 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992bf30-c936-4ddc-82fa-e4f8b42d3362 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:29.031250 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 136/268] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:51:29.036907 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65738f1a-6893-4c7f-8cf9-33087b71b78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:29.037825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65738f1a-6893-4c7f-8cf9-33087b71b78e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:29.038113 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65738f1a-6893-4c7f-8cf9-33087b71b78e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:29.038392 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65738f1a-6893-4c7f-8cf9-33087b71b78e None admin] PATH_INFO: `/v3/projects/08189b6976bc4ea785ac0de443ab36e3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:29.038748 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e7b17-d45d-4009-83d8-695e0a90c2aa None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:29.039363 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e7b17-d45d-4009-83d8-695e0a90c2aa None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:29.039837 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e7b17-d45d-4009-83d8-695e0a90c2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:29.044138 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65738f1a-6893-4c7f-8cf9-33087b71b78e None admin] RBAC: Authorizing `identity:get_project(project_id=08189b6976bc4ea785ac0de443ab36e3)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:29.045663 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65738f1a-6893-4c7f-8cf9-33087b71b78e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:29.053015 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 133/269] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:28 2022] GET /identity/v3/projects/08189b6976bc4ea785ac0de443ab36e3 => generated 302 bytes in 530 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:29.060291 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65738f1a-6893-4c7f-8cf9-33087b71b78e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:29.065808 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ed1e7b17-d45d-4009-83d8-695e0a90c2aa None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:29.067501 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ed1e7b17-d45d-4009-83d8-695e0a90c2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:29.151629 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:29.225150 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 137/270] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:29.257942 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e7b17-d45d-4009-83d8-695e0a90c2aa None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:29.305754 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65738f1a-6893-4c7f-8cf9-33087b71b78e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:29.357552 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9e484-200c-4d90-a192-3f50bc42427f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:29.358746 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9e484-200c-4d90-a192-3f50bc42427f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:29.359030 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9e484-200c-4d90-a192-3f50bc42427f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:29.359335 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9e484-200c-4d90-a192-3f50bc42427f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:29.360890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9e484-200c-4d90-a192-3f50bc42427f None admin] RBAC: Adding query filter params (role.id=9d41dc09d0f646b1994526fcbd8d3622, scope.project.id=08189b6976bc4ea785ac0de443ab36e3, user.id=ace8344d94d34f7aa136a7838fb51704) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:29.361271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9e484-200c-4d90-a192-3f50bc42427f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:29.362703 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9e484-200c-4d90-a192-3f50bc42427f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:29.370093 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 134/271] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:51:29 2022] GET /identity/v3/role_assignments?user.id=ace8344d94d34f7aa136a7838fb51704&scope.project.id=08189b6976bc4ea785ac0de443ab36e3&role.id=9d41dc09d0f646b1994526fcbd8d3622 => generated 608 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:29.371753 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcda62c-2757-4f10-8a64-907230f0217b None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:29.372045 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcda62c-2757-4f10-8a64-907230f0217b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:29.372320 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcda62c-2757-4f10-8a64-907230f0217b None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:29.373832 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 135/272] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:29.374958 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553783e-ed88-4ff8-9626-d1a3e6f8afbf None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:29.380300 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553783e-ed88-4ff8-9626-d1a3e6f8afbf None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:29.380617 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553783e-ed88-4ff8-9626-d1a3e6f8afbf None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:29.382116 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 136/273] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:29.383400 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00857a5-c6a9-46b5-ba39-32023cabb7c5 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:29.383656 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00857a5-c6a9-46b5-ba39-32023cabb7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:29.383936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00857a5-c6a9-46b5-ba39-32023cabb7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:29.403254 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c00857a5-c6a9-46b5-ba39-32023cabb7c5 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:29.404492 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c00857a5-c6a9-46b5-ba39-32023cabb7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:29.416139 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e7b17-d45d-4009-83d8-695e0a90c2aa None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:29.426463 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:29.472121 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4064f-65eb-409b-91cc-51d95a5c5a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:29.473622 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4064f-65eb-409b-91cc-51d95a5c5a7b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:29.474390 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4064f-65eb-409b-91cc-51d95a5c5a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:29.475459 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4064f-65eb-409b-91cc-51d95a5c5a7b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:29.490536 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 137/274] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:29.492213 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a76de-dca4-4362-9eb1-8c9e1e6d7b77 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:29.492744 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a76de-dca4-4362-9eb1-8c9e1e6d7b77 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:29.493227 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a76de-dca4-4362-9eb1-8c9e1e6d7b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:29.496247 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e4064f-65eb-409b-91cc-51d95a5c5a7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:29.506981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-30e4064f-65eb-409b-91cc-51d95a5c5a7b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:29.506981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:29.506981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:29.506981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:29.506981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:29.506981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:29.506981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:29.506981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:29.506981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:29.506981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:29.506981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:29.506981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:29.506981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:29.506981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:29.506981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:29.506981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:29.507988 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:29.507988 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:29.507988 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:29.507988 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:29.507988 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:29.507988 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:29.507988 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:29.507988 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:29.507988 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:29.507988 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:29.507988 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:29.507988 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:51:29.507988 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:29.507988 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:29.507988 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:29.507988 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:29.508768 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:29.508768 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:29.508768 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:29.508768 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:29.508768 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:29.508768 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:29.508768 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:29.508768 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:29.508768 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:29.508768 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:29.508768 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:29.508768 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:51:29.515885 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 138/275] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:51:29.517811 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8a1a76de-dca4-4362-9eb1-8c9e1e6d7b77 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:29.523326 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8a1a76de-dca4-4362-9eb1-8c9e1e6d7b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:29.528795 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4064f-65eb-409b-91cc-51d95a5c5a7b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:29.568609 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:29.612476 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 138/276] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:29.613700 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a76de-dca4-4362-9eb1-8c9e1e6d7b77 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:29.672165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4064f-65eb-409b-91cc-51d95a5c5a7b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:29.722366 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611e7eb-1a73-4178-ac1f-a8f098429f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:29.723965 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611e7eb-1a73-4178-ac1f-a8f098429f55 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:29.724169 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611e7eb-1a73-4178-ac1f-a8f098429f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:29.724500 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611e7eb-1a73-4178-ac1f-a8f098429f55 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:29.725004 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:29.725258 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611e7eb-1a73-4178-ac1f-a8f098429f55 None admin] RBAC: Adding query filter params (name=member) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:29.725655 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611e7eb-1a73-4178-ac1f-a8f098429f55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:29.727057 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611e7eb-1a73-4178-ac1f-a8f098429f55 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:29.736748 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 139/277] 10.222.0.24 () {56 vars in 1101 bytes} [Thu May 19 14:51:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:29.737409 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611e7eb-1a73-4178-ac1f-a8f098429f55 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:29.744142 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a76de-dca4-4362-9eb1-8c9e1e6d7b77 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:29.781097 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb240a97-6b2b-4391-a60b-ad3b86688fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:29.782250 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb240a97-6b2b-4391-a60b-ad3b86688fee None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:29.783308 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb240a97-6b2b-4391-a60b-ad3b86688fee None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:29.783781 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb240a97-6b2b-4391-a60b-ad3b86688fee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:29.794718 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb240a97-6b2b-4391-a60b-ad3b86688fee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:29.802946 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-eb240a97-6b2b-4391-a60b-ad3b86688fee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:51:29.802946 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:29.802946 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:29.802946 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:29.802946 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:29.802946 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:29.802946 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:29.802946 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:29.802946 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:29.802946 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:29.802946 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:29.802946 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:29.802946 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:29.802946 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:29.802946 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:29.802946 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:29.803941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:29.803941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:29.803941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:29.803941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:29.803941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:29.803941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:29.803941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:29.803941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:29.803941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:29.803941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:29.803941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:29.803941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:51:29.803941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:29.803941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:29.803941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:29.803941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:29.804730 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:29.804730 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:29.804730 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:29.804730 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:29.804730 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:29.804730 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:29.804730 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:29.804730 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:29.804730 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:29.804730 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:29.804730 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:51:29.804730 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:51:29.807347 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 139/278] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:29.809028 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb240a97-6b2b-4391-a60b-ad3b86688fee None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:29.848611 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:29.859332 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611e7eb-1a73-4178-ac1f-a8f098429f55 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:29.896644 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a537a-df8b-4a27-bfe8-ad5fc500aa17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:29.897842 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a537a-df8b-4a27-bfe8-ad5fc500aa17 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:29.898133 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a537a-df8b-4a27-bfe8-ad5fc500aa17 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:29.898407 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a537a-df8b-4a27-bfe8-ad5fc500aa17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:29.900047 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a537a-df8b-4a27-bfe8-ad5fc500aa17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:29.902117 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a537a-df8b-4a27-bfe8-ad5fc500aa17 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:29.904613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 140/279] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:51:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:29.905666 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a537a-df8b-4a27-bfe8-ad5fc500aa17 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:29.926154 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb240a97-6b2b-4391-a60b-ad3b86688fee None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:29.961177 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779fec8-ebb1-4565-b6ef-6df4e2967c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:29.962058 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779fec8-ebb1-4565-b6ef-6df4e2967c77 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:29.962690 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779fec8-ebb1-4565-b6ef-6df4e2967c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:29.962690 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779fec8-ebb1-4565-b6ef-6df4e2967c77 None admin] PATH_INFO: `/v3/users/63d7061f25894fc1be71474abe8be881` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:29.979496 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779fec8-ebb1-4565-b6ef-6df4e2967c77 None admin] RBAC: Authorizing `identity:get_user(user_id=63d7061f25894fc1be71474abe8be881)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:29.980916 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779fec8-ebb1-4565-b6ef-6df4e2967c77 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:29.982787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 140/280] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:29 2022] GET /identity/v3/users/63d7061f25894fc1be71474abe8be881 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:29.983380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779fec8-ebb1-4565-b6ef-6df4e2967c77 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:29.986039 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:30.024102 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a537a-df8b-4a27-bfe8-ad5fc500aa17 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:30.060168 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07336aef-ac83-4530-972a-e0ed13f6f833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:30.060820 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07336aef-ac83-4530-972a-e0ed13f6f833 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:30.061100 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07336aef-ac83-4530-972a-e0ed13f6f833 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:30.061373 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07336aef-ac83-4530-972a-e0ed13f6f833 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:30.062117 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07336aef-ac83-4530-972a-e0ed13f6f833 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:30.062417 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07336aef-ac83-4530-972a-e0ed13f6f833 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:30.063809 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07336aef-ac83-4530-972a-e0ed13f6f833 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:30.071966 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 141/281] 10.222.0.24 () {56 vars in 1101 bytes} [Thu May 19 14:51:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:30.072771 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07336aef-ac83-4530-972a-e0ed13f6f833 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:30.102581 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:30.103938 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779fec8-ebb1-4565-b6ef-6df4e2967c77 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:30.140104 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becbdddd-1dfd-4903-9ca8-8ab288b3ca62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:30.140766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbdddd-1dfd-4903-9ca8-8ab288b3ca62 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:30.141080 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbdddd-1dfd-4903-9ca8-8ab288b3ca62 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:30.141322 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbdddd-1dfd-4903-9ca8-8ab288b3ca62 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:30.142047 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becbdddd-1dfd-4903-9ca8-8ab288b3ca62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:30.143512 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becbdddd-1dfd-4903-9ca8-8ab288b3ca62 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:30.165182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 141/282] 10.222.0.24 () {60 vars in 1132 bytes} [Thu May 19 14:51:29 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:51:30.166288 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becbdddd-1dfd-4903-9ca8-8ab288b3ca62 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:30.198966 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07336aef-ac83-4530-972a-e0ed13f6f833 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:30.238048 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04271af5-0929-4d06-a260-d92ad4aa8a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:30.238661 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04271af5-0929-4d06-a260-d92ad4aa8a78 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:30.238908 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04271af5-0929-4d06-a260-d92ad4aa8a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:30.239188 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04271af5-0929-4d06-a260-d92ad4aa8a78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:30.240192 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04271af5-0929-4d06-a260-d92ad4aa8a78 None admin] RBAC: Adding query filter params (role.id=fd5043dc9e3e4ec49e035ee01fc68854, user.id=63d7061f25894fc1be71474abe8be881, scope.system=all) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:30.240517 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04271af5-0929-4d06-a260-d92ad4aa8a78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:30.242137 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04271af5-0929-4d06-a260-d92ad4aa8a78 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:30.244632 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:30.249740 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 142/283] 10.222.0.24 () {56 vars in 1308 bytes} [Thu May 19 14:51:30 2022] GET /identity/v3/role_assignments?user.id=63d7061f25894fc1be71474abe8be881&scope.system=all&role.id=fd5043dc9e3e4ec49e035ee01fc68854 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:30.301102 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becbdddd-1dfd-4903-9ca8-8ab288b3ca62 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:30.353824 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9d24a-cb3f-4898-a78b-6eac02e84f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:30.355749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9d24a-cb3f-4898-a78b-6eac02e84f85 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:30.356310 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9d24a-cb3f-4898-a78b-6eac02e84f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:30.356946 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9d24a-cb3f-4898-a78b-6eac02e84f85 None admin] PATH_INFO: `/v3/users/1a6ec8276012455c971b6f4eeb7dccf9` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:30.358759 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9d24a-cb3f-4898-a78b-6eac02e84f85 None admin] RBAC: Authorizing `identity:get_user(user_id=1a6ec8276012455c971b6f4eeb7dccf9)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:30.360620 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9d24a-cb3f-4898-a78b-6eac02e84f85 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:30.362755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 142/284] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:30 2022] GET /identity/v3/users/1a6ec8276012455c971b6f4eeb7dccf9 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:30.369927 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04271af5-0929-4d06-a260-d92ad4aa8a78 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:30.492707 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:30.509409 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04271af5-0929-4d06-a260-d92ad4aa8a78 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:30.544130 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0115198-a8a5-40ec-8b5e-ba1a7e55b11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:30.544996 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0115198-a8a5-40ec-8b5e-ba1a7e55b11e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:30.545280 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0115198-a8a5-40ec-8b5e-ba1a7e55b11e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:30.545552 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0115198-a8a5-40ec-8b5e-ba1a7e55b11e None admin] PATH_INFO: `/v3/projects/08189b6976bc4ea785ac0de443ab36e3` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:30.546810 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0115198-a8a5-40ec-8b5e-ba1a7e55b11e None admin] RBAC: Authorizing `identity:get_project(project_id=08189b6976bc4ea785ac0de443ab36e3)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:30.548426 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0115198-a8a5-40ec-8b5e-ba1a7e55b11e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:30.550139 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 143/285] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:30 2022] GET /identity/v3/projects/08189b6976bc4ea785ac0de443ab36e3 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:30.555833 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9d24a-cb3f-4898-a78b-6eac02e84f85 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:30.671221 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9d24a-cb3f-4898-a78b-6eac02e84f85 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:30.698897 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:30.709190 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2333a-f8d6-418b-a05f-38d24d5444f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:30.710152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2333a-f8d6-418b-a05f-38d24d5444f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:30.710603 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2333a-f8d6-418b-a05f-38d24d5444f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:30.710896 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2333a-f8d6-418b-a05f-38d24d5444f5 None admin] PATH_INFO: `/v3/projects/08189b6976bc4ea785ac0de443ab36e3/users/1a6ec8276012455c971b6f4eeb7dccf9/roles/1e1d2d30ba484c3f80d3cbb6f407a716` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:30.712934 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2333a-f8d6-418b-a05f-38d24d5444f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=08189b6976bc4ea785ac0de443ab36e3, user_id=1a6ec8276012455c971b6f4eeb7dccf9, role_id=1e1d2d30ba484c3f80d3cbb6f407a716)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:30.714417 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2333a-f8d6-418b-a05f-38d24d5444f5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:30.728634 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 143/286] 10.222.0.24 () {58 vars in 1439 bytes} [Thu May 19 14:51:30 2022] PUT /identity/v3/projects/08189b6976bc4ea785ac0de443ab36e3/users/1a6ec8276012455c971b6f4eeb7dccf9/roles/1e1d2d30ba484c3f80d3cbb6f407a716 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:51:30.982842 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5746e40-a746-40bf-be24-971780178a95 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:30.983559 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5746e40-a746-40bf-be24-971780178a95 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:30.984041 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5746e40-a746-40bf-be24-971780178a95 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:30.986555 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 144/287] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:30.992135 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305430e-9617-448f-8332-db7425176de9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:30.992435 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305430e-9617-448f-8332-db7425176de9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:30.992722 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305430e-9617-448f-8332-db7425176de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:31.013875 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-3305430e-9617-448f-8332-db7425176de9 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:31.015373 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3305430e-9617-448f-8332-db7425176de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:31.113440 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 144/288] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:31.149529 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5746e40-a746-40bf-be24-971780178a95 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:31.276918 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5746e40-a746-40bf-be24-971780178a95 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:31.322664 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5c70b-8b36-4ee7-ba52-9b1b0a521298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:31.325555 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5c70b-8b36-4ee7-ba52-9b1b0a521298 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:31.325555 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5c70b-8b36-4ee7-ba52-9b1b0a521298 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:31.325555 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5c70b-8b36-4ee7-ba52-9b1b0a521298 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:31.340202 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5c70b-8b36-4ee7-ba52-9b1b0a521298 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:31.347990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-d8e5c70b-8b36-4ee7-ba52-9b1b0a521298 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:31.347990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:31.347990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:31.347990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:31.347990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:31.347990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:31.347990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:31.347990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:31.347990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:31.347990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:31.347990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:31.347990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:31.347990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:31.347990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:31.347990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:31.347990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:31.348863 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:31.348863 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:31.348863 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:31.348863 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:31.348863 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:31.348863 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:31.348863 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:31.348863 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:31.348863 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:31.348863 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:31.348863 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:31.348863 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:51:31.348863 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:31.348863 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:31.348863 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:31.348863 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:31.349680 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:31.349680 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:31.349680 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:31.349680 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:31.349680 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:31.349680 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:31.349680 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:31.349680 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:31.349680 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:31.349680 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:31.349680 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:31.349680 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:51:31.356509 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 145/289] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:31.363053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305430e-9617-448f-8332-db7425176de9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:31.505320 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305430e-9617-448f-8332-db7425176de9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:31.529238 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:31.550686 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb0180-323e-4137-bbb1-bd17622db4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:31.551428 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb0180-323e-4137-bbb1-bd17622db4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:31.551712 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb0180-323e-4137-bbb1-bd17622db4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:31.551971 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb0180-323e-4137-bbb1-bd17622db4c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:31.556064 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb0180-323e-4137-bbb1-bd17622db4c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:31.556370 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb0180-323e-4137-bbb1-bd17622db4c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:31.557777 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb0180-323e-4137-bbb1-bd17622db4c4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:31.566749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 145/290] 10.222.0.24 () {56 vars in 1101 bytes} [Thu May 19 14:51:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:31.572319 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5c70b-8b36-4ee7-ba52-9b1b0a521298 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:31.589057 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:31.685320 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5c70b-8b36-4ee7-ba52-9b1b0a521298 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:31.729260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b79f79-b559-41d4-a3f3-2f14eeeff237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:31.730133 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b79f79-b559-41d4-a3f3-2f14eeeff237 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:31.730414 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b79f79-b559-41d4-a3f3-2f14eeeff237 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:31.730687 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b79f79-b559-41d4-a3f3-2f14eeeff237 None admin] PATH_INFO: `/v3/users/1b545d8a23d0483b99e715c1ccfcc172` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:31.732777 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b79f79-b559-41d4-a3f3-2f14eeeff237 None admin] RBAC: Authorizing `identity:get_user(user_id=1b545d8a23d0483b99e715c1ccfcc172)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:31.734214 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b79f79-b559-41d4-a3f3-2f14eeeff237 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:31.737370 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 146/291] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:31 2022] GET /identity/v3/users/1b545d8a23d0483b99e715c1ccfcc172 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:31.742188 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb0180-323e-4137-bbb1-bd17622db4c4 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:31.916131 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb0180-323e-4137-bbb1-bd17622db4c4 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:31.963914 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99296759-7d16-4868-987f-51a23bfcafaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:31.964570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99296759-7d16-4868-987f-51a23bfcafaa None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:31.964853 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99296759-7d16-4868-987f-51a23bfcafaa None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:31.965134 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99296759-7d16-4868-987f-51a23bfcafaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:32.020599 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:32.042358 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99296759-7d16-4868-987f-51a23bfcafaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:32.043862 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99296759-7d16-4868-987f-51a23bfcafaa None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:32.158611 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 146/292] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:51:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:51:32.164280 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b79f79-b559-41d4-a3f3-2f14eeeff237 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:32.287676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:32.313659 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b79f79-b559-41d4-a3f3-2f14eeeff237 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:32.369221 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2413f5c-c343-4ae0-a137-492b6549d307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:32.370436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2413f5c-c343-4ae0-a137-492b6549d307 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:32.371190 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2413f5c-c343-4ae0-a137-492b6549d307 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:32.371693 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2413f5c-c343-4ae0-a137-492b6549d307 None admin] PATH_INFO: `/v3/projects/08189b6976bc4ea785ac0de443ab36e3` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:32.373065 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2413f5c-c343-4ae0-a137-492b6549d307 None admin] RBAC: Authorizing `identity:get_project(project_id=08189b6976bc4ea785ac0de443ab36e3)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:32.374750 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2413f5c-c343-4ae0-a137-492b6549d307 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:32.376815 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 147/293] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:32 2022] GET /identity/v3/projects/08189b6976bc4ea785ac0de443ab36e3 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:32.382826 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99296759-7d16-4868-987f-51a23bfcafaa None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:32.506506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:32.529285 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99296759-7d16-4868-987f-51a23bfcafaa None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:32.567704 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8edc99-5259-47f1-95a2-edb2aa45de09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:32.568342 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8edc99-5259-47f1-95a2-edb2aa45de09 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:32.568634 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8edc99-5259-47f1-95a2-edb2aa45de09 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:32.568917 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8edc99-5259-47f1-95a2-edb2aa45de09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:32.569757 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8edc99-5259-47f1-95a2-edb2aa45de09 None admin] RBAC: Adding query filter params (role.id=fd5043dc9e3e4ec49e035ee01fc68854, scope.project.id=08189b6976bc4ea785ac0de443ab36e3, user.id=1b545d8a23d0483b99e715c1ccfcc172) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:32.570073 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8edc99-5259-47f1-95a2-edb2aa45de09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:32.571603 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8edc99-5259-47f1-95a2-edb2aa45de09 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:32.578316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 147/294] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:51:32 2022] GET /identity/v3/role_assignments?user.id=1b545d8a23d0483b99e715c1ccfcc172&scope.project.id=08189b6976bc4ea785ac0de443ab36e3&role.id=fd5043dc9e3e4ec49e035ee01fc68854 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:33.130487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71f8b4-1056-41e8-889e-ee2e95e972e5 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:33.131143 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71f8b4-1056-41e8-889e-ee2e95e972e5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:33.131655 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71f8b4-1056-41e8-889e-ee2e95e972e5 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:33.133232 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 148/295] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:33.138737 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2561fb-5af5-49cb-bc15-154849e05162 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:33.139030 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2561fb-5af5-49cb-bc15-154849e05162 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:33.139350 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2561fb-5af5-49cb-bc15-154849e05162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:33.162219 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-fc2561fb-5af5-49cb-bc15-154849e05162 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:33.163580 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fc2561fb-5af5-49cb-bc15-154849e05162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:33.220249 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60072d3-9781-4feb-ad80-85e8058145da None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:33.220577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60072d3-9781-4feb-ad80-85e8058145da None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:33.220796 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60072d3-9781-4feb-ad80-85e8058145da None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:33.223311 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 149/296] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:33.228574 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef80ab-9393-4198-82d1-24ba4ffbe6b2 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:33.228858 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef80ab-9393-4198-82d1-24ba4ffbe6b2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:33.229135 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef80ab-9393-4198-82d1-24ba4ffbe6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:33.249021 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-edef80ab-9393-4198-82d1-24ba4ffbe6b2 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:33.250188 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-edef80ab-9393-4198-82d1-24ba4ffbe6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:33.257514 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 148/297] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:51:33.283296 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2561fb-5af5-49cb-bc15-154849e05162 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:33.339309 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 150/298] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:51:33.359619 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef80ab-9393-4198-82d1-24ba4ffbe6b2 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:33.379138 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:33.409930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2561fb-5af5-49cb-bc15-154849e05162 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:33.438805 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:33.443223 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b605ebe-f46a-4b0d-8984-51eb69e58c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:33.444009 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b605ebe-f46a-4b0d-8984-51eb69e58c5b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:33.444287 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b605ebe-f46a-4b0d-8984-51eb69e58c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:33.444557 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b605ebe-f46a-4b0d-8984-51eb69e58c5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:33.454319 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b605ebe-f46a-4b0d-8984-51eb69e58c5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:33.458059 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef80ab-9393-4198-82d1-24ba4ffbe6b2 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:33.461868 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-0b605ebe-f46a-4b0d-8984-51eb69e58c5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:33.461868 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:33.461868 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:33.461868 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:33.461868 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:33.461868 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:33.461868 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:33.461868 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:33.461868 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:33.461868 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:33.461868 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:33.461868 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:33.461868 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:33.461868 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:33.461868 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:33.461868 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:33.462717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:33.462717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:33.462717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:33.462717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:33.462717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:33.462717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:33.462717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:33.462717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:33.462717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:33.462717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:33.462717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:33.462717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:51:33.462717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:33.462717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:33.462717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:33.462717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:33.463553 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:33.463553 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:33.463553 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:33.463553 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:33.463553 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:33.463553 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:33.463553 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:33.463553 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:33.463553 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:33.463553 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:33.463553 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:33.463553 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:51:33.463553 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 149/299] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:33.464784 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d7abb-ce4e-4ee9-8ac3-c409b73baaf4 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:33.464961 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d7abb-ce4e-4ee9-8ac3-c409b73baaf4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:33.465225 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d7abb-ce4e-4ee9-8ac3-c409b73baaf4 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:33.466613 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 150/300] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:33.467632 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23a9f9-b48b-4726-a65b-5c9160c2ec8d None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:33.467974 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23a9f9-b48b-4726-a65b-5c9160c2ec8d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:33.468259 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23a9f9-b48b-4726-a65b-5c9160c2ec8d None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:33.469773 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 151/301] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:33.470892 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23a9f9-b48b-4726-a65b-5c9160c2ec8d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:33.496122 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53541c5a-df0e-426b-868c-92689f61dab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:33.496938 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53541c5a-df0e-426b-868c-92689f61dab6 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:33.497203 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53541c5a-df0e-426b-868c-92689f61dab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:33.497476 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53541c5a-df0e-426b-868c-92689f61dab6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:33.507462 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53541c5a-df0e-426b-868c-92689f61dab6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:33.515165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-53541c5a-df0e-426b-868c-92689f61dab6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:51:33.515165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:33.515165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:33.515165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:33.515165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:33.515165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:33.515165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:33.515165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:33.515165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:33.515165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:33.515165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:33.515165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:33.515165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:33.515165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:33.515165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:33.515165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:33.516046 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:33.516046 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:33.516046 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:33.516046 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:33.516046 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:33.516046 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:33.516046 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:33.516046 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:33.516046 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:33.516046 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:33.516046 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:33.516046 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:51:33.516046 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:33.516046 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:33.516046 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:33.516046 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:33.516891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:33.516891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:33.516891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:33.516891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:33.516891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:33.516891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:33.516891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:33.516891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:33.516891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:33.516891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:33.516891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:51:33.516891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:51:33.516891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 151/302] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:51:33.517738 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285175d5-e8ce-42e6-8229-45a8064d6db2 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:33.518027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285175d5-e8ce-42e6-8229-45a8064d6db2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:33.518309 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285175d5-e8ce-42e6-8229-45a8064d6db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:33.534553 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-285175d5-e8ce-42e6-8229-45a8064d6db2 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:33.535764 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-285175d5-e8ce-42e6-8229-45a8064d6db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:33.572921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23a9f9-b48b-4726-a65b-5c9160c2ec8d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:33.600835 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 152/303] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:33.610528 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bf16b-c4da-421f-90e3-52763fbc2661 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:33.610528 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bf16b-c4da-421f-90e3-52763fbc2661 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:33.610528 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bf16b-c4da-421f-90e3-52763fbc2661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:33.612020 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:33.614881 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a866b2c-bd06-4999-85dd-c8924f1b0e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:33.615915 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a866b2c-bd06-4999-85dd-c8924f1b0e7c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:33.616438 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a866b2c-bd06-4999-85dd-c8924f1b0e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:33.616968 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a866b2c-bd06-4999-85dd-c8924f1b0e7c None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:33.617720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a866b2c-bd06-4999-85dd-c8924f1b0e7c None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:33.618035 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a866b2c-bd06-4999-85dd-c8924f1b0e7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:33.619463 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a866b2c-bd06-4999-85dd-c8924f1b0e7c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:33.626544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-383bf16b-c4da-421f-90e3-52763fbc2661 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:33.627728 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-383bf16b-c4da-421f-90e3-52763fbc2661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:33.628623 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 152/304] 10.222.0.24 () {56 vars in 1101 bytes} [Thu May 19 14:51:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:33.629256 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a866b2c-bd06-4999-85dd-c8924f1b0e7c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:33.689323 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:33.700019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 153/305] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:33.701070 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bf16b-c4da-421f-90e3-52763fbc2661 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:33.729571 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a866b2c-bd06-4999-85dd-c8924f1b0e7c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:33.762165 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8d6f4-7767-4453-9b1c-326da18dc17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:33.762828 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8d6f4-7767-4453-9b1c-326da18dc17f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:33.763117 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8d6f4-7767-4453-9b1c-326da18dc17f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:33.763424 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8d6f4-7767-4453-9b1c-326da18dc17f None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:33.764169 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f8d6f4-7767-4453-9b1c-326da18dc17f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:33.764478 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f8d6f4-7767-4453-9b1c-326da18dc17f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:33.765876 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f8d6f4-7767-4453-9b1c-326da18dc17f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:33.774243 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 153/306] 10.222.0.24 () {56 vars in 1101 bytes} [Thu May 19 14:51:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:33.775021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8d6f4-7767-4453-9b1c-326da18dc17f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:33.801031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bf16b-c4da-421f-90e3-52763fbc2661 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:33.829900 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:33.833979 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a4d03-fabf-45d4-a353-545b7ef8e3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:33.834766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a4d03-fabf-45d4-a353-545b7ef8e3ff None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:33.835050 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a4d03-fabf-45d4-a353-545b7ef8e3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:33.835427 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a4d03-fabf-45d4-a353-545b7ef8e3ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:33.836586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a4d03-fabf-45d4-a353-545b7ef8e3ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:33.838020 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a4d03-fabf-45d4-a353-545b7ef8e3ff None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:33.839687 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 154/307] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:51:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:33.844052 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a4d03-fabf-45d4-a353-545b7ef8e3ff None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:33.873360 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8d6f4-7767-4453-9b1c-326da18dc17f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:33.905406 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f14ea-0d98-4907-aeda-27fcaaa06162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:33.906272 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f14ea-0d98-4907-aeda-27fcaaa06162 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:33.906556 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f14ea-0d98-4907-aeda-27fcaaa06162 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:33.906832 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f14ea-0d98-4907-aeda-27fcaaa06162 None admin] PATH_INFO: `/v3/users/63d7061f25894fc1be71474abe8be881` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:33.908462 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:33.908639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f14ea-0d98-4907-aeda-27fcaaa06162 None admin] RBAC: Authorizing `identity:get_user(user_id=63d7061f25894fc1be71474abe8be881)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:33.910394 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f14ea-0d98-4907-aeda-27fcaaa06162 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:33.912255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 154/308] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:33 2022] GET /identity/v3/users/63d7061f25894fc1be71474abe8be881 => generated 293 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:33.913027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f14ea-0d98-4907-aeda-27fcaaa06162 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:33.945083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a4d03-fabf-45d4-a353-545b7ef8e3ff None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:33.977859 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d3c6a-2e28-4241-a78a-e4f331dd22ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:33.978637 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d3c6a-2e28-4241-a78a-e4f331dd22ff None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:33.978914 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d3c6a-2e28-4241-a78a-e4f331dd22ff None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:33.979182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d3c6a-2e28-4241-a78a-e4f331dd22ff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:33.989109 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d3c6a-2e28-4241-a78a-e4f331dd22ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:33.996945 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-190d3c6a-2e28-4241-a78a-e4f331dd22ff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:51:33.996945 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:33.996945 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:33.996945 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:33.996945 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:33.996945 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:33.996945 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:33.996945 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:33.996945 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:33.996945 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:33.996945 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:33.996945 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:33.996945 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:33.996945 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:33.996945 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:33.996945 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:33.997885 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:33.997885 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:33.997885 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:33.997885 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:33.997885 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:33.997885 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:33.997885 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:33.997885 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:33.997885 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:33.997885 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:33.997885 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:33.997885 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:51:33.997885 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:33.997885 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:33.997885 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:33.997885 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:33.998755 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:33.998755 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:33.998755 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:33.998755 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:33.998755 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:33.998755 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:33.998755 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:33.998755 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:33.998755 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:33.998755 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:33.998755 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:51:33.998755 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:51:33.998755 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 155/309] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:33.999444 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d3c6a-2e28-4241-a78a-e4f331dd22ff None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:34.014509 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f14ea-0d98-4907-aeda-27fcaaa06162 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:34.037359 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:34.047846 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff70bfa-4470-4eff-bfa3-1120b38b1bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:34.048753 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff70bfa-4470-4eff-bfa3-1120b38b1bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:34.049040 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff70bfa-4470-4eff-bfa3-1120b38b1bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:34.049317 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff70bfa-4470-4eff-bfa3-1120b38b1bd7 None admin] PATH_INFO: `/v3/users/e43ac8f1143c477b84b4c4f8f38135d3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:34.062119 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff70bfa-4470-4eff-bfa3-1120b38b1bd7 None admin] RBAC: Authorizing `identity:get_user(user_id=e43ac8f1143c477b84b4c4f8f38135d3)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:34.064169 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff70bfa-4470-4eff-bfa3-1120b38b1bd7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:34.065807 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 155/310] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:33 2022] GET /identity/v3/users/e43ac8f1143c477b84b4c4f8f38135d3 => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:34.066538 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff70bfa-4470-4eff-bfa3-1120b38b1bd7 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:34.104698 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d3c6a-2e28-4241-a78a-e4f331dd22ff None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:34.130920 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:34.139249 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1433f-1392-4988-b585-e3b5e63ae884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:34.139910 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1433f-1392-4988-b585-e3b5e63ae884 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:34.140193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1433f-1392-4988-b585-e3b5e63ae884 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:34.140468 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1433f-1392-4988-b585-e3b5e63ae884 None admin] PATH_INFO: `/v3/groups` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:34.141159 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1433f-1392-4988-b585-e3b5e63ae884 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:34.143222 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1433f-1392-4988-b585-e3b5e63ae884 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:34.158940 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 156/311] 10.222.0.24 () {60 vars in 1134 bytes} [Thu May 19 14:51:33 2022] POST /identity/v3/groups => generated 229 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:51:34.158940 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1433f-1392-4988-b585-e3b5e63ae884 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:34.178697 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff70bfa-4470-4eff-bfa3-1120b38b1bd7 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:34.217534 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafae7b-0eb9-4d25-a892-51d15b4097fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:34.218685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafae7b-0eb9-4d25-a892-51d15b4097fc None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:34.219126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafae7b-0eb9-4d25-a892-51d15b4097fc None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:34.219460 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafae7b-0eb9-4d25-a892-51d15b4097fc None admin] PATH_INFO: `/v3/system/users/63d7061f25894fc1be71474abe8be881/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:34.221188 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dafae7b-0eb9-4d25-a892-51d15b4097fc None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=63d7061f25894fc1be71474abe8be881, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:34.222620 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dafae7b-0eb9-4d25-a892-51d15b4097fc None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:34.234561 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 156/312] 10.222.0.24 () {58 vars in 1334 bytes} [Thu May 19 14:51:34 2022] PUT /identity/v3/system/users/63d7061f25894fc1be71474abe8be881/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:51:34.235528 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafae7b-0eb9-4d25-a892-51d15b4097fc None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:34.291427 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1433f-1392-4988-b585-e3b5e63ae884 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:34.311789 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:34.347495 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170fac0-4e12-46c1-8400-fe2190883dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:34.348394 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170fac0-4e12-46c1-8400-fe2190883dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:34.349099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170fac0-4e12-46c1-8400-fe2190883dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:34.349488 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170fac0-4e12-46c1-8400-fe2190883dc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:34.351634 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170fac0-4e12-46c1-8400-fe2190883dc4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:34.352076 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170fac0-4e12-46c1-8400-fe2190883dc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:34.354399 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170fac0-4e12-46c1-8400-fe2190883dc4 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:34.367289 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 157/313] 10.222.0.24 () {56 vars in 1101 bytes} [Thu May 19 14:51:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:34.373934 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170fac0-4e12-46c1-8400-fe2190883dc4 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:34.401842 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafae7b-0eb9-4d25-a892-51d15b4097fc None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:34.439338 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:34.447284 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d9a8e-d902-4e1e-86bc-7994a00bd181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:34.447910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d9a8e-d902-4e1e-86bc-7994a00bd181 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:34.448196 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d9a8e-d902-4e1e-86bc-7994a00bd181 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:34.448480 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d9a8e-d902-4e1e-86bc-7994a00bd181 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:34.449822 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d9a8e-d902-4e1e-86bc-7994a00bd181 None admin] RBAC: Adding query filter params (role.id=1e1d2d30ba484c3f80d3cbb6f407a716, user.id=e43ac8f1143c477b84b4c4f8f38135d3, scope.system=all) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:34.449822 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d9a8e-d902-4e1e-86bc-7994a00bd181 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:34.451151 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d9a8e-d902-4e1e-86bc-7994a00bd181 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:34.457343 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 157/314] 10.222.0.24 () {56 vars in 1308 bytes} [Thu May 19 14:51:34 2022] GET /identity/v3/role_assignments?user.id=e43ac8f1143c477b84b4c4f8f38135d3&scope.system=all&role.id=1e1d2d30ba484c3f80d3cbb6f407a716 => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:34.498590 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170fac0-4e12-46c1-8400-fe2190883dc4 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:34.549728 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c90db-6000-4b79-930f-f32e368fe58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:34.550988 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c90db-6000-4b79-930f-f32e368fe58a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:34.551470 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c90db-6000-4b79-930f-f32e368fe58a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:34.551893 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c90db-6000-4b79-930f-f32e368fe58a None admin] PATH_INFO: `/v3/users/1a6ec8276012455c971b6f4eeb7dccf9` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:34.553400 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c90db-6000-4b79-930f-f32e368fe58a None admin] RBAC: Authorizing `identity:get_user(user_id=1a6ec8276012455c971b6f4eeb7dccf9)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:34.555133 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c90db-6000-4b79-930f-f32e368fe58a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:34.564953 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 158/315] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:34 2022] GET /identity/v3/users/1a6ec8276012455c971b6f4eeb7dccf9 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:34.571417 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d9a8e-d902-4e1e-86bc-7994a00bd181 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:34.686838 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d9a8e-d902-4e1e-86bc-7994a00bd181 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:34.698731 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:34.722748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b541a1f-6e2b-4b34-9296-f3fc9717e875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:34.723451 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b541a1f-6e2b-4b34-9296-f3fc9717e875 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:34.723739 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b541a1f-6e2b-4b34-9296-f3fc9717e875 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:34.724016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b541a1f-6e2b-4b34-9296-f3fc9717e875 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:34.793643 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b541a1f-6e2b-4b34-9296-f3fc9717e875 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:34.795033 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b541a1f-6e2b-4b34-9296-f3fc9717e875 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:34.902574 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 158/316] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:51:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:34.904170 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c90db-6000-4b79-930f-f32e368fe58a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:35.008525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c90db-6000-4b79-930f-f32e368fe58a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:35.026384 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:35.044637 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab719d1-2035-4d66-83be-e561d9c6e90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:35.045427 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab719d1-2035-4d66-83be-e561d9c6e90e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:35.045708 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab719d1-2035-4d66-83be-e561d9c6e90e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:35.045981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab719d1-2035-4d66-83be-e561d9c6e90e None admin] PATH_INFO: `/v3/projects/08189b6976bc4ea785ac0de443ab36e3` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:35.047175 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab719d1-2035-4d66-83be-e561d9c6e90e None admin] RBAC: Authorizing `identity:get_project(project_id=08189b6976bc4ea785ac0de443ab36e3)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:35.049283 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab719d1-2035-4d66-83be-e561d9c6e90e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:35.051303 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 159/317] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:34 2022] GET /identity/v3/projects/08189b6976bc4ea785ac0de443ab36e3 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:35.057107 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b541a1f-6e2b-4b34-9296-f3fc9717e875 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:35.076778 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:35.163021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b541a1f-6e2b-4b34-9296-f3fc9717e875 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:35.197590 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917a98d-673e-4119-ae21-c2b3e3340dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:35.198550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917a98d-673e-4119-ae21-c2b3e3340dbe None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:35.199038 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917a98d-673e-4119-ae21-c2b3e3340dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:35.199628 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917a98d-673e-4119-ae21-c2b3e3340dbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:35.200709 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1917a98d-673e-4119-ae21-c2b3e3340dbe None admin] RBAC: Adding query filter params (role.id=1e1d2d30ba484c3f80d3cbb6f407a716, scope.project.id=08189b6976bc4ea785ac0de443ab36e3, user.id=1a6ec8276012455c971b6f4eeb7dccf9) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:35.201226 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1917a98d-673e-4119-ae21-c2b3e3340dbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:35.202995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1917a98d-673e-4119-ae21-c2b3e3340dbe None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:35.215342 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 159/318] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:51:35 2022] GET /identity/v3/role_assignments?user.id=1a6ec8276012455c971b6f4eeb7dccf9&scope.project.id=08189b6976bc4ea785ac0de443ab36e3&role.id=1e1d2d30ba484c3f80d3cbb6f407a716 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:36.509997 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160ed18-6edd-4acf-9d47-f923da81478b None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:36.510522 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160ed18-6edd-4acf-9d47-f923da81478b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:36.510522 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160ed18-6edd-4acf-9d47-f923da81478b None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:36.512116 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 160/319] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:36.517108 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306bf14-eab0-4a28-9da8-9c81c6690063 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:36.517484 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306bf14-eab0-4a28-9da8-9c81c6690063 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:36.517794 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306bf14-eab0-4a28-9da8-9c81c6690063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:36.535180 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9306bf14-eab0-4a28-9da8-9c81c6690063 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:36.536389 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9306bf14-eab0-4a28-9da8-9c81c6690063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:36.577142 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed0e09-6590-4696-bf3f-9df775eb69fe None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:36.577427 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed0e09-6590-4696-bf3f-9df775eb69fe None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:36.577626 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed0e09-6590-4696-bf3f-9df775eb69fe None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:36.579335 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 161/320] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:36.584954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f557e8-5e64-4760-b155-d0458db43db6 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:36.585294 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f557e8-5e64-4760-b155-d0458db43db6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:36.585524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f557e8-5e64-4760-b155-d0458db43db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:36.604747 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-c5f557e8-5e64-4760-b155-d0458db43db6 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:36.605977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c5f557e8-5e64-4760-b155-d0458db43db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:36.611637 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 160/321] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:36.634041 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306bf14-eab0-4a28-9da8-9c81c6690063 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:36.638033 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:36.681791 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 162/322] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:51:36.705300 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f557e8-5e64-4760-b155-d0458db43db6 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:36.742772 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306bf14-eab0-4a28-9da8-9c81c6690063 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:36.778547 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbea74-c4e1-483b-af89-55bf4e6607d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:36.779372 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbea74-c4e1-483b-af89-55bf4e6607d8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:36.779660 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbea74-c4e1-483b-af89-55bf4e6607d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:36.779940 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbea74-c4e1-483b-af89-55bf4e6607d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:36.781082 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abbea74-c4e1-483b-af89-55bf4e6607d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:36.783074 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abbea74-c4e1-483b-af89-55bf4e6607d8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:36.784863 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 161/323] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:51:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:36.790392 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43ec8c-b98f-4cdf-afde-94c91f9c049a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:36.790677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43ec8c-b98f-4cdf-afde-94c91f9c049a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:36.790951 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43ec8c-b98f-4cdf-afde-94c91f9c049a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:36.792238 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 162/324] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:36.792976 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43ec8c-b98f-4cdf-afde-94c91f9c049a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:36.804986 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f557e8-5e64-4760-b155-d0458db43db6 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:36.821148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:36.839397 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477f040-02f3-4059-a185-13a8226f8a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:36.840113 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477f040-02f3-4059-a185-13a8226f8a4c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:36.840387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477f040-02f3-4059-a185-13a8226f8a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:36.840654 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477f040-02f3-4059-a185-13a8226f8a4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:36.851136 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477f040-02f3-4059-a185-13a8226f8a4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:36.858798 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-a477f040-02f3-4059-a185-13a8226f8a4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:36.858798 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:36.858798 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:36.858798 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:36.858798 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:36.858798 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:36.858798 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:36.858798 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:36.858798 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:36.858798 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:36.858798 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:36.858798 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:36.858798 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:36.858798 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:36.858798 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:36.858798 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:36.859691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:36.859691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:36.859691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:36.859691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:36.859691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:36.859691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:36.859691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:36.859691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:36.859691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:36.859691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:36.859691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:36.859691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:51:36.859691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:36.859691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:36.859691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:36.859691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:36.860541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:36.860541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:36.860541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:36.860541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:36.860541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:36.860541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:36.860541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:36.860541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:36.860541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:36.860541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:36.860541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:36.860541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:51:36.860541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 163/325] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:51:36.861627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087fc06-19c9-4182-8af6-75e4854d07ff None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:36.861899 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087fc06-19c9-4182-8af6-75e4854d07ff None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:36.862175 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087fc06-19c9-4182-8af6-75e4854d07ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:36.866763 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:36.878195 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9087fc06-19c9-4182-8af6-75e4854d07ff None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:36.879388 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9087fc06-19c9-4182-8af6-75e4854d07ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:36.897954 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43ec8c-b98f-4cdf-afde-94c91f9c049a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:36.931722 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa81fc1-26a4-4e6e-95e9-27564b5e5f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:36.932386 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa81fc1-26a4-4e6e-95e9-27564b5e5f4a None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:36.932674 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa81fc1-26a4-4e6e-95e9-27564b5e5f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:36.932954 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa81fc1-26a4-4e6e-95e9-27564b5e5f4a None admin] PATH_INFO: `/v3/groups` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:36.933638 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa81fc1-26a4-4e6e-95e9-27564b5e5f4a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:36.935084 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa81fc1-26a4-4e6e-95e9-27564b5e5f4a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:36.945815 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 164/326] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:36.946655 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087fc06-19c9-4182-8af6-75e4854d07ff None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:36.951512 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 163/327] 10.222.0.24 () {60 vars in 1134 bytes} [Thu May 19 14:51:36 2022] POST /identity/v3/groups => generated 226 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:51:36.968999 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa81fc1-26a4-4e6e-95e9-27564b5e5f4a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:37.064145 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087fc06-19c9-4182-8af6-75e4854d07ff None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:37.072505 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:37.087935 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa81fc1-26a4-4e6e-95e9-27564b5e5f4a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:37.103752 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4756f13-2a20-45fb-96f9-2b6494937077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:37.104401 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4756f13-2a20-45fb-96f9-2b6494937077 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:37.104665 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4756f13-2a20-45fb-96f9-2b6494937077 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:37.104880 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4756f13-2a20-45fb-96f9-2b6494937077 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:37.105644 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4756f13-2a20-45fb-96f9-2b6494937077 None admin] RBAC: Adding query filter params (name=member) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:37.105944 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4756f13-2a20-45fb-96f9-2b6494937077 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:37.107380 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4756f13-2a20-45fb-96f9-2b6494937077 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:37.117444 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 165/328] 10.222.0.24 () {56 vars in 1101 bytes} [Thu May 19 14:51:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:37.123099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4756f13-2a20-45fb-96f9-2b6494937077 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:37.125676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:37.132468 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44d577-9fe8-4b03-a04f-8a7772f67c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:37.134147 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44d577-9fe8-4b03-a04f-8a7772f67c37 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:37.135010 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44d577-9fe8-4b03-a04f-8a7772f67c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:37.135325 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44d577-9fe8-4b03-a04f-8a7772f67c37 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:37.150097 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44d577-9fe8-4b03-a04f-8a7772f67c37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:37.158001 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-9d44d577-9fe8-4b03-a04f-8a7772f67c37 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:51:37.158001 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:37.158001 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:37.158001 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:37.158001 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:37.158001 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:37.158001 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:37.158001 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:37.158001 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:37.158001 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:37.158001 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:37.158001 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:37.158001 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:37.158001 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:37.158001 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:37.158001 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:37.159278 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:37.159278 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:37.159278 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:37.159278 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:37.159278 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:37.159278 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:37.159278 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:37.159278 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:37.159278 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:37.159278 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:37.159278 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:37.159278 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:51:37.159278 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:37.159278 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:37.159278 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:37.159278 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:37.160332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:37.160332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:37.160332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:37.160332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:37.160332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:37.160332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:37.160332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:37.160332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:37.160332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:37.160332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:37.160332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:51:37.160332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:51:37.163415 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 164/329] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:51:37.164846 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44d577-9fe8-4b03-a04f-8a7772f67c37 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:37.248972 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4756f13-2a20-45fb-96f9-2b6494937077 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:37.289511 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44d577-9fe8-4b03-a04f-8a7772f67c37 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:37.295646 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afd511-56da-4fb6-aa05-d1b3c9e22bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:37.296538 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afd511-56da-4fb6-aa05-d1b3c9e22bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:37.296823 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afd511-56da-4fb6-aa05-d1b3c9e22bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:37.297102 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afd511-56da-4fb6-aa05-d1b3c9e22bb8 None admin] PATH_INFO: `/v3/users/63d7061f25894fc1be71474abe8be881` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:37.298360 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43afd511-56da-4fb6-aa05-d1b3c9e22bb8 None admin] RBAC: Authorizing `identity:get_user(user_id=63d7061f25894fc1be71474abe8be881)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:37.299863 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43afd511-56da-4fb6-aa05-d1b3c9e22bb8 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:37.301823 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 166/330] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:37 2022] GET /identity/v3/users/63d7061f25894fc1be71474abe8be881 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:37.308347 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afd511-56da-4fb6-aa05-d1b3c9e22bb8 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:37.332256 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fafaf2-707b-4e95-93c6-9323d94e552c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:37.333084 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fafaf2-707b-4e95-93c6-9323d94e552c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:37.333915 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fafaf2-707b-4e95-93c6-9323d94e552c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:37.333915 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fafaf2-707b-4e95-93c6-9323d94e552c None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:37.334702 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fafaf2-707b-4e95-93c6-9323d94e552c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:37.335084 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fafaf2-707b-4e95-93c6-9323d94e552c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:37.336678 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fafaf2-707b-4e95-93c6-9323d94e552c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:37.350125 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 165/331] 10.222.0.24 () {56 vars in 1101 bytes} [Thu May 19 14:51:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:37.351186 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fafaf2-707b-4e95-93c6-9323d94e552c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:37.365856 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:37.430425 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:37.444979 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afd511-56da-4fb6-aa05-d1b3c9e22bb8 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:37.481201 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9853547-448a-4102-9178-e59c1130a64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:37.482697 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9853547-448a-4102-9178-e59c1130a64c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:37.483193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9853547-448a-4102-9178-e59c1130a64c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:37.483715 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9853547-448a-4102-9178-e59c1130a64c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:37.484754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9853547-448a-4102-9178-e59c1130a64c None admin] RBAC: Adding query filter params (role.id=fd5043dc9e3e4ec49e035ee01fc68854, user.id=63d7061f25894fc1be71474abe8be881, scope.system=all) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:37.485309 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9853547-448a-4102-9178-e59c1130a64c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:37.485977 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fafaf2-707b-4e95-93c6-9323d94e552c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:37.487166 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9853547-448a-4102-9178-e59c1130a64c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:37.501634 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 167/332] 10.222.0.24 () {56 vars in 1308 bytes} [Thu May 19 14:51:37 2022] GET /identity/v3/role_assignments?user.id=63d7061f25894fc1be71474abe8be881&scope.system=all&role.id=fd5043dc9e3e4ec49e035ee01fc68854 => generated 510 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:37.527545 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f912e7-aae0-45d0-bc3c-2e7df0f4da7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:37.529211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f912e7-aae0-45d0-bc3c-2e7df0f4da7a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:37.529703 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f912e7-aae0-45d0-bc3c-2e7df0f4da7a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:37.530206 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f912e7-aae0-45d0-bc3c-2e7df0f4da7a None admin] PATH_INFO: `/v3/users/e43ac8f1143c477b84b4c4f8f38135d3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:37.531828 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f912e7-aae0-45d0-bc3c-2e7df0f4da7a None admin] RBAC: Authorizing `identity:get_user(user_id=e43ac8f1143c477b84b4c4f8f38135d3)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:37.534207 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f912e7-aae0-45d0-bc3c-2e7df0f4da7a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:37.536621 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 166/333] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:37 2022] GET /identity/v3/users/e43ac8f1143c477b84b4c4f8f38135d3 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:37.542481 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9853547-448a-4102-9178-e59c1130a64c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:37.650227 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:37.657169 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9853547-448a-4102-9178-e59c1130a64c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:37.695231 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c64f6-3e08-4379-af28-537fabae3750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:37.696124 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c64f6-3e08-4379-af28-537fabae3750 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:37.696408 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c64f6-3e08-4379-af28-537fabae3750 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:37.696690 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c64f6-3e08-4379-af28-537fabae3750 None admin] PATH_INFO: `/v3/system/users/e43ac8f1143c477b84b4c4f8f38135d3/roles/1e1d2d30ba484c3f80d3cbb6f407a716` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:37.698285 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c64f6-3e08-4379-af28-537fabae3750 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e43ac8f1143c477b84b4c4f8f38135d3, role_id=1e1d2d30ba484c3f80d3cbb6f407a716)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:37.699769 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c64f6-3e08-4379-af28-537fabae3750 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:37.715521 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 168/334] 10.222.0.24 () {58 vars in 1334 bytes} [Thu May 19 14:51:37 2022] PUT /identity/v3/system/users/e43ac8f1143c477b84b4c4f8f38135d3/roles/1e1d2d30ba484c3f80d3cbb6f407a716 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:51:40.113594 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36466083-9bec-488d-945b-da7d7a375159 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:40.129819 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36466083-9bec-488d-945b-da7d7a375159 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:40.129819 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36466083-9bec-488d-945b-da7d7a375159 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:40.129819 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 167/335] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:40.130084 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c10e8-b469-468a-bb1a-9bdafd2a3bd5 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:40.130084 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c10e8-b469-468a-bb1a-9bdafd2a3bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:40.130084 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c10e8-b469-468a-bb1a-9bdafd2a3bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:40.144101 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-591c10e8-b469-468a-bb1a-9bdafd2a3bd5 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:40.145305 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-591c10e8-b469-468a-bb1a-9bdafd2a3bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:40.227947 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 169/336] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:40.270052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36466083-9bec-488d-945b-da7d7a375159 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:40.275370 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f3fa5-556c-4589-81f8-3b5f6972348c None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:40.275654 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f3fa5-556c-4589-81f8-3b5f6972348c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:40.275924 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f3fa5-556c-4589-81f8-3b5f6972348c None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:40.277289 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 170/337] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:40.295284 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cb276-a829-470e-a572-42770bcca5f7 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:40.295613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cb276-a829-470e-a572-42770bcca5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:40.295846 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238cb276-a829-470e-a572-42770bcca5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:40.341720 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-238cb276-a829-470e-a572-42770bcca5f7 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:40.342883 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-238cb276-a829-470e-a572-42770bcca5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:40.426264 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36466083-9bec-488d-945b-da7d7a375159 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:40.446826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 171/338] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:40.448551 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0783a98-6fa3-477b-a4c0-c5505d927e87 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:40.449048 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0783a98-6fa3-477b-a4c0-c5505d927e87 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:40.449524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0783a98-6fa3-477b-a4c0-c5505d927e87 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:40.450718 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:40.455677 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 172/339] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:40.457436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6eec27-fb55-4d64-b48a-2ecb88c15f72 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:40.457932 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6eec27-fb55-4d64-b48a-2ecb88c15f72 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:40.458407 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6eec27-fb55-4d64-b48a-2ecb88c15f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:40.463753 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf709002-60cc-49a1-801c-309ff4c4a562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:40.464565 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf709002-60cc-49a1-801c-309ff4c4a562 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:40.465074 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf709002-60cc-49a1-801c-309ff4c4a562 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:40.465527 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf709002-60cc-49a1-801c-309ff4c4a562 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:40.475480 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-8e6eec27-fb55-4d64-b48a-2ecb88c15f72 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:40.476843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf709002-60cc-49a1-801c-309ff4c4a562 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:40.476971 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8e6eec27-fb55-4d64-b48a-2ecb88c15f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:40.487851 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-cf709002-60cc-49a1-801c-309ff4c4a562 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:40.487851 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:40.487851 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:40.487851 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:40.487851 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:40.487851 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:40.487851 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:40.487851 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:40.487851 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:40.487851 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:40.487851 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:40.487851 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:40.487851 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:40.487851 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:40.487851 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:40.487851 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:40.488805 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:40.488805 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:40.488805 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:40.488805 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:40.488805 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:40.488805 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:40.488805 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:40.488805 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:40.488805 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:40.488805 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:40.488805 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:40.488805 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:51:40.488805 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:40.488805 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:40.488805 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:40.488805 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:40.489622 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:40.489622 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:40.489622 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:40.489622 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:40.489622 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:40.489622 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:40.489622 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:40.489622 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:40.489622 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:40.489622 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:40.489622 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:40.489622 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:51:40.492337 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 168/340] 10.222.0.24 () {56 vars in 1114 bytes} [Thu May 19 14:51:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:40.493316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf709002-60cc-49a1-801c-309ff4c4a562 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:40.514393 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:40.559349 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 173/341] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:51:40.560679 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6eec27-fb55-4d64-b48a-2ecb88c15f72 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:40.616874 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf709002-60cc-49a1-801c-309ff4c4a562 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:40.658627 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36996931-04b7-4d1e-8e9f-487eaef25d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:40.659714 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36996931-04b7-4d1e-8e9f-487eaef25d65 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:40.660159 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36996931-04b7-4d1e-8e9f-487eaef25d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:40.660592 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36996931-04b7-4d1e-8e9f-487eaef25d65 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:40.679295 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36996931-04b7-4d1e-8e9f-487eaef25d65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:40.683598 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-36996931-04b7-4d1e-8e9f-487eaef25d65 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:40.683598 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:40.683598 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:40.683598 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:40.683598 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:40.683598 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:40.683598 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:40.683598 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:40.683598 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:40.683598 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:40.683598 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:40.683598 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:40.683598 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:40.683598 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:40.683598 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:40.683598 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:40.684667 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:40.684667 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:40.684667 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:40.684667 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:40.684667 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:40.684667 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:40.684667 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:40.684667 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:40.684667 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:40.684667 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:40.684667 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:40.684667 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:51:40.684667 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:40.684667 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:40.684667 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:40.684667 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:40.685487 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:40.685487 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:40.685487 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:40.685487 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:40.685487 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:40.685487 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:40.685487 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:40.685487 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:40.685487 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:40.685487 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:40.685487 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:40.685487 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:51:40.685487 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 169/342] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:40.686328 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6623ef7-862d-4412-ae3e-c10d715a6c89 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:40.686771 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6623ef7-862d-4412-ae3e-c10d715a6c89 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:40.691618 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6623ef7-862d-4412-ae3e-c10d715a6c89 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:40.693120 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 170/343] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:40.693717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6623ef7-862d-4412-ae3e-c10d715a6c89 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:40.708131 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6eec27-fb55-4d64-b48a-2ecb88c15f72 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:40.757792 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6778709-c0ec-4fff-9eea-ff1cea6f1cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:40.759028 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6778709-c0ec-4fff-9eea-ff1cea6f1cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:40.759540 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6778709-c0ec-4fff-9eea-ff1cea6f1cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:40.759978 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6778709-c0ec-4fff-9eea-ff1cea6f1cd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:40.761353 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6778709-c0ec-4fff-9eea-ff1cea6f1cd8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:40.761811 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6778709-c0ec-4fff-9eea-ff1cea6f1cd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:40.762682 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:40.765342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6778709-c0ec-4fff-9eea-ff1cea6f1cd8 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:40.782584 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 174/344] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:51:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:40.782584 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6778709-c0ec-4fff-9eea-ff1cea6f1cd8 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:40.819544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:40.852043 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6623ef7-862d-4412-ae3e-c10d715a6c89 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:40.895770 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4d10a-8c61-4130-a2a2-9941ee2061d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:40.896640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4d10a-8c61-4130-a2a2-9941ee2061d7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:40.896931 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4d10a-8c61-4130-a2a2-9941ee2061d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:40.897258 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4d10a-8c61-4130-a2a2-9941ee2061d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:40.907400 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6778709-c0ec-4fff-9eea-ff1cea6f1cd8 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:40.911152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4d10a-8c61-4130-a2a2-9941ee2061d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:40.919659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-dde4d10a-8c61-4130-a2a2-9941ee2061d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:40.919659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:40.919659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:40.919659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:40.919659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:40.919659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:40.919659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:40.919659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:40.919659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:40.919659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:40.919659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:40.919659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:40.919659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:40.919659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:40.919659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:40.919659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:40.920635 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:40.920635 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:40.920635 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:40.920635 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:40.920635 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:40.920635 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:40.920635 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:40.920635 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:40.920635 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:40.920635 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:40.920635 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:40.920635 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:51:40.920635 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:40.920635 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:40.920635 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:40.920635 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:40.921472 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:40.921472 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:40.921472 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:40.921472 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:40.921472 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:40.921472 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:40.921472 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:40.921472 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:40.921472 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:40.921472 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:40.921472 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:40.921472 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:51:40.923716 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 171/345] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:40.925166 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70ab22-abe3-4f78-9fcb-048f3ff87f8b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:40.925611 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70ab22-abe3-4f78-9fcb-048f3ff87f8b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:40.926078 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70ab22-abe3-4f78-9fcb-048f3ff87f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:40.945440 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2e70ab22-abe3-4f78-9fcb-048f3ff87f8b None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:40.946974 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2e70ab22-abe3-4f78-9fcb-048f3ff87f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:40.949697 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23e20f-7bcc-44fe-add7-b6ca2e1db12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:40.950396 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23e20f-7bcc-44fe-add7-b6ca2e1db12e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:40.950686 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23e20f-7bcc-44fe-add7-b6ca2e1db12e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:40.950967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23e20f-7bcc-44fe-add7-b6ca2e1db12e None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:40.951773 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f23e20f-7bcc-44fe-add7-b6ca2e1db12e None admin] RBAC: Adding query filter params (name=member) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:40.952084 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f23e20f-7bcc-44fe-add7-b6ca2e1db12e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:40.953959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f23e20f-7bcc-44fe-add7-b6ca2e1db12e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:40.964017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 175/346] 10.222.0.24 () {56 vars in 1101 bytes} [Thu May 19 14:51:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:40.964866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23e20f-7bcc-44fe-add7-b6ca2e1db12e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:41.030126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 172/347] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:41.031363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70ab22-abe3-4f78-9fcb-048f3ff87f8b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:41.039742 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:41.067252 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:41.073217 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23e20f-7bcc-44fe-add7-b6ca2e1db12e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:41.110816 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f70488-d7a1-42c6-9812-8706c63344e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:41.110816 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f70488-d7a1-42c6-9812-8706c63344e4 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:41.110816 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f70488-d7a1-42c6-9812-8706c63344e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:41.110816 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f70488-d7a1-42c6-9812-8706c63344e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:41.147314 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70ab22-abe3-4f78-9fcb-048f3ff87f8b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:41.185096 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f70488-d7a1-42c6-9812-8706c63344e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:41.186568 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f70488-d7a1-42c6-9812-8706c63344e4 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:41.188096 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091d7fe-e6b0-4d1a-a379-f2bfe3592779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:41.189485 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091d7fe-e6b0-4d1a-a379-f2bfe3592779 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:41.189915 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091d7fe-e6b0-4d1a-a379-f2bfe3592779 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:41.190453 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091d7fe-e6b0-4d1a-a379-f2bfe3592779 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:41.191534 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091d7fe-e6b0-4d1a-a379-f2bfe3592779 None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:41.191990 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091d7fe-e6b0-4d1a-a379-f2bfe3592779 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:41.193539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091d7fe-e6b0-4d1a-a379-f2bfe3592779 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:41.204002 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 173/348] 10.222.0.24 () {56 vars in 1101 bytes} [Thu May 19 14:51:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:41.205194 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091d7fe-e6b0-4d1a-a379-f2bfe3592779 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:41.260967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:41.294497 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 176/349] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:51:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:41.295384 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f70488-d7a1-42c6-9812-8706c63344e4 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:41.311501 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:41.327761 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091d7fe-e6b0-4d1a-a379-f2bfe3592779 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:41.366563 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc2cf9-ee2e-4522-ac84-692a8bb127d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:41.367608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc2cf9-ee2e-4522-ac84-692a8bb127d9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:41.368056 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc2cf9-ee2e-4522-ac84-692a8bb127d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:41.368477 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc2cf9-ee2e-4522-ac84-692a8bb127d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:41.415664 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f70488-d7a1-42c6-9812-8706c63344e4 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:41.460343 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d994a7b-8563-4ab8-84a5-480eb76dac35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:41.461265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d994a7b-8563-4ab8-84a5-480eb76dac35 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:41.461551 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d994a7b-8563-4ab8-84a5-480eb76dac35 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:41.461830 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d994a7b-8563-4ab8-84a5-480eb76dac35 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:41.464794 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc2cf9-ee2e-4522-ac84-692a8bb127d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:41.466447 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc2cf9-ee2e-4522-ac84-692a8bb127d9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:41.475624 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d994a7b-8563-4ab8-84a5-480eb76dac35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:41.486644 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-9d994a7b-8563-4ab8-84a5-480eb76dac35 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:51:41.486644 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:41.486644 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:41.486644 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:41.486644 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:41.486644 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:41.486644 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:41.486644 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:41.486644 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:41.486644 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:41.486644 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:41.486644 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:41.486644 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:41.486644 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:41.486644 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:41.486644 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:41.487604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:41.487604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:41.487604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:41.487604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:41.487604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:41.487604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:41.487604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:41.487604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:41.487604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:41.487604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:41.487604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:41.487604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:51:41.487604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:41.487604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:41.487604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:41.487604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:41.488377 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:41.488377 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:41.488377 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:41.488377 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:41.488377 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:41.488377 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:41.488377 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:41.488377 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:41.488377 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:41.488377 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:41.488377 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 19 14:51:41.488377 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:51:41.488377 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 177/350] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:41.489025 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d994a7b-8563-4ab8-84a5-480eb76dac35 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:41.530606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:41.583041 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:41.593112 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 174/351] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:51:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:41.594165 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc2cf9-ee2e-4522-ac84-692a8bb127d9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:41.631416 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d994a7b-8563-4ab8-84a5-480eb76dac35 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:41.678354 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1c7dd-e352-4883-920c-c7fff020334f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:41.679125 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1c7dd-e352-4883-920c-c7fff020334f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:41.679517 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1c7dd-e352-4883-920c-c7fff020334f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:41.679878 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1c7dd-e352-4883-920c-c7fff020334f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:41.723297 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc2cf9-ee2e-4522-ac84-692a8bb127d9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:41.762260 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8521a-1402-4613-a353-30ff225a238d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:41.763797 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8521a-1402-4613-a353-30ff225a238d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:41.764025 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1c7dd-e352-4883-920c-c7fff020334f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:41.764500 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8521a-1402-4613-a353-30ff225a238d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:41.764982 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8521a-1402-4613-a353-30ff225a238d None admin] PATH_INFO: `/v3/projects/824de15367424616b3588eca8e09020e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:41.765505 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1c7dd-e352-4883-920c-c7fff020334f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:41.766702 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8521a-1402-4613-a353-30ff225a238d None admin] RBAC: Authorizing `identity:get_project(project_id=824de15367424616b3588eca8e09020e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:41.769724 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8521a-1402-4613-a353-30ff225a238d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:41.771805 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 175/352] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:41 2022] GET /identity/v3/projects/824de15367424616b3588eca8e09020e => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:41.772798 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8521a-1402-4613-a353-30ff225a238d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:41.808878 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:41.862978 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:41.898398 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 178/353] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:51:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:41.899707 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1c7dd-e352-4883-920c-c7fff020334f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:41.911449 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8521a-1402-4613-a353-30ff225a238d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:41.956684 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c39e1a-da83-4093-8b42-a3a316cf2b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:41.957365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c39e1a-da83-4093-8b42-a3a316cf2b7e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:41.957654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c39e1a-da83-4093-8b42-a3a316cf2b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:41.957942 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c39e1a-da83-4093-8b42-a3a316cf2b7e None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:41.958701 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c39e1a-da83-4093-8b42-a3a316cf2b7e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:41.959017 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c39e1a-da83-4093-8b42-a3a316cf2b7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:41.960440 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c39e1a-da83-4093-8b42-a3a316cf2b7e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:41.969084 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 176/354] 10.222.0.24 () {56 vars in 1101 bytes} [Thu May 19 14:51:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:41.970965 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475ed77-d640-4775-bbe4-c71b31d0db6f None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:41.971298 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475ed77-d640-4775-bbe4-c71b31d0db6f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:41.971569 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475ed77-d640-4775-bbe4-c71b31d0db6f None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:41.972958 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 177/355] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:41.973570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475ed77-d640-4775-bbe4-c71b31d0db6f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:42.017489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1c7dd-e352-4883-920c-c7fff020334f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:42.057041 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:42.064571 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf234a88-48fd-4d03-b6b0-945a7a96dd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:42.065573 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf234a88-48fd-4d03-b6b0-945a7a96dd9d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:42.065867 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf234a88-48fd-4d03-b6b0-945a7a96dd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:42.066150 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf234a88-48fd-4d03-b6b0-945a7a96dd9d None admin] PATH_INFO: `/v3/projects/824de15367424616b3588eca8e09020e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:42.067624 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf234a88-48fd-4d03-b6b0-945a7a96dd9d None admin] RBAC: Authorizing `identity:get_project(project_id=824de15367424616b3588eca8e09020e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:42.069094 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf234a88-48fd-4d03-b6b0-945a7a96dd9d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:42.070985 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 179/356] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:41 2022] GET /identity/v3/projects/824de15367424616b3588eca8e09020e => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:42.076678 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5a675-9200-48f3-a561-5044a9747094 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:42.076968 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5a675-9200-48f3-a561-5044a9747094 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:42.077249 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5a675-9200-48f3-a561-5044a9747094 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:42.078711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 180/357] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:42.079844 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5a675-9200-48f3-a561-5044a9747094 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:42.112790 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475ed77-d640-4775-bbe4-c71b31d0db6f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:42.137753 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:42.152759 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55faeeda-be12-479b-91a3-4b03cd9fa502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:42.153622 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55faeeda-be12-479b-91a3-4b03cd9fa502 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:42.153910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55faeeda-be12-479b-91a3-4b03cd9fa502 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:42.154188 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55faeeda-be12-479b-91a3-4b03cd9fa502 None admin] PATH_INFO: `/v3/groups/390a56587cdb46cf9ed3442404df3b19` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:42.161132 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55faeeda-be12-479b-91a3-4b03cd9fa502 None admin] RBAC: Authorizing `identity:get_group(group_id=390a56587cdb46cf9ed3442404df3b19)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:42.163227 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55faeeda-be12-479b-91a3-4b03cd9fa502 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:42.165301 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 178/358] 10.222.0.24 () {56 vars in 1180 bytes} [Thu May 19 14:51:41 2022] GET /identity/v3/groups/390a56587cdb46cf9ed3442404df3b19 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:42.166271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55faeeda-be12-479b-91a3-4b03cd9fa502 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:42.197719 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5a675-9200-48f3-a561-5044a9747094 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:42.241293 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c2ea3-dd35-4e05-bad2-bb43d942d0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:42.242270 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c2ea3-dd35-4e05-bad2-bb43d942d0d9 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:42.242600 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c2ea3-dd35-4e05-bad2-bb43d942d0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:42.243025 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c2ea3-dd35-4e05-bad2-bb43d942d0d9 None admin] PATH_INFO: `/v3/projects/08189b6976bc4ea785ac0de443ab36e3` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:42.245263 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c2ea3-dd35-4e05-bad2-bb43d942d0d9 None admin] RBAC: Authorizing `identity:get_project(project_id=08189b6976bc4ea785ac0de443ab36e3)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:42.246950 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c2ea3-dd35-4e05-bad2-bb43d942d0d9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:42.248886 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 181/359] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:42 2022] GET /identity/v3/projects/08189b6976bc4ea785ac0de443ab36e3 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:42.250450 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b138c1a-00d3-43fd-ab6e-8d599080f82e None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:42.251354 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b138c1a-00d3-43fd-ab6e-8d599080f82e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:42.251981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b138c1a-00d3-43fd-ab6e-8d599080f82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:42.272455 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-8b138c1a-00d3-43fd-ab6e-8d599080f82e None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:42.273873 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8b138c1a-00d3-43fd-ab6e-8d599080f82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:42.279476 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55faeeda-be12-479b-91a3-4b03cd9fa502 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:42.329460 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83833a44-d4f2-4492-ade9-e8b6d91bf79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:42.330379 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83833a44-d4f2-4492-ade9-e8b6d91bf79f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:42.330664 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83833a44-d4f2-4492-ade9-e8b6d91bf79f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:42.330942 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83833a44-d4f2-4492-ade9-e8b6d91bf79f None admin] PATH_INFO: `/v3/users/e43ac8f1143c477b84b4c4f8f38135d3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:42.332230 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83833a44-d4f2-4492-ade9-e8b6d91bf79f None admin] RBAC: Authorizing `identity:get_user(user_id=e43ac8f1143c477b84b4c4f8f38135d3)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:42.333694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83833a44-d4f2-4492-ade9-e8b6d91bf79f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:42.335542 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 179/360] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:51:42 2022] GET /identity/v3/users/e43ac8f1143c477b84b4c4f8f38135d3 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:42.336153 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83833a44-d4f2-4492-ade9-e8b6d91bf79f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:42.346067 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:42.353432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 182/361] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:42.354663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6194169-9efc-4631-8969-2b9c6cfd374c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:42.354941 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6194169-9efc-4631-8969-2b9c6cfd374c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:42.355245 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6194169-9efc-4631-8969-2b9c6cfd374c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:42.373511 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b6194169-9efc-4631-8969-2b9c6cfd374c None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:42.374689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b6194169-9efc-4631-8969-2b9c6cfd374c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:42.408898 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:42.456254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 183/362] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:42.457232 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83833a44-d4f2-4492-ade9-e8b6d91bf79f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:42.458153 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6194169-9efc-4631-8969-2b9c6cfd374c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:42.498365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981fd4a-c33e-4228-9583-b7c446295bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:42.498563 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981fd4a-c33e-4228-9583-b7c446295bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:42.498761 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981fd4a-c33e-4228-9583-b7c446295bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:42.499041 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981fd4a-c33e-4228-9583-b7c446295bf1 None admin] PATH_INFO: `/v3/groups/390a56587cdb46cf9ed3442404df3b19` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:42.501372 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981fd4a-c33e-4228-9583-b7c446295bf1 None admin] RBAC: Authorizing `identity:get_group(group_id=390a56587cdb46cf9ed3442404df3b19)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:42.502847 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981fd4a-c33e-4228-9583-b7c446295bf1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:42.504698 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 180/363] 10.222.0.24 () {56 vars in 1180 bytes} [Thu May 19 14:51:42 2022] GET /identity/v3/groups/390a56587cdb46cf9ed3442404df3b19 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:42.505644 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981fd4a-c33e-4228-9583-b7c446295bf1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:42.573711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6194169-9efc-4631-8969-2b9c6cfd374c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:42.608287 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:42.619928 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981fd4a-c33e-4228-9583-b7c446295bf1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:42.621611 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57b887-66b4-4035-82a0-2f1d3c8df173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:42.622286 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57b887-66b4-4035-82a0-2f1d3c8df173 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:42.622581 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57b887-66b4-4035-82a0-2f1d3c8df173 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:42.622850 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57b887-66b4-4035-82a0-2f1d3c8df173 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:42.623731 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57b887-66b4-4035-82a0-2f1d3c8df173 None admin] RBAC: Adding query filter params (group.id=390a56587cdb46cf9ed3442404df3b19, role.id=9d41dc09d0f646b1994526fcbd8d3622, scope.project.id=824de15367424616b3588eca8e09020e) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:42.624047 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57b887-66b4-4035-82a0-2f1d3c8df173 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:42.625510 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57b887-66b4-4035-82a0-2f1d3c8df173 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:42.633609 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 184/364] 10.222.0.24 () {56 vars in 1376 bytes} [Thu May 19 14:51:42 2022] GET /identity/v3/role_assignments?group.id=390a56587cdb46cf9ed3442404df3b19&scope.project.id=824de15367424616b3588eca8e09020e&role.id=9d41dc09d0f646b1994526fcbd8d3622 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:42.635017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57b887-66b4-4035-82a0-2f1d3c8df173 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:42.650648 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:42.668625 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d7e98-f124-45d8-9658-df428ffc9354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:42.669980 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d7e98-f124-45d8-9658-df428ffc9354 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:42.670548 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d7e98-f124-45d8-9658-df428ffc9354 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:42.671665 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d7e98-f124-45d8-9658-df428ffc9354 None admin] PATH_INFO: `/v3/groups/390a56587cdb46cf9ed3442404df3b19` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:42.673751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d7e98-f124-45d8-9658-df428ffc9354 None admin] RBAC: Authorizing `identity:get_group(group_id=390a56587cdb46cf9ed3442404df3b19)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:42.676391 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d7e98-f124-45d8-9658-df428ffc9354 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:42.677033 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 181/365] 10.222.0.24 () {56 vars in 1180 bytes} [Thu May 19 14:51:42 2022] GET /identity/v3/groups/390a56587cdb46cf9ed3442404df3b19 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:42.677839 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d7e98-f124-45d8-9658-df428ffc9354 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:42.772245 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57b887-66b4-4035-82a0-2f1d3c8df173 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:42.820375 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d7e98-f124-45d8-9658-df428ffc9354 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:42.823349 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ee473-6d86-497b-8700-12d7d4c75bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:42.824995 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ee473-6d86-497b-8700-12d7d4c75bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:42.825279 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ee473-6d86-497b-8700-12d7d4c75bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:42.825551 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ee473-6d86-497b-8700-12d7d4c75bd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:42.826394 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ee473-6d86-497b-8700-12d7d4c75bd1 None admin] RBAC: Adding query filter params (role.id=1e1d2d30ba484c3f80d3cbb6f407a716, user.id=e43ac8f1143c477b84b4c4f8f38135d3, scope.system=all) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:42.826697 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ee473-6d86-497b-8700-12d7d4c75bd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:42.828239 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ee473-6d86-497b-8700-12d7d4c75bd1 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:42.842141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 185/366] 10.222.0.24 () {56 vars in 1308 bytes} [Thu May 19 14:51:42 2022] GET /identity/v3/role_assignments?user.id=e43ac8f1143c477b84b4c4f8f38135d3&scope.system=all&role.id=1e1d2d30ba484c3f80d3cbb6f407a716 => generated 510 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:42.843089 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ee473-6d86-497b-8700-12d7d4c75bd1 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:42.884356 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac41240-b399-47b7-999e-013770fc4e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:42.885433 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac41240-b399-47b7-999e-013770fc4e2a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:42.885733 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac41240-b399-47b7-999e-013770fc4e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:42.886016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac41240-b399-47b7-999e-013770fc4e2a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:42.903547 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac41240-b399-47b7-999e-013770fc4e2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:42.905821 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:42.914854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-fac41240-b399-47b7-999e-013770fc4e2a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:42.914854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:42.914854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:42.914854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:42.914854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:42.914854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:42.914854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:42.914854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:42.914854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:42.914854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:42.914854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:42.914854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:42.914854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:42.914854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:42.914854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:42.914854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:42.915941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:42.915941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:42.915941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:42.915941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:42.915941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:42.915941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:42.915941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:42.915941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:42.915941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:42.915941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:42.915941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:42.915941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:51:42.915941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:42.915941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:42.915941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:42.915941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:42.916791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:42.916791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:42.916791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:42.916791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:42.916791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:42.916791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:42.916791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:42.916791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:42.916791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:42.916791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:42.916791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:42.916791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:51:42.916791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 182/367] 10.222.0.24 () {56 vars in 1114 bytes} [Thu May 19 14:51:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:42.917500 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac41240-b399-47b7-999e-013770fc4e2a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:42.964272 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ee473-6d86-497b-8700-12d7d4c75bd1 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:42.987166 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:43.003915 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773be82-9547-42c8-9758-ac1be1a3dc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:43.004903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773be82-9547-42c8-9758-ac1be1a3dc30 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:43.005293 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773be82-9547-42c8-9758-ac1be1a3dc30 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:43.005573 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773be82-9547-42c8-9758-ac1be1a3dc30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:43.019006 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773be82-9547-42c8-9758-ac1be1a3dc30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:43.028653 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-3773be82-9547-42c8-9758-ac1be1a3dc30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:43.028653 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:43.028653 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:43.028653 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:43.028653 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:43.028653 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:43.028653 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:43.028653 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:43.028653 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:43.028653 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:43.028653 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:43.028653 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:43.028653 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:43.028653 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:43.028653 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:43.028653 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:43.030778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:43.030778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:43.030778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:43.030778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:43.030778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:43.030778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:43.030778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:43.030778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:43.030778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:43.030778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:43.030778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:43.030778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:51:43.030778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:43.030778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:43.030778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:43.030778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:43.033415 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:43.033415 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:43.033415 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:43.033415 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:43.033415 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:43.033415 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:43.033415 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:43.033415 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:43.033415 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:43.033415 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:43.033415 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:43.033415 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:51:43.033415 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 186/368] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:51:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:43.033415 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773be82-9547-42c8-9758-ac1be1a3dc30 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:43.044800 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac41240-b399-47b7-999e-013770fc4e2a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:43.083502 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f96ee-fd4b-409c-a38e-ccf6992fbc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:43.084504 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f96ee-fd4b-409c-a38e-ccf6992fbc13 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:43.084802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f96ee-fd4b-409c-a38e-ccf6992fbc13 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:43.085091 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f96ee-fd4b-409c-a38e-ccf6992fbc13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:43.085940 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f96ee-fd4b-409c-a38e-ccf6992fbc13 None admin] RBAC: Adding query filter params (group.id=390a56587cdb46cf9ed3442404df3b19, role.id=fd5043dc9e3e4ec49e035ee01fc68854, scope.project.id=824de15367424616b3588eca8e09020e) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:43.086259 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f96ee-fd4b-409c-a38e-ccf6992fbc13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:43.088830 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f96ee-fd4b-409c-a38e-ccf6992fbc13 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:43.096133 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 183/369] 10.222.0.24 () {56 vars in 1376 bytes} [Thu May 19 14:51:42 2022] GET /identity/v3/role_assignments?group.id=390a56587cdb46cf9ed3442404df3b19&scope.project.id=824de15367424616b3588eca8e09020e&role.id=fd5043dc9e3e4ec49e035ee01fc68854 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:43.097798 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f96ee-fd4b-409c-a38e-ccf6992fbc13 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:43.173777 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773be82-9547-42c8-9758-ac1be1a3dc30 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:43.188906 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:43.227481 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4eaac-02e8-4d09-af56-7903287cec7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:43.228223 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4eaac-02e8-4d09-af56-7903287cec7d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:43.228398 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4eaac-02e8-4d09-af56-7903287cec7d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:43.231223 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4eaac-02e8-4d09-af56-7903287cec7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:43.231223 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b4eaac-02e8-4d09-af56-7903287cec7d None admin] RBAC: Adding query filter params (group.id=390a56587cdb46cf9ed3442404df3b19, role.id=fd5043dc9e3e4ec49e035ee01fc68854, scope.project.id=08189b6976bc4ea785ac0de443ab36e3) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:43.231223 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b4eaac-02e8-4d09-af56-7903287cec7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:43.231661 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b4eaac-02e8-4d09-af56-7903287cec7d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:43.244004 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 187/370] 10.222.0.24 () {56 vars in 1376 bytes} [Thu May 19 14:51:43 2022] GET /identity/v3/role_assignments?group.id=390a56587cdb46cf9ed3442404df3b19&scope.project.id=08189b6976bc4ea785ac0de443ab36e3&role.id=fd5043dc9e3e4ec49e035ee01fc68854 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:43.244989 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4eaac-02e8-4d09-af56-7903287cec7d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:43.269362 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f96ee-fd4b-409c-a38e-ccf6992fbc13 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:43.304671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:43.366602 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d9348-aff6-4ed6-89f8-c6aff03334ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:43.367502 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d9348-aff6-4ed6-89f8-c6aff03334ae None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:43.367795 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d9348-aff6-4ed6-89f8-c6aff03334ae None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:43.368084 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d9348-aff6-4ed6-89f8-c6aff03334ae None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:43.370882 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d9348-aff6-4ed6-89f8-c6aff03334ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:43.370882 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d9348-aff6-4ed6-89f8-c6aff03334ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:43.371080 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d9348-aff6-4ed6-89f8-c6aff03334ae None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:43.380891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4eaac-02e8-4d09-af56-7903287cec7d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:43.381614 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 184/371] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:51:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:43.392971 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d9348-aff6-4ed6-89f8-c6aff03334ae None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:43.428936 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be3949-e122-4e90-9187-a5cdf86cfe86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:43.430091 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be3949-e122-4e90-9187-a5cdf86cfe86 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:43.430653 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be3949-e122-4e90-9187-a5cdf86cfe86 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:43.431134 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be3949-e122-4e90-9187-a5cdf86cfe86 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:43.432142 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be3949-e122-4e90-9187-a5cdf86cfe86 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:43.432731 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be3949-e122-4e90-9187-a5cdf86cfe86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:43.434403 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be3949-e122-4e90-9187-a5cdf86cfe86 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:43.453268 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 188/372] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:43.460075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be3949-e122-4e90-9187-a5cdf86cfe86 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:43.533761 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:43.588911 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d9348-aff6-4ed6-89f8-c6aff03334ae None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:43.658625 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3b0b9-feab-4765-bf9e-b1081c61d1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:43.659759 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3b0b9-feab-4765-bf9e-b1081c61d1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:43.660591 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3b0b9-feab-4765-bf9e-b1081c61d1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:43.661088 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3b0b9-feab-4765-bf9e-b1081c61d1a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:43.664607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be3949-e122-4e90-9187-a5cdf86cfe86 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:43.738101 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb929ff-ee8b-4126-a9fa-aee68e246391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:43.739344 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb929ff-ee8b-4126-a9fa-aee68e246391 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:43.740905 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb929ff-ee8b-4126-a9fa-aee68e246391 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:43.741491 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb929ff-ee8b-4126-a9fa-aee68e246391 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:43.749724 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:43.793259 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3b0b9-feab-4765-bf9e-b1081c61d1a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:43.794743 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3b0b9-feab-4765-bf9e-b1081c61d1a5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:43.877547 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb929ff-ee8b-4126-a9fa-aee68e246391 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:43.878927 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb929ff-ee8b-4126-a9fa-aee68e246391 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:43.957138 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:43.963616 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 185/373] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:51:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:43.970203 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3b0b9-feab-4765-bf9e-b1081c61d1a5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:44.077631 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 189/374] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:51:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:44.083922 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb929ff-ee8b-4126-a9fa-aee68e246391 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:44.146708 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:44.195131 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3b0b9-feab-4765-bf9e-b1081c61d1a5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:44.204897 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb929ff-ee8b-4126-a9fa-aee68e246391 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:44.241305 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b513f8-5849-44d2-8786-d0c756ad7347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:44.242165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b513f8-5849-44d2-8786-d0c756ad7347 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:44.242450 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b513f8-5849-44d2-8786-d0c756ad7347 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:44.242728 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b513f8-5849-44d2-8786-d0c756ad7347 None admin] PATH_INFO: `/v3/projects/55b46daee5c44a5cacdc54e48d280e5e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:44.243973 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b513f8-5849-44d2-8786-d0c756ad7347 None admin] RBAC: Authorizing `identity:get_project(project_id=55b46daee5c44a5cacdc54e48d280e5e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:44.245433 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b513f8-5849-44d2-8786-d0c756ad7347 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:44.247831 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 190/375] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:44 2022] GET /identity/v3/projects/55b46daee5c44a5cacdc54e48d280e5e => generated 344 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:44.253658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b513f8-5849-44d2-8786-d0c756ad7347 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:44.257347 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:44.265487 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8087a50-df3d-4cbe-9848-596a4606a374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:44.266392 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8087a50-df3d-4cbe-9848-596a4606a374 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:44.266708 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8087a50-df3d-4cbe-9848-596a4606a374 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:44.267133 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8087a50-df3d-4cbe-9848-596a4606a374 None admin] PATH_INFO: `/v3/projects/08189b6976bc4ea785ac0de443ab36e3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:44.271930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8087a50-df3d-4cbe-9848-596a4606a374 None admin] RBAC: Authorizing `identity:get_project(project_id=08189b6976bc4ea785ac0de443ab36e3)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:44.273408 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8087a50-df3d-4cbe-9848-596a4606a374 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:44.275471 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 186/376] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:43 2022] GET /identity/v3/projects/08189b6976bc4ea785ac0de443ab36e3 => generated 302 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:44.281055 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8087a50-df3d-4cbe-9848-596a4606a374 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:44.358132 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b513f8-5849-44d2-8786-d0c756ad7347 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:44.394307 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d86f3-40b6-4bbe-8416-91636518df85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:44.395185 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d86f3-40b6-4bbe-8416-91636518df85 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:44.395499 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d86f3-40b6-4bbe-8416-91636518df85 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:44.395773 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d86f3-40b6-4bbe-8416-91636518df85 None admin] PATH_INFO: `/v3/groups/2c29375965884354a2b22d67b5eddad0` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:44.401869 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d86f3-40b6-4bbe-8416-91636518df85 None admin] RBAC: Authorizing `identity:get_group(group_id=2c29375965884354a2b22d67b5eddad0)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:44.403594 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d86f3-40b6-4bbe-8416-91636518df85 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:44.405743 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 191/377] 10.222.0.24 () {56 vars in 1180 bytes} [Thu May 19 14:51:44 2022] GET /identity/v3/groups/2c29375965884354a2b22d67b5eddad0 => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:44.416619 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d86f3-40b6-4bbe-8416-91636518df85 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:44.486815 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8087a50-df3d-4cbe-9848-596a4606a374 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:44.487551 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:44.525441 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d86f3-40b6-4bbe-8416-91636518df85 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:44.563475 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084852e-4364-486b-9c02-8495499ed828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:44.564499 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084852e-4364-486b-9c02-8495499ed828 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:44.565085 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084852e-4364-486b-9c02-8495499ed828 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:44.565510 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084852e-4364-486b-9c02-8495499ed828 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:44.566739 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084852e-4364-486b-9c02-8495499ed828 None admin] RBAC: Adding query filter params (group.id=2c29375965884354a2b22d67b5eddad0, role.id=ec4b73b709ca4cdc983e35e955aed57a, scope.project.id=55b46daee5c44a5cacdc54e48d280e5e) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:44.567217 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084852e-4364-486b-9c02-8495499ed828 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:44.569260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084852e-4364-486b-9c02-8495499ed828 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:44.575912 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 192/378] 10.222.0.24 () {56 vars in 1376 bytes} [Thu May 19 14:51:44 2022] GET /identity/v3/role_assignments?group.id=2c29375965884354a2b22d67b5eddad0&scope.project.id=55b46daee5c44a5cacdc54e48d280e5e&role.id=ec4b73b709ca4cdc983e35e955aed57a => generated 260 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:44.604023 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937f076-c891-4c4f-bd72-44815e1e8081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:44.605081 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937f076-c891-4c4f-bd72-44815e1e8081 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:44.605367 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937f076-c891-4c4f-bd72-44815e1e8081 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:44.605640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937f076-c891-4c4f-bd72-44815e1e8081 None admin] PATH_INFO: `/v3/groups/390a56587cdb46cf9ed3442404df3b19` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:44.606951 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937f076-c891-4c4f-bd72-44815e1e8081 None admin] RBAC: Authorizing `identity:get_group(group_id=390a56587cdb46cf9ed3442404df3b19)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:44.608469 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937f076-c891-4c4f-bd72-44815e1e8081 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:44.613541 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 187/379] 10.222.0.24 () {56 vars in 1180 bytes} [Thu May 19 14:51:44 2022] GET /identity/v3/groups/390a56587cdb46cf9ed3442404df3b19 => generated 226 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:44.620230 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084852e-4364-486b-9c02-8495499ed828 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:44.774475 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084852e-4364-486b-9c02-8495499ed828 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:44.817167 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:44.818156 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f14eb-93ff-4727-a624-87e1453b5ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:44.818730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f14eb-93ff-4727-a624-87e1453b5ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:44.819064 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f14eb-93ff-4727-a624-87e1453b5ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:44.819382 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f14eb-93ff-4727-a624-87e1453b5ef8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:44.820728 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f14eb-93ff-4727-a624-87e1453b5ef8 None admin] RBAC: Adding query filter params (group.id=390a56587cdb46cf9ed3442404df3b19, role.id=9d41dc09d0f646b1994526fcbd8d3622, scope.project.id=08189b6976bc4ea785ac0de443ab36e3) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:44.820728 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f14eb-93ff-4727-a624-87e1453b5ef8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:44.822049 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f14eb-93ff-4727-a624-87e1453b5ef8 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:44.831127 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 193/380] 10.222.0.24 () {56 vars in 1376 bytes} [Thu May 19 14:51:44 2022] GET /identity/v3/role_assignments?group.id=390a56587cdb46cf9ed3442404df3b19&scope.project.id=08189b6976bc4ea785ac0de443ab36e3&role.id=9d41dc09d0f646b1994526fcbd8d3622 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:45.395513 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2ff11-8091-4523-b82d-dd7ae58f6bd6 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:45.396023 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2ff11-8091-4523-b82d-dd7ae58f6bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:45.396121 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2ff11-8091-4523-b82d-dd7ae58f6bd6 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:45.397798 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 188/381] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:45.403638 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa74cf-c917-4be6-919d-4672c1bdfcac None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:45.404105 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa74cf-c917-4be6-919d-4672c1bdfcac None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:45.404193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa74cf-c917-4be6-919d-4672c1bdfcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:45.431352 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-93aa74cf-c917-4be6-919d-4672c1bdfcac None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:45.432522 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-93aa74cf-c917-4be6-919d-4672c1bdfcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:45.525514 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 194/382] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:51:45.562498 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2ff11-8091-4523-b82d-dd7ae58f6bd6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:45.588655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:45.689395 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2ff11-8091-4523-b82d-dd7ae58f6bd6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:45.736029 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82cb1a-c829-4025-8d24-2110b92cd697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:45.737123 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82cb1a-c829-4025-8d24-2110b92cd697 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:45.737553 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82cb1a-c829-4025-8d24-2110b92cd697 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:45.738005 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82cb1a-c829-4025-8d24-2110b92cd697 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:45.751431 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82cb1a-c829-4025-8d24-2110b92cd697 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:45.759995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-5e82cb1a-c829-4025-8d24-2110b92cd697 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:45.759995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:45.759995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:45.759995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:45.759995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:45.759995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:45.759995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:45.759995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:45.759995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:45.759995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:45.759995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:45.759995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:45.759995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:45.759995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:45.759995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:45.759995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:45.761069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:45.761069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:45.761069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:45.761069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:45.761069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:45.761069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:45.761069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:45.761069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:45.761069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:45.761069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:45.761069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:45.761069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:51:45.761069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:45.761069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:45.761069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:45.761069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:45.762059 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:45.762059 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:45.762059 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:45.762059 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:45.762059 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:45.762059 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:45.762059 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:45.762059 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:45.762059 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:45.762059 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:45.762059 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:45.762059 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:51:45.764457 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 189/383] 10.222.0.24 () {56 vars in 1114 bytes} [Thu May 19 14:51:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:45.774317 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa74cf-c917-4be6-919d-4672c1bdfcac None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:45.902707 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa74cf-c917-4be6-919d-4672c1bdfcac None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:45.931580 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:45.940132 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebab736-57d4-4cfe-8798-73928ec37bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:45.940857 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebab736-57d4-4cfe-8798-73928ec37bcf None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:45.941351 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebab736-57d4-4cfe-8798-73928ec37bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:45.941909 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebab736-57d4-4cfe-8798-73928ec37bcf None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:45.942662 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebab736-57d4-4cfe-8798-73928ec37bcf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:45.942968 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebab736-57d4-4cfe-8798-73928ec37bcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:45.944381 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebab736-57d4-4cfe-8798-73928ec37bcf None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:45.945927 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a20a39-e543-4f56-a4dd-c2e3ea4ec616 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:45.946411 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a20a39-e543-4f56-a4dd-c2e3ea4ec616 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:45.946871 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a20a39-e543-4f56-a4dd-c2e3ea4ec616 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:45.948715 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 190/384] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:45.953032 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 195/385] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:51:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:45.953972 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fac0e9-e978-423a-b765-800690e1d9db None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:45.954278 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fac0e9-e978-423a-b765-800690e1d9db None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:45.954565 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fac0e9-e978-423a-b765-800690e1d9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:45.958139 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebab736-57d4-4cfe-8798-73928ec37bcf None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:45.988270 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e8fac0e9-e978-423a-b765-800690e1d9db None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:45.989473 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e8fac0e9-e978-423a-b765-800690e1d9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:46.100727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebab736-57d4-4cfe-8798-73928ec37bcf None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:46.120834 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 191/386] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:46.122427 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beee1a0-bdfb-452a-a7ce-87fab5ecd975 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:46.122861 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beee1a0-bdfb-452a-a7ce-87fab5ecd975 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:46.123317 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beee1a0-bdfb-452a-a7ce-87fab5ecd975 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:46.125090 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 192/387] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:46.130017 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adba7e3-6507-420c-acb1-1123421569a8 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:46.130512 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adba7e3-6507-420c-acb1-1123421569a8 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:46.130927 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adba7e3-6507-420c-acb1-1123421569a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:46.137464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddddd1a-7f0f-4535-97a8-f356621bfbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:46.138594 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddddd1a-7f0f-4535-97a8-f356621bfbf9 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:46.139050 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddddd1a-7f0f-4535-97a8-f356621bfbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:46.139516 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddddd1a-7f0f-4535-97a8-f356621bfbf9 None admin] PATH_INFO: `/v3/groups/390a56587cdb46cf9ed3442404df3b19` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:46.140851 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddddd1a-7f0f-4535-97a8-f356621bfbf9 None admin] RBAC: Authorizing `identity:get_group(group_id=390a56587cdb46cf9ed3442404df3b19)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:46.142485 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddddd1a-7f0f-4535-97a8-f356621bfbf9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:46.144676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 196/388] 10.222.0.24 () {56 vars in 1180 bytes} [Thu May 19 14:51:45 2022] GET /identity/v3/groups/390a56587cdb46cf9ed3442404df3b19 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:46.145272 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:46.150351 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddddd1a-7f0f-4535-97a8-f356621bfbf9 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:46.159275 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-3adba7e3-6507-420c-acb1-1123421569a8 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:46.160718 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3adba7e3-6507-420c-acb1-1123421569a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:46.215468 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:46.243301 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 193/389] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:51:46.244195 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adba7e3-6507-420c-acb1-1123421569a8 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:46.261571 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddddd1a-7f0f-4535-97a8-f356621bfbf9 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:46.297485 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fb97b-7d65-4d63-9d80-bdafb5c29186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:46.298642 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fb97b-7d65-4d63-9d80-bdafb5c29186 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:46.299126 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fb97b-7d65-4d63-9d80-bdafb5c29186 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:46.299641 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fb97b-7d65-4d63-9d80-bdafb5c29186 None admin] PATH_INFO: `/v3/projects/824de15367424616b3588eca8e09020e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:46.301015 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fb97b-7d65-4d63-9d80-bdafb5c29186 None admin] RBAC: Authorizing `identity:get_project(project_id=824de15367424616b3588eca8e09020e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:46.302771 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fb97b-7d65-4d63-9d80-bdafb5c29186 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:46.305179 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 197/390] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:46 2022] GET /identity/v3/projects/824de15367424616b3588eca8e09020e => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:46.306384 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fb97b-7d65-4d63-9d80-bdafb5c29186 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:46.372906 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adba7e3-6507-420c-acb1-1123421569a8 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:46.426338 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63736351-295b-402c-a163-539b92f0c09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:46.428125 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63736351-295b-402c-a163-539b92f0c09b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:46.428419 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63736351-295b-402c-a163-539b92f0c09b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:46.428697 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63736351-295b-402c-a163-539b92f0c09b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:46.430807 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:46.441827 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63736351-295b-402c-a163-539b92f0c09b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:46.449785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-63736351-295b-402c-a163-539b92f0c09b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:46.449785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:46.449785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:46.449785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:46.449785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:46.449785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:46.449785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:46.449785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:46.449785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:46.449785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:46.449785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:46.449785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:46.449785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:46.449785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:46.449785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:46.449785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:46.450809 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:46.450809 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:46.450809 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:46.450809 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:46.450809 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:46.450809 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:46.450809 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:46.450809 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:46.450809 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:46.450809 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:46.450809 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:46.450809 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:51:46.450809 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:46.450809 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:46.450809 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:46.450809 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:46.451736 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:46.451736 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:46.451736 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:46.451736 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:46.451736 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:46.451736 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:46.451736 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:46.451736 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:46.451736 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:46.451736 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:46.451736 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:46.451736 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:51:46.454039 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 194/391] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:46.457278 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fb97b-7d65-4d63-9d80-bdafb5c29186 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:46.459551 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63736351-295b-402c-a163-539b92f0c09b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:46.502962 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c532a1-6c39-4105-9811-9833395dfb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:46.504014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c532a1-6c39-4105-9811-9833395dfb6d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:46.504916 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c532a1-6c39-4105-9811-9833395dfb6d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:46.505380 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c532a1-6c39-4105-9811-9833395dfb6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:46.519628 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c532a1-6c39-4105-9811-9833395dfb6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:46.528730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-83c532a1-6c39-4105-9811-9833395dfb6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:46.528730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:46.528730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:46.528730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:46.528730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:46.528730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:46.528730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:46.528730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:46.528730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:46.528730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:46.528730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:46.528730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:46.528730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:46.528730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:46.528730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:46.528730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:46.529797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:46.529797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:46.529797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:46.529797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:46.529797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:46.529797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:46.529797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:46.529797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:46.529797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:46.529797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:46.529797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:46.529797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:51:46.529797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:46.529797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:46.529797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:46.529797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:46.530776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:46.530776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:46.530776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:46.530776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:46.530776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:46.530776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:46.530776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:46.530776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:46.530776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:46.530776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:46.530776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:46.530776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:51:46.532221 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 198/392] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:46.537686 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c532a1-6c39-4105-9811-9833395dfb6d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:46.548046 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:46.576396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63736351-295b-402c-a163-539b92f0c09b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:46.611749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1c5dd-0a0a-491b-90fb-971dce15504d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:46.612976 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1c5dd-0a0a-491b-90fb-971dce15504d None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:46.613493 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1c5dd-0a0a-491b-90fb-971dce15504d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:46.613986 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1c5dd-0a0a-491b-90fb-971dce15504d None admin] PATH_INFO: `/v3/projects/824de15367424616b3588eca8e09020e/groups/390a56587cdb46cf9ed3442404df3b19/roles/9d41dc09d0f646b1994526fcbd8d3622` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:46.616546 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f1c5dd-0a0a-491b-90fb-971dce15504d None admin] RBAC: Authorizing `identity:create_grant(project_id=824de15367424616b3588eca8e09020e, group_id=390a56587cdb46cf9ed3442404df3b19, role_id=9d41dc09d0f646b1994526fcbd8d3622)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:46.618310 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f1c5dd-0a0a-491b-90fb-971dce15504d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:46.633930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 195/393] 10.222.0.24 () {58 vars in 1442 bytes} [Thu May 19 14:51:46 2022] PUT /identity/v3/projects/824de15367424616b3588eca8e09020e/groups/390a56587cdb46cf9ed3442404df3b19/roles/9d41dc09d0f646b1994526fcbd8d3622 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:51:46.635347 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1c5dd-0a0a-491b-90fb-971dce15504d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:46.652015 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c532a1-6c39-4105-9811-9833395dfb6d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:46.708295 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:46.708501 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317508d0-914d-4b37-a23d-33bd27dc9dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:46.709617 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317508d0-914d-4b37-a23d-33bd27dc9dac None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:46.709844 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317508d0-914d-4b37-a23d-33bd27dc9dac None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:46.710296 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317508d0-914d-4b37-a23d-33bd27dc9dac None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:46.711338 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317508d0-914d-4b37-a23d-33bd27dc9dac None admin] RBAC: Adding query filter params (name=member) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:46.711633 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317508d0-914d-4b37-a23d-33bd27dc9dac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:46.713055 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317508d0-914d-4b37-a23d-33bd27dc9dac None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:46.733425 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 199/394] 10.222.0.24 () {56 vars in 1101 bytes} [Thu May 19 14:51:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:46.748167 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317508d0-914d-4b37-a23d-33bd27dc9dac None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:46.771250 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1c5dd-0a0a-491b-90fb-971dce15504d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:46.816210 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042c86d-6efe-4c4e-83ba-91447a29b7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:46.818100 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042c86d-6efe-4c4e-83ba-91447a29b7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:46.818879 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042c86d-6efe-4c4e-83ba-91447a29b7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:46.819451 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042c86d-6efe-4c4e-83ba-91447a29b7e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:46.822840 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b042c86d-6efe-4c4e-83ba-91447a29b7e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:46.823469 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b042c86d-6efe-4c4e-83ba-91447a29b7e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:46.829127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b042c86d-6efe-4c4e-83ba-91447a29b7e1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:46.844046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 196/395] 10.222.0.24 () {56 vars in 1101 bytes} [Thu May 19 14:51:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:46.847900 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:46.861650 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042c86d-6efe-4c4e-83ba-91447a29b7e1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:46.936195 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317508d0-914d-4b37-a23d-33bd27dc9dac None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:46.981653 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fc27c-b0ff-4854-9cd2-944deb10820b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:46.982956 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fc27c-b0ff-4854-9cd2-944deb10820b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:46.983600 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fc27c-b0ff-4854-9cd2-944deb10820b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:46.984141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fc27c-b0ff-4854-9cd2-944deb10820b None admin] PATH_INFO: `/v3/groups/390a56587cdb46cf9ed3442404df3b19` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:46.986356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049fc27c-b0ff-4854-9cd2-944deb10820b None admin] RBAC: Authorizing `identity:get_group(group_id=390a56587cdb46cf9ed3442404df3b19)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:46.988264 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049fc27c-b0ff-4854-9cd2-944deb10820b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:46.990611 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 200/396] 10.222.0.24 () {56 vars in 1180 bytes} [Thu May 19 14:51:46 2022] GET /identity/v3/groups/390a56587cdb46cf9ed3442404df3b19 => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:46.996572 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fc27c-b0ff-4854-9cd2-944deb10820b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:47.011097 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042c86d-6efe-4c4e-83ba-91447a29b7e1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:47.029838 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:47.052771 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabafda0-d6ea-40cc-b7ea-42eb595f2598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:47.053689 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabafda0-d6ea-40cc-b7ea-42eb595f2598 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:47.053976 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabafda0-d6ea-40cc-b7ea-42eb595f2598 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:47.054306 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabafda0-d6ea-40cc-b7ea-42eb595f2598 None admin] PATH_INFO: `/v3/groups/390a56587cdb46cf9ed3442404df3b19` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:47.055546 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabafda0-d6ea-40cc-b7ea-42eb595f2598 None admin] RBAC: Authorizing `identity:get_group(group_id=390a56587cdb46cf9ed3442404df3b19)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:47.057000 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabafda0-d6ea-40cc-b7ea-42eb595f2598 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:47.058946 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 197/397] 10.222.0.24 () {56 vars in 1180 bytes} [Thu May 19 14:51:46 2022] GET /identity/v3/groups/390a56587cdb46cf9ed3442404df3b19 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:47.067259 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabafda0-d6ea-40cc-b7ea-42eb595f2598 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:47.121072 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fc27c-b0ff-4854-9cd2-944deb10820b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:47.136814 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:47.162352 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263ab95-2e68-446f-955f-72f92b924fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:47.163533 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263ab95-2e68-446f-955f-72f92b924fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:47.163862 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263ab95-2e68-446f-955f-72f92b924fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:47.164143 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263ab95-2e68-446f-955f-72f92b924fb5 None admin] PATH_INFO: `/v3/projects/824de15367424616b3588eca8e09020e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:47.165879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263ab95-2e68-446f-955f-72f92b924fb5 None admin] RBAC: Authorizing `identity:get_project(project_id=824de15367424616b3588eca8e09020e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:47.167218 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263ab95-2e68-446f-955f-72f92b924fb5 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:47.169384 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 201/398] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:46 2022] GET /identity/v3/projects/824de15367424616b3588eca8e09020e => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:47.177611 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263ab95-2e68-446f-955f-72f92b924fb5 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:47.241720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabafda0-d6ea-40cc-b7ea-42eb595f2598 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:47.277555 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904e071-0983-41aa-8292-d4f9f78c85a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:47.278833 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904e071-0983-41aa-8292-d4f9f78c85a1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:47.279396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904e071-0983-41aa-8292-d4f9f78c85a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:47.279895 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904e071-0983-41aa-8292-d4f9f78c85a1 None admin] PATH_INFO: `/v3/projects/08189b6976bc4ea785ac0de443ab36e3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:47.281325 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904e071-0983-41aa-8292-d4f9f78c85a1 None admin] RBAC: Authorizing `identity:get_project(project_id=08189b6976bc4ea785ac0de443ab36e3)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:47.283042 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904e071-0983-41aa-8292-d4f9f78c85a1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:47.285350 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 198/399] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:47 2022] GET /identity/v3/projects/08189b6976bc4ea785ac0de443ab36e3 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:47.295339 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904e071-0983-41aa-8292-d4f9f78c85a1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:47.385507 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263ab95-2e68-446f-955f-72f92b924fb5 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:47.398853 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:47.430709 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8628f-b55e-43e5-a1bd-6c2b39ad7efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:47.431851 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8628f-b55e-43e5-a1bd-6c2b39ad7efe None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:47.432198 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8628f-b55e-43e5-a1bd-6c2b39ad7efe None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:47.432537 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8628f-b55e-43e5-a1bd-6c2b39ad7efe None admin] PATH_INFO: `/v3/projects/824de15367424616b3588eca8e09020e/groups/390a56587cdb46cf9ed3442404df3b19/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:47.434724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8628f-b55e-43e5-a1bd-6c2b39ad7efe None admin] RBAC: Authorizing `identity:create_grant(project_id=824de15367424616b3588eca8e09020e, group_id=390a56587cdb46cf9ed3442404df3b19, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:47.436421 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8628f-b55e-43e5-a1bd-6c2b39ad7efe None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:47.459055 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904e071-0983-41aa-8292-d4f9f78c85a1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:47.459634 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 202/400] 10.222.0.24 () {58 vars in 1442 bytes} [Thu May 19 14:51:47 2022] PUT /identity/v3/projects/824de15367424616b3588eca8e09020e/groups/390a56587cdb46cf9ed3442404df3b19/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:51:47.461076 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab6e5b-7899-4181-9d7f-46db932827bb None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:47.461446 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab6e5b-7899-4181-9d7f-46db932827bb None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:47.461727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab6e5b-7899-4181-9d7f-46db932827bb None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:47.463454 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 203/401] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:47.477113 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4dd6a-111a-4e84-a11b-cc6216be4b2f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:47.477400 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4dd6a-111a-4e84-a11b-cc6216be4b2f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:47.477678 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4dd6a-111a-4e84-a11b-cc6216be4b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:47.502595 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-54d4dd6a-111a-4e84-a11b-cc6216be4b2f None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:47.503887 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-54d4dd6a-111a-4e84-a11b-cc6216be4b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:47.516739 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011be0b7-4eef-4849-b627-989e61d45787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:47.517973 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011be0b7-4eef-4849-b627-989e61d45787 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:47.518422 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011be0b7-4eef-4849-b627-989e61d45787 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:47.518969 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011be0b7-4eef-4849-b627-989e61d45787 None admin] PATH_INFO: `/v3/projects/08189b6976bc4ea785ac0de443ab36e3/groups/390a56587cdb46cf9ed3442404df3b19/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:47.521989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011be0b7-4eef-4849-b627-989e61d45787 None admin] RBAC: Authorizing `identity:create_grant(project_id=08189b6976bc4ea785ac0de443ab36e3, group_id=390a56587cdb46cf9ed3442404df3b19, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:47.523494 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011be0b7-4eef-4849-b627-989e61d45787 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:47.540154 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 199/402] 10.222.0.24 () {58 vars in 1442 bytes} [Thu May 19 14:51:47 2022] PUT /identity/v3/projects/08189b6976bc4ea785ac0de443ab36e3/groups/390a56587cdb46cf9ed3442404df3b19/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 14:51:47.541704 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d437d1b-f911-4272-850b-b06d91d76e8a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:47.542046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d437d1b-f911-4272-850b-b06d91d76e8a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:47.542274 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d437d1b-f911-4272-850b-b06d91d76e8a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:47.548202 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 200/403] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:47.550353 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef300b-12fc-435a-b916-8a4516c338f9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:47.550655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef300b-12fc-435a-b916-8a4516c338f9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:47.550939 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef300b-12fc-435a-b916-8a4516c338f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:47.552500 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:47.569484 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-93ef300b-12fc-435a-b916-8a4516c338f9 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:47.570773 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-93ef300b-12fc-435a-b916-8a4516c338f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:47.583567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 204/404] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 19 14:51:47.608233 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4dd6a-111a-4e84-a11b-cc6216be4b2f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:47.650807 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 201/405] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:51:47.675521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef300b-12fc-435a-b916-8a4516c338f9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:47.727457 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:47.732770 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4dd6a-111a-4e84-a11b-cc6216be4b2f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:47.784890 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708e82e-c795-48fc-9d93-c3708804bfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:47.786535 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708e82e-c795-48fc-9d93-c3708804bfec None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:47.787346 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708e82e-c795-48fc-9d93-c3708804bfec None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:47.788045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708e82e-c795-48fc-9d93-c3708804bfec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:47.796554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef300b-12fc-435a-b916-8a4516c338f9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:47.801296 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708e82e-c795-48fc-9d93-c3708804bfec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:47.809604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-3708e82e-c795-48fc-9d93-c3708804bfec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:47.809604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:47.809604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:47.809604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:47.809604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:47.809604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:47.809604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:47.809604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:47.809604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:47.809604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:47.809604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:47.809604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:47.809604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:47.809604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:47.809604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:47.809604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:47.810601 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:47.810601 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:47.810601 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:47.810601 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:47.810601 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:47.810601 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:47.810601 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:47.810601 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:47.810601 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:47.810601 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:47.810601 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:47.810601 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:51:47.810601 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:47.810601 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:47.810601 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:47.810601 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:47.811430 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:47.811430 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:47.811430 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:47.811430 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:47.811430 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:47.811430 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:47.811430 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:47.811430 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:47.811430 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:47.811430 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:47.811430 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:47.811430 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:51:47.814046 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 205/406] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:51:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:51:47.820192 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708e82e-c795-48fc-9d93-c3708804bfec None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:47.834567 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f05e4-e1a0-448e-8d1a-066b21e6e346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:47.835430 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f05e4-e1a0-448e-8d1a-066b21e6e346 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:47.835718 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f05e4-e1a0-448e-8d1a-066b21e6e346 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:47.835992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f05e4-e1a0-448e-8d1a-066b21e6e346 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:47.850223 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f05e4-e1a0-448e-8d1a-066b21e6e346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:47.856661 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:47.860791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-e96f05e4-e1a0-448e-8d1a-066b21e6e346 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:47.860791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:47.860791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:47.860791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:47.860791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:47.860791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:47.860791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:47.860791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:47.860791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:47.860791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:47.860791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:47.860791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:47.860791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:47.860791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:47.860791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:47.860791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:47.861833 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:47.861833 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:47.861833 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:47.861833 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:47.861833 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:47.861833 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:47.861833 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:47.861833 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:47.861833 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:47.861833 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:47.861833 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:47.861833 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:51:47.861833 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:47.861833 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:47.861833 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:47.861833 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:47.862666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:47.862666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:47.862666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:47.862666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:47.862666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:47.862666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:47.862666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:47.862666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:47.862666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:47.862666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:47.862666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:47.862666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:51:47.865468 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 202/407] 10.222.0.24 () {56 vars in 1114 bytes} [Thu May 19 14:51:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:51:47.872066 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f05e4-e1a0-448e-8d1a-066b21e6e346 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:47.939623 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708e82e-c795-48fc-9d93-c3708804bfec None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:47.978809 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f05e4-e1a0-448e-8d1a-066b21e6e346 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:47.985362 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf56050-ea1b-4657-afe8-fbd3760c5605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:47.986665 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf56050-ea1b-4657-afe8-fbd3760c5605 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:47.987130 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf56050-ea1b-4657-afe8-fbd3760c5605 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:47.987632 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf56050-ea1b-4657-afe8-fbd3760c5605 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:47.988900 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf56050-ea1b-4657-afe8-fbd3760c5605 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:47.989702 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf56050-ea1b-4657-afe8-fbd3760c5605 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:47.991561 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf56050-ea1b-4657-afe8-fbd3760c5605 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:47.999539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:48.004191 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 206/408] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:48.009514 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf56050-ea1b-4657-afe8-fbd3760c5605 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:48.044019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48599ae9-c640-4784-913d-0d7477423721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:48.044625 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48599ae9-c640-4784-913d-0d7477423721 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:48.044917 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48599ae9-c640-4784-913d-0d7477423721 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:48.045195 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48599ae9-c640-4784-913d-0d7477423721 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:48.045949 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48599ae9-c640-4784-913d-0d7477423721 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:48.046256 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48599ae9-c640-4784-913d-0d7477423721 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:48.047760 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48599ae9-c640-4784-913d-0d7477423721 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:48.069173 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 203/409] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:51:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:48.079149 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48599ae9-c640-4784-913d-0d7477423721 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:48.120339 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:48.129486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf56050-ea1b-4657-afe8-fbd3760c5605 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:48.169240 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f6d87-7ae0-4211-bbe7-ecc9704e38cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:48.171000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f6d87-7ae0-4211-bbe7-ecc9704e38cd None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:48.171320 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f6d87-7ae0-4211-bbe7-ecc9704e38cd None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:48.171601 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f6d87-7ae0-4211-bbe7-ecc9704e38cd None admin] PATH_INFO: `/v3/groups/2c29375965884354a2b22d67b5eddad0` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:48.172869 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f6d87-7ae0-4211-bbe7-ecc9704e38cd None admin] RBAC: Authorizing `identity:get_group(group_id=2c29375965884354a2b22d67b5eddad0)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:48.174356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f6d87-7ae0-4211-bbe7-ecc9704e38cd None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:48.176346 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 207/410] 10.222.0.24 () {56 vars in 1180 bytes} [Thu May 19 14:51:48 2022] GET /identity/v3/groups/2c29375965884354a2b22d67b5eddad0 => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:48.181907 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f6d87-7ae0-4211-bbe7-ecc9704e38cd None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:48.258302 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48599ae9-c640-4784-913d-0d7477423721 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:48.297893 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f1162-1e72-42c7-9690-27648e1a21dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:48.298828 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f1162-1e72-42c7-9690-27648e1a21dd None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:48.299119 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f1162-1e72-42c7-9690-27648e1a21dd None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:48.299429 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f1162-1e72-42c7-9690-27648e1a21dd None admin] PATH_INFO: `/v3/groups/390a56587cdb46cf9ed3442404df3b19` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:48.302118 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f1162-1e72-42c7-9690-27648e1a21dd None admin] RBAC: Authorizing `identity:get_group(group_id=390a56587cdb46cf9ed3442404df3b19)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:48.303587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f1162-1e72-42c7-9690-27648e1a21dd None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:48.305869 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 204/411] 10.222.0.24 () {56 vars in 1180 bytes} [Thu May 19 14:51:48 2022] GET /identity/v3/groups/390a56587cdb46cf9ed3442404df3b19 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:48.311543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f1162-1e72-42c7-9690-27648e1a21dd None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:48.351623 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:48.420508 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f1162-1e72-42c7-9690-27648e1a21dd None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:48.456529 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf890aeb-642c-4f53-b180-7cbd0f0c0c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:48.457483 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf890aeb-642c-4f53-b180-7cbd0f0c0c3e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:48.457834 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf890aeb-642c-4f53-b180-7cbd0f0c0c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:48.458176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf890aeb-642c-4f53-b180-7cbd0f0c0c3e None admin] PATH_INFO: `/v3/projects/08189b6976bc4ea785ac0de443ab36e3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:48.459460 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf890aeb-642c-4f53-b180-7cbd0f0c0c3e None admin] RBAC: Authorizing `identity:get_project(project_id=08189b6976bc4ea785ac0de443ab36e3)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:48.461105 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf890aeb-642c-4f53-b180-7cbd0f0c0c3e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:48.463233 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 205/412] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:48 2022] GET /identity/v3/projects/08189b6976bc4ea785ac0de443ab36e3 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:48.469213 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf890aeb-642c-4f53-b180-7cbd0f0c0c3e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:48.488268 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f6d87-7ae0-4211-bbe7-ecc9704e38cd None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:48.539352 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31fc61-bd68-42a3-a381-c8a7b0949685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:48.540208 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31fc61-bd68-42a3-a381-c8a7b0949685 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:48.540609 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31fc61-bd68-42a3-a381-c8a7b0949685 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:48.540925 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31fc61-bd68-42a3-a381-c8a7b0949685 None admin] PATH_INFO: `/v3/projects/55b46daee5c44a5cacdc54e48d280e5e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:48.542185 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31fc61-bd68-42a3-a381-c8a7b0949685 None admin] RBAC: Authorizing `identity:get_project(project_id=55b46daee5c44a5cacdc54e48d280e5e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:48.545492 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31fc61-bd68-42a3-a381-c8a7b0949685 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:48.545817 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 208/413] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:48 2022] GET /identity/v3/projects/55b46daee5c44a5cacdc54e48d280e5e => generated 344 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:48.556707 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31fc61-bd68-42a3-a381-c8a7b0949685 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:48.631688 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:48.649370 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf890aeb-642c-4f53-b180-7cbd0f0c0c3e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:48.669442 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:48.723791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488ea70-a448-4974-bba9-60d970489d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:48.725116 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488ea70-a448-4974-bba9-60d970489d6c None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:48.725602 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488ea70-a448-4974-bba9-60d970489d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:48.726067 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488ea70-a448-4974-bba9-60d970489d6c None admin] PATH_INFO: `/v3/projects/08189b6976bc4ea785ac0de443ab36e3/groups/390a56587cdb46cf9ed3442404df3b19/roles/9d41dc09d0f646b1994526fcbd8d3622` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:48.730802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b488ea70-a448-4974-bba9-60d970489d6c None admin] RBAC: Authorizing `identity:create_grant(project_id=08189b6976bc4ea785ac0de443ab36e3, group_id=390a56587cdb46cf9ed3442404df3b19, role_id=9d41dc09d0f646b1994526fcbd8d3622)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:48.732490 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b488ea70-a448-4974-bba9-60d970489d6c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:48.746325 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31fc61-bd68-42a3-a381-c8a7b0949685 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:48.772937 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 206/414] 10.222.0.24 () {58 vars in 1442 bytes} [Thu May 19 14:51:48 2022] PUT /identity/v3/projects/08189b6976bc4ea785ac0de443ab36e3/groups/390a56587cdb46cf9ed3442404df3b19/roles/9d41dc09d0f646b1994526fcbd8d3622 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:51:48.789038 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544787c-1847-4e56-a4d5-f62583edfe95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:48.790356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544787c-1847-4e56-a4d5-f62583edfe95 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:48.790831 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544787c-1847-4e56-a4d5-f62583edfe95 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:48.791332 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544787c-1847-4e56-a4d5-f62583edfe95 None admin] PATH_INFO: `/v3/projects/55b46daee5c44a5cacdc54e48d280e5e/groups/2c29375965884354a2b22d67b5eddad0/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:48.793518 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544787c-1847-4e56-a4d5-f62583edfe95 None admin] RBAC: Authorizing `identity:create_grant(project_id=55b46daee5c44a5cacdc54e48d280e5e, group_id=2c29375965884354a2b22d67b5eddad0, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:48.795274 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544787c-1847-4e56-a4d5-f62583edfe95 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:48.820545 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 209/415] 10.222.0.24 () {58 vars in 1442 bytes} [Thu May 19 14:51:48 2022] PUT /identity/v3/projects/55b46daee5c44a5cacdc54e48d280e5e/groups/2c29375965884354a2b22d67b5eddad0/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:51:49.470753 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a17b4e-6751-4d84-8254-91e327a8c0b9 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:49.471277 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a17b4e-6751-4d84-8254-91e327a8c0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:49.471354 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a17b4e-6751-4d84-8254-91e327a8c0b9 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:49.472948 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 207/416] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:49.478451 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffc2a5-36a5-4c69-a91d-d9d260a996b7 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:49.478741 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffc2a5-36a5-4c69-a91d-d9d260a996b7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:49.479019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffc2a5-36a5-4c69-a91d-d9d260a996b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:49.499460 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-85ffc2a5-36a5-4c69-a91d-d9d260a996b7 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:49.500678 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-85ffc2a5-36a5-4c69-a91d-d9d260a996b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:49.586340 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 210/417] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:49.626103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a17b4e-6751-4d84-8254-91e327a8c0b9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:49.755282 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a17b4e-6751-4d84-8254-91e327a8c0b9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:49.801585 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c68be-ced6-4c20-9b99-6c77dab6ad79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:49.802394 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c68be-ced6-4c20-9b99-6c77dab6ad79 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:49.802676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c68be-ced6-4c20-9b99-6c77dab6ad79 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:49.802947 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c68be-ced6-4c20-9b99-6c77dab6ad79 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:49.819011 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c68be-ced6-4c20-9b99-6c77dab6ad79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:49.827267 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-d12c68be-ced6-4c20-9b99-6c77dab6ad79 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:49.827267 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:49.827267 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:49.827267 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:49.827267 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:49.827267 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:49.827267 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:49.827267 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:49.827267 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:49.827267 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:49.827267 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:49.827267 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:49.827267 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:49.827267 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:49.827267 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:49.827267 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:49.828159 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:49.828159 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:49.828159 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:49.828159 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:49.828159 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:49.828159 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:49.828159 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:49.828159 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:49.828159 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:49.828159 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:49.828159 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:49.828159 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:51:49.828159 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:49.828159 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:49.828159 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:49.828159 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:49.828995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:49.828995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:49.828995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:49.828995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:49.828995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:49.828995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:49.828995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:49.828995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:49.828995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:49.828995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:49.828995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:49.828995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:51:49.828995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 208/418] 10.222.0.24 () {56 vars in 1114 bytes} [Thu May 19 14:51:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:49.834362 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffc2a5-36a5-4c69-a91d-d9d260a996b7 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:49.863716 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:49.977448 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffc2a5-36a5-4c69-a91d-d9d260a996b7 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:50.014530 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35125585-8846-4540-83c8-00b4fa404807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:50.015215 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35125585-8846-4540-83c8-00b4fa404807 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:50.015523 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35125585-8846-4540-83c8-00b4fa404807 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:50.015833 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35125585-8846-4540-83c8-00b4fa404807 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:50.016844 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35125585-8846-4540-83c8-00b4fa404807 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:50.017152 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35125585-8846-4540-83c8-00b4fa404807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:50.018536 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35125585-8846-4540-83c8-00b4fa404807 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:50.027428 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 211/419] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:51:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:50.036250 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c68be-ced6-4c20-9b99-6c77dab6ad79 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:50.080244 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:50.185875 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c68be-ced6-4c20-9b99-6c77dab6ad79 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:50.221363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4f5cd-927a-4e18-8ce8-c92337f96448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:50.222375 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4f5cd-927a-4e18-8ce8-c92337f96448 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:50.222864 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4f5cd-927a-4e18-8ce8-c92337f96448 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:50.223401 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4f5cd-927a-4e18-8ce8-c92337f96448 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:50.255732 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171919c-ba54-46ab-9b54-a79152bd4656 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:50.256054 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171919c-ba54-46ab-9b54-a79152bd4656 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:50.256288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171919c-ba54-46ab-9b54-a79152bd4656 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:50.259296 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 212/420] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:50.268941 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c2e14-5e1f-4f8b-aff6-d3a7a43cc9c8 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:50.269236 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c2e14-5e1f-4f8b-aff6-d3a7a43cc9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:50.269532 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c2e14-5e1f-4f8b-aff6-d3a7a43cc9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:50.301637 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4f5cd-927a-4e18-8ce8-c92337f96448 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:50.303134 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4f5cd-927a-4e18-8ce8-c92337f96448 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:50.304125 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-261c2e14-5e1f-4f8b-aff6-d3a7a43cc9c8 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:50.305421 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-261c2e14-5e1f-4f8b-aff6-d3a7a43cc9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:50.327418 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:50.415765 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 209/421] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:51:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:51:50.421301 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4f5cd-927a-4e18-8ce8-c92337f96448 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:50.454292 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 213/422] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:50.455621 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24699b3e-be93-470f-9ea2-3e6bcc2fdeb8 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:50.456016 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24699b3e-be93-470f-9ea2-3e6bcc2fdeb8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:50.456299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24699b3e-be93-470f-9ea2-3e6bcc2fdeb8 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:50.457748 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 214/423] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:50.463296 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1fee8-d76a-4f62-9007-e03c350b061b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:50.463585 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1fee8-d76a-4f62-9007-e03c350b061b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:50.463970 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1fee8-d76a-4f62-9007-e03c350b061b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:50.482261 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b9a1fee8-d76a-4f62-9007-e03c350b061b None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:50.483583 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b9a1fee8-d76a-4f62-9007-e03c350b061b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:50.491711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:50.535230 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4f5cd-927a-4e18-8ce8-c92337f96448 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:50.556089 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:50.560555 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 215/424] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:51:50.569172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1fee8-d76a-4f62-9007-e03c350b061b None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:50.570804 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf01120-197a-44ac-b7c9-645f37ecb8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:50.571807 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf01120-197a-44ac-b7c9-645f37ecb8fa None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:50.572093 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf01120-197a-44ac-b7c9-645f37ecb8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:50.572466 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf01120-197a-44ac-b7c9-645f37ecb8fa None admin] PATH_INFO: `/v3/projects/824de15367424616b3588eca8e09020e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:50.573676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf01120-197a-44ac-b7c9-645f37ecb8fa None admin] RBAC: Authorizing `identity:get_project(project_id=824de15367424616b3588eca8e09020e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:50.575119 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf01120-197a-44ac-b7c9-645f37ecb8fa None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:50.577298 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 210/425] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:50 2022] GET /identity/v3/projects/824de15367424616b3588eca8e09020e => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:50.582845 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf01120-197a-44ac-b7c9-645f37ecb8fa None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:50.683092 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1fee8-d76a-4f62-9007-e03c350b061b None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:50.702454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf01120-197a-44ac-b7c9-645f37ecb8fa None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:50.730982 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820e732-6a90-4b81-80d7-e15c3f1654cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:50.732307 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820e732-6a90-4b81-80d7-e15c3f1654cc None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:50.732597 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820e732-6a90-4b81-80d7-e15c3f1654cc None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:50.732880 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820e732-6a90-4b81-80d7-e15c3f1654cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:50.743005 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f63d0b-7f30-4bbb-b8d9-28a39944670a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:50.744004 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f63d0b-7f30-4bbb-b8d9-28a39944670a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:50.744413 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f63d0b-7f30-4bbb-b8d9-28a39944670a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:50.745053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f63d0b-7f30-4bbb-b8d9-28a39944670a None admin] PATH_INFO: `/v3/groups/390a56587cdb46cf9ed3442404df3b19` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:50.745392 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820e732-6a90-4b81-80d7-e15c3f1654cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:50.746679 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f63d0b-7f30-4bbb-b8d9-28a39944670a None admin] RBAC: Authorizing `identity:get_group(group_id=390a56587cdb46cf9ed3442404df3b19)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:50.748245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f63d0b-7f30-4bbb-b8d9-28a39944670a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:50.750747 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 211/426] 10.222.0.24 () {56 vars in 1180 bytes} [Thu May 19 14:51:50 2022] GET /identity/v3/groups/390a56587cdb46cf9ed3442404df3b19 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:50.751609 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f63d0b-7f30-4bbb-b8d9-28a39944670a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:50.758321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-4820e732-6a90-4b81-80d7-e15c3f1654cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:50.758321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:50.758321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:50.758321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:50.758321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:50.758321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:50.758321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:50.758321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:50.758321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:50.758321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:50.758321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:50.758321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:50.758321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:50.758321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:50.758321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:50.758321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:50.759217 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:50.759217 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:50.759217 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:50.759217 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:50.759217 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:50.759217 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:50.759217 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:50.759217 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:50.759217 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:50.759217 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:50.759217 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:50.759217 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:51:50.759217 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:50.759217 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:50.759217 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:50.759217 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:50.760017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:50.760017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:50.760017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:50.760017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:50.760017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:50.760017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:50.760017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:50.760017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:50.760017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:50.760017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:50.760017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:50.760017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:51:50.760017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 216/427] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:50.760691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820e732-6a90-4b81-80d7-e15c3f1654cc None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:50.771616 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:50.833839 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:50.891162 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f63d0b-7f30-4bbb-b8d9-28a39944670a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:50.903274 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820e732-6a90-4b81-80d7-e15c3f1654cc None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:50.941745 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177d580-0cc8-4501-ba0c-8af387b9bad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:50.942551 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177d580-0cc8-4501-ba0c-8af387b9bad4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:50.942839 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177d580-0cc8-4501-ba0c-8af387b9bad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:50.943121 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177d580-0cc8-4501-ba0c-8af387b9bad4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:50.950463 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af393fd-8a19-4c50-9c10-fa6928394aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:50.951648 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af393fd-8a19-4c50-9c10-fa6928394aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:50.952496 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af393fd-8a19-4c50-9c10-fa6928394aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:50.952989 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af393fd-8a19-4c50-9c10-fa6928394aa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:50.954326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af393fd-8a19-4c50-9c10-fa6928394aa0 None admin] RBAC: Adding query filter params (group.id=390a56587cdb46cf9ed3442404df3b19, role.id=9d41dc09d0f646b1994526fcbd8d3622, scope.project.id=824de15367424616b3588eca8e09020e) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:50.954754 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1177d580-0cc8-4501-ba0c-8af387b9bad4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:50.955112 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af393fd-8a19-4c50-9c10-fa6928394aa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:50.956847 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af393fd-8a19-4c50-9c10-fa6928394aa0 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:50.969815 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-1177d580-0cc8-4501-ba0c-8af387b9bad4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:50.969815 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:50.969815 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:50.969815 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:50.969815 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:50.969815 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:50.969815 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:50.969815 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:50.969815 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:50.969815 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:50.969815 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:50.969815 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:50.969815 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:50.969815 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:50.969815 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:50.969815 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:50.970770 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:50.970770 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:50.970770 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:50.970770 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:50.970770 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:50.970770 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:50.970770 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:50.970770 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:50.970770 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:50.970770 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:50.970770 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:50.970770 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:51:50.970770 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:50.970770 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:50.970770 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:50.970770 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:50.971609 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:50.971609 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:50.971609 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:50.971609 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:50.971609 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:50.971609 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:50.971609 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:50.971609 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:50.971609 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:50.971609 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:50.971609 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 19 14:51:50.971609 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:51:50.971609 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 212/429] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:50.971609 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177d580-0cc8-4501-ba0c-8af387b9bad4 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:50.972332 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 217/429] 10.222.0.24 () {56 vars in 1376 bytes} [Thu May 19 14:51:50 2022] GET /identity/v3/role_assignments?group.id=390a56587cdb46cf9ed3442404df3b19&scope.project.id=824de15367424616b3588eca8e09020e&role.id=9d41dc09d0f646b1994526fcbd8d3622 => generated 611 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:50.972332 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af393fd-8a19-4c50-9c10-fa6928394aa0 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:51.061110 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:51.119171 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af393fd-8a19-4c50-9c10-fa6928394aa0 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:51.158277 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199b380-daf7-4577-bb1e-981e6ace1758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:51.159016 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199b380-daf7-4577-bb1e-981e6ace1758 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:51.159348 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199b380-daf7-4577-bb1e-981e6ace1758 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:51.159628 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199b380-daf7-4577-bb1e-981e6ace1758 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:51.161146 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5199b380-daf7-4577-bb1e-981e6ace1758 None admin] RBAC: Adding query filter params (name=member) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:51.161465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5199b380-daf7-4577-bb1e-981e6ace1758 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:51.163035 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5199b380-daf7-4577-bb1e-981e6ace1758 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:51.174630 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 218/430] 10.222.0.24 () {56 vars in 1101 bytes} [Thu May 19 14:51:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:51.184557 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199b380-daf7-4577-bb1e-981e6ace1758 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:51.210818 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177d580-0cc8-4501-ba0c-8af387b9bad4 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:51.230061 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:51.252049 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb69115-00ce-49e3-8bf9-48ef858e8631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:51.252820 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb69115-00ce-49e3-8bf9-48ef858e8631 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:51.253112 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb69115-00ce-49e3-8bf9-48ef858e8631 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:51.253484 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb69115-00ce-49e3-8bf9-48ef858e8631 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:51.254241 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb69115-00ce-49e3-8bf9-48ef858e8631 None admin] RBAC: Adding query filter params (name=member) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:51.254553 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb69115-00ce-49e3-8bf9-48ef858e8631 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:51.255967 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb69115-00ce-49e3-8bf9-48ef858e8631 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:51.265136 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 213/431] 10.222.0.24 () {56 vars in 1101 bytes} [Thu May 19 14:51:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:51.270591 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb69115-00ce-49e3-8bf9-48ef858e8631 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:51.292822 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199b380-daf7-4577-bb1e-981e6ace1758 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:51.321305 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:51.330018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0ef68-6a38-4378-ab8f-a05c3f175ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:51.331134 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0ef68-6a38-4378-ab8f-a05c3f175ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:51.331806 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0ef68-6a38-4378-ab8f-a05c3f175ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:51.332180 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0ef68-6a38-4378-ab8f-a05c3f175ce0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:51.402755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb69115-00ce-49e3-8bf9-48ef858e8631 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:51.408794 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0ef68-6a38-4378-ab8f-a05c3f175ce0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:51.409203 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0ef68-6a38-4378-ab8f-a05c3f175ce0 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:51.450565 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cf717-0a34-4144-8b12-806b8d0c1e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:51.451678 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cf717-0a34-4144-8b12-806b8d0c1e1f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:51.452195 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cf717-0a34-4144-8b12-806b8d0c1e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:51.455043 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cf717-0a34-4144-8b12-806b8d0c1e1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:51.512944 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:51.530125 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 219/432] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:51:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:51:51.536079 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0ef68-6a38-4378-ab8f-a05c3f175ce0 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:51.538496 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17cf717-0a34-4144-8b12-806b8d0c1e1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:51.540613 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17cf717-0a34-4144-8b12-806b8d0c1e1f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:51.563849 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:51.638876 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0ef68-6a38-4378-ab8f-a05c3f175ce0 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:51.654367 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 214/433] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:51:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:51:51.655580 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cf717-0a34-4144-8b12-806b8d0c1e1f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:51.675145 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d18e16-b36d-4dd7-83b6-569ab62a63b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:51.676023 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d18e16-b36d-4dd7-83b6-569ab62a63b7 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:51.676298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d18e16-b36d-4dd7-83b6-569ab62a63b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:51.676570 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d18e16-b36d-4dd7-83b6-569ab62a63b7 None admin] PATH_INFO: `/v3/projects/824de15367424616b3588eca8e09020e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:51.677746 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d18e16-b36d-4dd7-83b6-569ab62a63b7 None admin] RBAC: Authorizing `identity:get_project(project_id=824de15367424616b3588eca8e09020e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:51.679344 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d18e16-b36d-4dd7-83b6-569ab62a63b7 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:51.681065 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 220/434] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:51 2022] GET /identity/v3/projects/824de15367424616b3588eca8e09020e => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:51.684725 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa0a6b-6ace-4504-970c-381050121cb0 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:51.685014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa0a6b-6ace-4504-970c-381050121cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:51.685433 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa0a6b-6ace-4504-970c-381050121cb0 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:51.686675 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 221/435] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:51.687867 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6b891-eca8-49af-878b-25257dac7e71 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:51.688205 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6b891-eca8-49af-878b-25257dac7e71 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:51.688478 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6b891-eca8-49af-878b-25257dac7e71 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:51.689781 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 222/436] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:51.690406 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6b891-eca8-49af-878b-25257dac7e71 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:51.738727 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:51.760582 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cf717-0a34-4144-8b12-806b8d0c1e1f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:51.787732 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:51.794580 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2fd19b-6672-4a23-b0ce-7e400adcac99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:51.795078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6b891-eca8-49af-878b-25257dac7e71 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:51.795471 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fd19b-6672-4a23-b0ce-7e400adcac99 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:51.795764 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fd19b-6672-4a23-b0ce-7e400adcac99 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:51.796044 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fd19b-6672-4a23-b0ce-7e400adcac99 None admin] PATH_INFO: `/v3/projects/08189b6976bc4ea785ac0de443ab36e3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:51.797255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2fd19b-6672-4a23-b0ce-7e400adcac99 None admin] RBAC: Authorizing `identity:get_project(project_id=08189b6976bc4ea785ac0de443ab36e3)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:51.798706 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2fd19b-6672-4a23-b0ce-7e400adcac99 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:51.800430 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 215/437] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:51 2022] GET /identity/v3/projects/08189b6976bc4ea785ac0de443ab36e3 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:51.804464 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8636e74-4d33-4c13-b9e0-e64c604a833f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:51.804852 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8636e74-4d33-4c13-b9e0-e64c604a833f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:51.805141 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8636e74-4d33-4c13-b9e0-e64c604a833f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:51.821853 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a8636e74-4d33-4c13-b9e0-e64c604a833f None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:51.823035 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a8636e74-4d33-4c13-b9e0-e64c604a833f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:51.827816 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714274b1-ba80-479e-b29d-d121d9308624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:51.829157 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714274b1-ba80-479e-b29d-d121d9308624 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:51.829431 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714274b1-ba80-479e-b29d-d121d9308624 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:51.829697 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714274b1-ba80-479e-b29d-d121d9308624 None admin] PATH_INFO: `/v3/groups/390a56587cdb46cf9ed3442404df3b19` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:51.830850 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714274b1-ba80-479e-b29d-d121d9308624 None admin] RBAC: Authorizing `identity:get_group(group_id=390a56587cdb46cf9ed3442404df3b19)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:51.832294 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714274b1-ba80-479e-b29d-d121d9308624 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:51.838422 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 223/438] 10.222.0.24 () {56 vars in 1180 bytes} [Thu May 19 14:51:51 2022] GET /identity/v3/groups/390a56587cdb46cf9ed3442404df3b19 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:51.838422 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdeaec-e7ac-4be6-a64a-df88622d9344 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:51.838422 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdeaec-e7ac-4be6-a64a-df88622d9344 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:51.838422 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdeaec-e7ac-4be6-a64a-df88622d9344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:51.851725 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-04cdeaec-e7ac-4be6-a64a-df88622d9344 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:51.853091 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-04cdeaec-e7ac-4be6-a64a-df88622d9344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:51.887745 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 216/439] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:51.888580 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8636e74-4d33-4c13-b9e0-e64c604a833f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:51.919881 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 224/440] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:51.920892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cdeaec-e7ac-4be6-a64a-df88622d9344 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:51.964476 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:51.987778 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8636e74-4d33-4c13-b9e0-e64c604a833f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:52.021434 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:52.023031 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d1d36-6c7c-446a-8112-d435c0009a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:52.024008 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d1d36-6c7c-446a-8112-d435c0009a75 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:52.024287 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d1d36-6c7c-446a-8112-d435c0009a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:52.024571 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d1d36-6c7c-446a-8112-d435c0009a75 None admin] PATH_INFO: `/v3/groups/390a56587cdb46cf9ed3442404df3b19` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:52.025739 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d1d36-6c7c-446a-8112-d435c0009a75 None admin] RBAC: Authorizing `identity:get_group(group_id=390a56587cdb46cf9ed3442404df3b19)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:52.027190 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d1d36-6c7c-446a-8112-d435c0009a75 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:52.028000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cdeaec-e7ac-4be6-a64a-df88622d9344 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:52.028825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 217/441] 10.222.0.24 () {56 vars in 1180 bytes} [Thu May 19 14:51:51 2022] GET /identity/v3/groups/390a56587cdb46cf9ed3442404df3b19 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:52.029576 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d1d36-6c7c-446a-8112-d435c0009a75 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:52.068136 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db555f-95d0-4dc6-a1b4-30af2443c547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:52.068793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db555f-95d0-4dc6-a1b4-30af2443c547 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:52.069075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db555f-95d0-4dc6-a1b4-30af2443c547 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:52.069354 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db555f-95d0-4dc6-a1b4-30af2443c547 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:52.070187 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db555f-95d0-4dc6-a1b4-30af2443c547 None admin] RBAC: Adding query filter params (group.id=390a56587cdb46cf9ed3442404df3b19, role.id=fd5043dc9e3e4ec49e035ee01fc68854, scope.project.id=824de15367424616b3588eca8e09020e) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:52.070501 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db555f-95d0-4dc6-a1b4-30af2443c547 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:52.072985 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db555f-95d0-4dc6-a1b4-30af2443c547 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:52.082761 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 225/442] 10.222.0.24 () {56 vars in 1376 bytes} [Thu May 19 14:51:51 2022] GET /identity/v3/role_assignments?group.id=390a56587cdb46cf9ed3442404df3b19&scope.project.id=824de15367424616b3588eca8e09020e&role.id=fd5043dc9e3e4ec49e035ee01fc68854 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:52.083539 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db555f-95d0-4dc6-a1b4-30af2443c547 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:52.143534 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d1d36-6c7c-446a-8112-d435c0009a75 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:52.183086 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf24a6-1f84-4875-9d51-6a02f9333820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:52.184014 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf24a6-1f84-4875-9d51-6a02f9333820 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:52.184372 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf24a6-1f84-4875-9d51-6a02f9333820 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:52.184721 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf24a6-1f84-4875-9d51-6a02f9333820 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:52.197342 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf24a6-1f84-4875-9d51-6a02f9333820 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:52.201431 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db555f-95d0-4dc6-a1b4-30af2443c547 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:52.205790 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-66cf24a6-1f84-4875-9d51-6a02f9333820 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:52.205790 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:52.205790 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:52.205790 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:52.205790 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:52.205790 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:52.205790 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:52.205790 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:52.205790 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:52.205790 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:52.205790 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:52.205790 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:52.205790 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:52.205790 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:52.205790 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:52.205790 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:52.206735 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:52.206735 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:52.206735 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:52.206735 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:52.206735 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:52.206735 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:52.206735 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:52.206735 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:52.206735 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:52.206735 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:52.206735 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:52.206735 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:51:52.206735 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:52.206735 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:52.206735 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:52.206735 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:52.208016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:52.208016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:52.208016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:52.208016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:52.208016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:52.208016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:52.208016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:52.208016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:52.208016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:52.208016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:52.208016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:51:52.208016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:51:52.208016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 218/443] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:51:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:52.208961 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf24a6-1f84-4875-9d51-6a02f9333820 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:52.213890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:52.245270 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a26f0-33b9-4fd0-9748-3e1b7c5cc3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:52.246350 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a26f0-33b9-4fd0-9748-3e1b7c5cc3c6 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:52.246634 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a26f0-33b9-4fd0-9748-3e1b7c5cc3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:52.246918 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a26f0-33b9-4fd0-9748-3e1b7c5cc3c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:52.258447 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a26f0-33b9-4fd0-9748-3e1b7c5cc3c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:52.267283 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-0c7a26f0-33b9-4fd0-9748-3e1b7c5cc3c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:52.267283 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:52.267283 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:52.267283 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:52.267283 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:52.267283 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:52.267283 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:52.267283 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:52.267283 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:52.267283 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:52.267283 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:52.267283 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:52.267283 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:52.267283 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:52.267283 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:52.267283 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:52.268182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:52.268182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:52.268182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:52.268182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:52.268182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:52.268182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:52.268182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:52.268182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:52.268182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:52.268182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:52.268182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:52.268182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:51:52.268182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:52.268182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:52.268182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:52.268182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:52.268957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:52.268957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:52.268957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:52.268957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:52.268957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:52.268957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:52.268957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:52.268957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:52.268957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:52.268957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:52.268957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:52.268957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:51:52.268957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 226/444] 10.222.0.24 () {56 vars in 1114 bytes} [Thu May 19 14:51:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:52.269635 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a26f0-33b9-4fd0-9748-3e1b7c5cc3c6 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:52.293990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:52.347036 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf24a6-1f84-4875-9d51-6a02f9333820 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:52.383683 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f189153-130b-43bf-b096-be7633527053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:52.384355 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f189153-130b-43bf-b096-be7633527053 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:52.384650 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f189153-130b-43bf-b096-be7633527053 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:52.384937 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f189153-130b-43bf-b096-be7633527053 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:52.385778 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f189153-130b-43bf-b096-be7633527053 None admin] RBAC: Adding query filter params (group.id=390a56587cdb46cf9ed3442404df3b19, role.id=fd5043dc9e3e4ec49e035ee01fc68854, scope.project.id=08189b6976bc4ea785ac0de443ab36e3) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:52.386156 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f189153-130b-43bf-b096-be7633527053 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:52.387635 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f189153-130b-43bf-b096-be7633527053 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:52.395776 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 219/445] 10.222.0.24 () {56 vars in 1376 bytes} [Thu May 19 14:51:52 2022] GET /identity/v3/role_assignments?group.id=390a56587cdb46cf9ed3442404df3b19&scope.project.id=08189b6976bc4ea785ac0de443ab36e3&role.id=fd5043dc9e3e4ec49e035ee01fc68854 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:52.396604 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f189153-130b-43bf-b096-be7633527053 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:52.396950 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a26f0-33b9-4fd0-9748-3e1b7c5cc3c6 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:52.446566 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1ffd0-755e-4203-951c-76d400654336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:52.447160 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1ffd0-755e-4203-951c-76d400654336 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:52.447487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1ffd0-755e-4203-951c-76d400654336 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:52.447775 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1ffd0-755e-4203-951c-76d400654336 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:52.448515 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1ffd0-755e-4203-951c-76d400654336 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:52.448822 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1ffd0-755e-4203-951c-76d400654336 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:52.450210 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1ffd0-755e-4203-951c-76d400654336 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:52.460886 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 227/446] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:51:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:52.466242 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1ffd0-755e-4203-951c-76d400654336 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:52.491760 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:52.542682 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f189153-130b-43bf-b096-be7633527053 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:52.585290 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:52.594678 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f40b2b-e02a-4740-b9bc-b7a75c1ee635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:52.596024 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f40b2b-e02a-4740-b9bc-b7a75c1ee635 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:52.596024 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f40b2b-e02a-4740-b9bc-b7a75c1ee635 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:52.596024 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f40b2b-e02a-4740-b9bc-b7a75c1ee635 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:52.596891 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f40b2b-e02a-4740-b9bc-b7a75c1ee635 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:52.597211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f40b2b-e02a-4740-b9bc-b7a75c1ee635 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:52.598610 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f40b2b-e02a-4740-b9bc-b7a75c1ee635 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:52.608212 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 220/447] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:51:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:52.610586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1ffd0-755e-4203-951c-76d400654336 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:52.614417 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f40b2b-e02a-4740-b9bc-b7a75c1ee635 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:52.657255 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2742e-2dce-4f63-b0a7-d7ccf87ab3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:52.657919 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2742e-2dce-4f63-b0a7-d7ccf87ab3fa None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:52.658203 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2742e-2dce-4f63-b0a7-d7ccf87ab3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:52.658474 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2742e-2dce-4f63-b0a7-d7ccf87ab3fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:52.738572 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2742e-2dce-4f63-b0a7-d7ccf87ab3fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:52.740022 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2742e-2dce-4f63-b0a7-d7ccf87ab3fa None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:52.742078 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f40b2b-e02a-4740-b9bc-b7a75c1ee635 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:52.776643 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:52.783919 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f40a6d-a10a-429f-a1a6-8faacac360a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:52.784581 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f40a6d-a10a-429f-a1a6-8faacac360a4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:52.786792 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f40a6d-a10a-429f-a1a6-8faacac360a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:52.786792 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f40a6d-a10a-429f-a1a6-8faacac360a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:52.833263 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:52.860914 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 228/448] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:51:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:51:52.867371 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2742e-2dce-4f63-b0a7-d7ccf87ab3fa None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:52.874088 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f40a6d-a10a-429f-a1a6-8faacac360a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:52.875639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f40a6d-a10a-429f-a1a6-8faacac360a4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:52.967912 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2742e-2dce-4f63-b0a7-d7ccf87ab3fa None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:52.975447 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 221/449] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:51:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:51:52.980778 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f40a6d-a10a-429f-a1a6-8faacac360a4 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:53.003772 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4b109-8ef9-43e5-a587-f16ccbeb069c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:53.004561 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4b109-8ef9-43e5-a587-f16ccbeb069c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:53.004845 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4b109-8ef9-43e5-a587-f16ccbeb069c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:53.005117 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4b109-8ef9-43e5-a587-f16ccbeb069c None admin] PATH_INFO: `/v3/projects/55b46daee5c44a5cacdc54e48d280e5e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:53.006289 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4b109-8ef9-43e5-a587-f16ccbeb069c None admin] RBAC: Authorizing `identity:get_project(project_id=55b46daee5c44a5cacdc54e48d280e5e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:53.007901 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4b109-8ef9-43e5-a587-f16ccbeb069c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:53.009813 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:53.009923 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 229/450] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:52 2022] GET /identity/v3/projects/55b46daee5c44a5cacdc54e48d280e5e => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:53.015220 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4b109-8ef9-43e5-a587-f16ccbeb069c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:53.062506 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:53.078682 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f40a6d-a10a-429f-a1a6-8faacac360a4 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:53.113571 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927642cb-082c-41f9-9746-a9409dc4b08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:53.113990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4b109-8ef9-43e5-a587-f16ccbeb069c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:53.114420 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927642cb-082c-41f9-9746-a9409dc4b08c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:53.114701 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927642cb-082c-41f9-9746-a9409dc4b08c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:53.114975 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927642cb-082c-41f9-9746-a9409dc4b08c None admin] PATH_INFO: `/v3/projects/08189b6976bc4ea785ac0de443ab36e3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:53.116173 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927642cb-082c-41f9-9746-a9409dc4b08c None admin] RBAC: Authorizing `identity:get_project(project_id=08189b6976bc4ea785ac0de443ab36e3)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:53.117620 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927642cb-082c-41f9-9746-a9409dc4b08c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:53.119312 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 222/451] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:51:52 2022] GET /identity/v3/projects/08189b6976bc4ea785ac0de443ab36e3 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:53.125021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927642cb-082c-41f9-9746-a9409dc4b08c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:53.147323 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d33e26-25ae-4fce-99d7-50c070dbd7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:53.148177 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d33e26-25ae-4fce-99d7-50c070dbd7dd None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:53.148453 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d33e26-25ae-4fce-99d7-50c070dbd7dd None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:53.148721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d33e26-25ae-4fce-99d7-50c070dbd7dd None admin] PATH_INFO: `/v3/groups/2c29375965884354a2b22d67b5eddad0` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:53.149876 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d33e26-25ae-4fce-99d7-50c070dbd7dd None admin] RBAC: Authorizing `identity:get_group(group_id=2c29375965884354a2b22d67b5eddad0)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:53.151322 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d33e26-25ae-4fce-99d7-50c070dbd7dd None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:53.152913 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 230/452] 10.222.0.24 () {56 vars in 1180 bytes} [Thu May 19 14:51:53 2022] GET /identity/v3/groups/2c29375965884354a2b22d67b5eddad0 => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:53.159091 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d33e26-25ae-4fce-99d7-50c070dbd7dd None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:53.219186 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:53.222999 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927642cb-082c-41f9-9746-a9409dc4b08c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:53.257712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d33e26-25ae-4fce-99d7-50c070dbd7dd None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:53.258285 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92722248-db85-4a8d-9c70-d49dbd20f047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:53.259139 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92722248-db85-4a8d-9c70-d49dbd20f047 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:53.259454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92722248-db85-4a8d-9c70-d49dbd20f047 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:53.259728 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92722248-db85-4a8d-9c70-d49dbd20f047 None admin] PATH_INFO: `/v3/groups/390a56587cdb46cf9ed3442404df3b19` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:53.260913 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92722248-db85-4a8d-9c70-d49dbd20f047 None admin] RBAC: Authorizing `identity:get_group(group_id=390a56587cdb46cf9ed3442404df3b19)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:53.262353 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92722248-db85-4a8d-9c70-d49dbd20f047 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:53.263995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 223/453] 10.222.0.24 () {56 vars in 1180 bytes} [Thu May 19 14:51:53 2022] GET /identity/v3/groups/390a56587cdb46cf9ed3442404df3b19 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:53.269655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92722248-db85-4a8d-9c70-d49dbd20f047 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:53.273773 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:53.291582 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7f098-556d-4bfc-8e58-ccbcf62e8a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:53.292232 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7f098-556d-4bfc-8e58-ccbcf62e8a70 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:53.292523 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7f098-556d-4bfc-8e58-ccbcf62e8a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:53.292793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7f098-556d-4bfc-8e58-ccbcf62e8a70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:53.293615 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7f098-556d-4bfc-8e58-ccbcf62e8a70 None admin] RBAC: Adding query filter params (group.id=2c29375965884354a2b22d67b5eddad0, role.id=ec4b73b709ca4cdc983e35e955aed57a, scope.project.id=55b46daee5c44a5cacdc54e48d280e5e) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:53.293923 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7f098-556d-4bfc-8e58-ccbcf62e8a70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:53.295361 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7f098-556d-4bfc-8e58-ccbcf62e8a70 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:53.301471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 231/454] 10.222.0.24 () {56 vars in 1376 bytes} [Thu May 19 14:51:53 2022] GET /identity/v3/role_assignments?group.id=2c29375965884354a2b22d67b5eddad0&scope.project.id=55b46daee5c44a5cacdc54e48d280e5e&role.id=ec4b73b709ca4cdc983e35e955aed57a => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:53.374868 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92722248-db85-4a8d-9c70-d49dbd20f047 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:53.414640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab39ba-aedd-4e18-b472-bb67d65fb009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:53.415329 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab39ba-aedd-4e18-b472-bb67d65fb009 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:53.415613 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab39ba-aedd-4e18-b472-bb67d65fb009 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:53.415887 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab39ba-aedd-4e18-b472-bb67d65fb009 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:53.416727 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab39ba-aedd-4e18-b472-bb67d65fb009 None admin] RBAC: Adding query filter params (group.id=390a56587cdb46cf9ed3442404df3b19, role.id=9d41dc09d0f646b1994526fcbd8d3622, scope.project.id=08189b6976bc4ea785ac0de443ab36e3) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:53.417041 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab39ba-aedd-4e18-b472-bb67d65fb009 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:53.418494 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab39ba-aedd-4e18-b472-bb67d65fb009 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:53.424955 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 224/455] 10.222.0.24 () {56 vars in 1376 bytes} [Thu May 19 14:51:53 2022] GET /identity/v3/role_assignments?group.id=390a56587cdb46cf9ed3442404df3b19&scope.project.id=08189b6976bc4ea785ac0de443ab36e3&role.id=9d41dc09d0f646b1994526fcbd8d3622 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:51:56.322800 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f17316-5aff-42e6-b492-37294ce63c17 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:56.323315 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f17316-5aff-42e6-b492-37294ce63c17 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:56.323395 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f17316-5aff-42e6-b492-37294ce63c17 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:56.324751 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 232/456] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:56.340920 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb110f-1b6b-4670-abbd-d16bdbdbfeba None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:56.341394 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb110f-1b6b-4670-abbd-d16bdbdbfeba None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:56.341495 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb110f-1b6b-4670-abbd-d16bdbdbfeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:56.367310 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-45bb110f-1b6b-4670-abbd-d16bdbdbfeba None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:56.368511 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-45bb110f-1b6b-4670-abbd-d16bdbdbfeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:56.375450 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f6ab2-008c-4a0f-b99d-3a1fbc9d16cb None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:56.376089 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f6ab2-008c-4a0f-b99d-3a1fbc9d16cb None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:56.376655 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f6ab2-008c-4a0f-b99d-3a1fbc9d16cb None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:56.378545 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 233/457] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:56.384919 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0aac2-c951-4011-83a6-32ec880709cb None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:56.385537 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0aac2-c951-4011-83a6-32ec880709cb None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:56.386034 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0aac2-c951-4011-83a6-32ec880709cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:56.415596 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:56.419221 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-90e0aac2-c951-4011-83a6-32ec880709cb None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:56.419221 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-90e0aac2-c951-4011-83a6-32ec880709cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:56.493556 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 225/458] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:56.540694 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 234/459] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:51:56.547954 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb110f-1b6b-4670-abbd-d16bdbdbfeba None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:56.577690 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0aac2-c951-4011-83a6-32ec880709cb None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:56.728015 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb110f-1b6b-4670-abbd-d16bdbdbfeba None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:56.770856 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0aac2-c951-4011-83a6-32ec880709cb None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:56.774268 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e5dec-b94d-44dc-bd43-afbb75d07199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:56.774534 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e5dec-b94d-44dc-bd43-afbb75d07199 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:56.774829 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e5dec-b94d-44dc-bd43-afbb75d07199 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:56.775107 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e5dec-b94d-44dc-bd43-afbb75d07199 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:56.784822 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:56.787232 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e5dec-b94d-44dc-bd43-afbb75d07199 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:56.788723 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e5dec-b94d-44dc-bd43-afbb75d07199 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:56.813174 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c282b-b1ee-4035-b0ab-e44a989e2a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:56.813374 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-218e5dec-b94d-44dc-bd43-afbb75d07199 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:56.813374 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:56.813374 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:56.813374 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:56.813374 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:56.813374 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:56.813374 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:56.813374 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:56.813374 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:56.813374 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:56.813374 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:56.813374 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:56.813374 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:56.813374 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:56.813374 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:56.814204 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:56.814204 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:56.814204 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:56.814204 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:56.814204 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:56.814204 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:56.814204 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:56.814204 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:56.814204 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:51:56.814204 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:56.814204 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:56.814204 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:56.814204 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:56.814204 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:56.814204 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:56.814204 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:56.814204 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:56.815042 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:56.815042 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:56.815042 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:56.815042 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:51:56.815042 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 226/460] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:51:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:56.816274 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419f23f-ba59-44ab-b886-58a9a2502bb9 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:56.816564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419f23f-ba59-44ab-b886-58a9a2502bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:56.816842 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419f23f-ba59-44ab-b886-58a9a2502bb9 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:56.817272 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c282b-b1ee-4035-b0ab-e44a989e2a65 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:56.817740 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c282b-b1ee-4035-b0ab-e44a989e2a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:56.818213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c282b-b1ee-4035-b0ab-e44a989e2a65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:56.822648 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 227/461] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:56.824199 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419f23f-ba59-44ab-b886-58a9a2502bb9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:56.838270 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c282b-b1ee-4035-b0ab-e44a989e2a65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:56.840218 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c282b-b1ee-4035-b0ab-e44a989e2a65 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:56.847898 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:56.870075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-e22c282b-b1ee-4035-b0ab-e44a989e2a65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:56.870075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:56.870075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:56.870075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:56.870075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:56.870075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:56.870075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:56.870075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:56.870075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:56.870075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:56.870075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:56.870075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:56.870075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:56.870075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:56.870075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:56.871421 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:56.871421 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:56.871421 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:56.871421 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:56.871421 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:56.871421 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:56.871421 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:56.871421 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:56.871421 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:51:56.871421 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:56.871421 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:56.871421 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:56.871421 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:56.871421 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:56.871421 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:56.871421 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:56.871421 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:56.872461 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:56.872461 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:56.872461 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:56.872461 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:51:56.874249 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 235/462] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:51:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:51:56.880557 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce736e78-47bf-4f18-9c4b-50c6843a1d26 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:56.880557 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce736e78-47bf-4f18-9c4b-50c6843a1d26 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:56.880557 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce736e78-47bf-4f18-9c4b-50c6843a1d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:56.905960 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ce736e78-47bf-4f18-9c4b-50c6843a1d26 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:56.908463 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ce736e78-47bf-4f18-9c4b-50c6843a1d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:56.965515 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419f23f-ba59-44ab-b886-58a9a2502bb9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:56.995314 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 236/463] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:56.996458 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce736e78-47bf-4f18-9c4b-50c6843a1d26 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:57.005751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faefd38-78a0-4148-9f52-c661b37fb63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:57.006777 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faefd38-78a0-4148-9f52-c661b37fb63c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:57.007285 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faefd38-78a0-4148-9f52-c661b37fb63c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:57.007958 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faefd38-78a0-4148-9f52-c661b37fb63c None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:57.008887 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faefd38-78a0-4148-9f52-c661b37fb63c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:57.009415 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faefd38-78a0-4148-9f52-c661b37fb63c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:57.011174 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faefd38-78a0-4148-9f52-c661b37fb63c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:57.024360 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 228/464] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:57.026134 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dc9cd-3dc6-49fa-a398-10877d6a41f4 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:57.026626 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dc9cd-3dc6-49fa-a398-10877d6a41f4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:57.027229 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dc9cd-3dc6-49fa-a398-10877d6a41f4 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:57.028954 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 229/465] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:57.031140 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5dc9cd-3dc6-49fa-a398-10877d6a41f4 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:57.109921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:57.118299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:57.129607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce736e78-47bf-4f18-9c4b-50c6843a1d26 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:57.143237 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5dc9cd-3dc6-49fa-a398-10877d6a41f4 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:57.168525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fedf057-bb94-4ebe-8399-8f7af42e882b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:57.169641 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fedf057-bb94-4ebe-8399-8f7af42e882b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:57.170043 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fedf057-bb94-4ebe-8399-8f7af42e882b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:57.170325 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fedf057-bb94-4ebe-8399-8f7af42e882b None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:57.171223 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fedf057-bb94-4ebe-8399-8f7af42e882b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:57.172426 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fedf057-bb94-4ebe-8399-8f7af42e882b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:57.174092 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fedf057-bb94-4ebe-8399-8f7af42e882b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:57.177230 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772dca12-58d6-4a20-ae3e-bf3f61512036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:57.177909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772dca12-58d6-4a20-ae3e-bf3f61512036 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:57.178199 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772dca12-58d6-4a20-ae3e-bf3f61512036 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:57.178484 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772dca12-58d6-4a20-ae3e-bf3f61512036 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:57.179192 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772dca12-58d6-4a20-ae3e-bf3f61512036 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:57.181163 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772dca12-58d6-4a20-ae3e-bf3f61512036 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:57.190708 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 237/466] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:57.190708 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fedf057-bb94-4ebe-8399-8f7af42e882b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:57.203502 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 230/467] 10.222.0.24 () {60 vars in 1132 bytes} [Thu May 19 14:51:57 2022] POST /identity/v3/users => generated 246 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:51:57.213445 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2e61d-f4bb-4ca5-97c1-5d4b0fa00989 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:57.214051 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2e61d-f4bb-4ca5-97c1-5d4b0fa00989 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:57.214535 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2e61d-f4bb-4ca5-97c1-5d4b0fa00989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:57.245397 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-fad2e61d-f4bb-4ca5-97c1-5d4b0fa00989 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:57.248050 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fad2e61d-f4bb-4ca5-97c1-5d4b0fa00989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:57.328315 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fedf057-bb94-4ebe-8399-8f7af42e882b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:57.351922 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 231/468] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:57.354047 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2e61d-f4bb-4ca5-97c1-5d4b0fa00989 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:57.385563 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aea158-5c43-48c2-87e0-1943fa6135c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:57.386416 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aea158-5c43-48c2-87e0-1943fa6135c0 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:57.386776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aea158-5c43-48c2-87e0-1943fa6135c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:57.387126 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aea158-5c43-48c2-87e0-1943fa6135c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:57.404485 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aea158-5c43-48c2-87e0-1943fa6135c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:57.407240 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aea158-5c43-48c2-87e0-1943fa6135c0 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:57.425951 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-e4aea158-5c43-48c2-87e0-1943fa6135c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:57.425951 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:57.425951 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:57.425951 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:57.425951 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:57.425951 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:57.425951 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:57.425951 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:57.425951 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:57.425951 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:57.425951 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:57.425951 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:57.425951 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:57.425951 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:57.425951 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:57.426954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:57.426954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:57.426954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:57.426954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:57.426954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:57.426954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:57.426954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:57.426954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:57.426954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:51:57.426954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:57.426954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:57.426954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:57.426954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:57.426954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:57.426954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:57.426954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:57.426954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:57.427850 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:57.427850 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:57.427850 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:57.427850 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:51:57.433202 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 238/469] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:51:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:57.433341 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:57.433438 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aea158-5c43-48c2-87e0-1943fa6135c0 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:57.437351 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:57.488683 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2e61d-f4bb-4ca5-97c1-5d4b0fa00989 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:57.528580 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa2908-6472-46b4-a417-f83a2dc7a861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:57.529861 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa2908-6472-46b4-a417-f83a2dc7a861 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:57.530369 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa2908-6472-46b4-a417-f83a2dc7a861 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:57.530978 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa2908-6472-46b4-a417-f83a2dc7a861 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:57.532957 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa2908-6472-46b4-a417-f83a2dc7a861 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:57.534851 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa2908-6472-46b4-a417-f83a2dc7a861 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:57.550691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aea158-5c43-48c2-87e0-1943fa6135c0 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:57.558933 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 232/470] 10.222.0.24 () {60 vars in 1132 bytes} [Thu May 19 14:51:57 2022] POST /identity/v3/users => generated 248 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:51:57.559978 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa2908-6472-46b4-a417-f83a2dc7a861 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:57.592196 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d990f-b24d-4462-922e-7de46bd80314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:57.593060 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d990f-b24d-4462-922e-7de46bd80314 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:57.593430 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d990f-b24d-4462-922e-7de46bd80314 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:57.594222 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d990f-b24d-4462-922e-7de46bd80314 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:57.608571 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d990f-b24d-4462-922e-7de46bd80314 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:57.610981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d990f-b24d-4462-922e-7de46bd80314 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:57.635070 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-aa4d990f-b24d-4462-922e-7de46bd80314 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:57.635070 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:57.635070 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:57.635070 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:57.635070 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:57.635070 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:57.635070 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:57.635070 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:57.635070 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:57.635070 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:57.635070 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:57.635070 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:57.635070 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:51:57.635070 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:51:57.635070 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:51:57.636202 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:51:57.636202 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:57.636202 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:57.636202 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:57.636202 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:57.636202 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:57.636202 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:57.636202 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:57.636202 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:51:57.636202 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:57.636202 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:57.636202 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:57.636202 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:57.636202 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:57.636202 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:57.636202 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:57.636202 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:57.637260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:51:57.637260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:51:57.637260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:51:57.637260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:51:57.639786 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 239/471] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:51:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:57.642236 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e42f04-0333-4f53-858b-fc1aeeb57703 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:57.642666 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e42f04-0333-4f53-858b-fc1aeeb57703 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:57.643081 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e42f04-0333-4f53-858b-fc1aeeb57703 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:57.645218 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 240/472] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:57.646081 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e42f04-0333-4f53-858b-fc1aeeb57703 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:57.703877 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa2908-6472-46b4-a417-f83a2dc7a861 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:57.720011 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:57.729552 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:57.746025 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b3724-78cc-4e37-96c2-7f266dfe5aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:57.746564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b3724-78cc-4e37-96c2-7f266dfe5aaa None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:57.746917 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b3724-78cc-4e37-96c2-7f266dfe5aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:57.747288 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b3724-78cc-4e37-96c2-7f266dfe5aaa None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:57.748102 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b3724-78cc-4e37-96c2-7f266dfe5aaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:57.748489 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b3724-78cc-4e37-96c2-7f266dfe5aaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:57.750116 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b3724-78cc-4e37-96c2-7f266dfe5aaa None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:57.763358 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 233/473] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:57.765219 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3113dd9-bece-4054-8230-f2b20e9fcce9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:57.767337 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3113dd9-bece-4054-8230-f2b20e9fcce9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:57.767765 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3113dd9-bece-4054-8230-f2b20e9fcce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:57.791298 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e3113dd9-bece-4054-8230-f2b20e9fcce9 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:57.792697 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e3113dd9-bece-4054-8230-f2b20e9fcce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:51:57.795297 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e42f04-0333-4f53-858b-fc1aeeb57703 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:57.843563 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723a524-4772-487c-8a51-b93a327e3c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:57.844783 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723a524-4772-487c-8a51-b93a327e3c86 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:57.845054 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723a524-4772-487c-8a51-b93a327e3c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:57.845325 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723a524-4772-487c-8a51-b93a327e3c86 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:57.846048 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723a524-4772-487c-8a51-b93a327e3c86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:57.846351 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723a524-4772-487c-8a51-b93a327e3c86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:57.847748 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723a524-4772-487c-8a51-b93a327e3c86 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:57.863304 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 241/474] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:57.863945 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723a524-4772-487c-8a51-b93a327e3c86 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:57.873681 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 234/475] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:51:57.874613 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3113dd9-bece-4054-8230-f2b20e9fcce9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:57.980649 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3113dd9-bece-4054-8230-f2b20e9fcce9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:57.983996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:58.000954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723a524-4772-487c-8a51-b93a327e3c86 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:58.021714 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbe010-79a8-4425-abf2-9c11a32ab3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:58.022484 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbe010-79a8-4425-abf2-9c11a32ab3a7 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:58.022849 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbe010-79a8-4425-abf2-9c11a32ab3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:58.023129 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbe010-79a8-4425-abf2-9c11a32ab3a7 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:58.023971 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbe010-79a8-4425-abf2-9c11a32ab3a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:58.025503 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbe010-79a8-4425-abf2-9c11a32ab3a7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:58.027639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:58.045262 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af59a31-9243-4fc3-b506-4ab40ee3f1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:58.046432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af59a31-9243-4fc3-b506-4ab40ee3f1eb None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:58.047529 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af59a31-9243-4fc3-b506-4ab40ee3f1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:58.048029 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af59a31-9243-4fc3-b506-4ab40ee3f1eb None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:58.049039 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af59a31-9243-4fc3-b506-4ab40ee3f1eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:58.050735 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af59a31-9243-4fc3-b506-4ab40ee3f1eb None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:58.052123 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 235/476] 10.222.0.24 () {60 vars in 1132 bytes} [Thu May 19 14:51:57 2022] POST /identity/v3/users => generated 249 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:51:58.053233 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbe010-79a8-4425-abf2-9c11a32ab3a7 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:58.100789 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 242/477] 10.222.0.24 () {60 vars in 1132 bytes} [Thu May 19 14:51:57 2022] POST /identity/v3/users => generated 248 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:51:58.170315 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbe010-79a8-4425-abf2-9c11a32ab3a7 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:58.208452 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7fe1af-3015-4dd7-9ea2-b64e1e7e462b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:58.209151 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fe1af-3015-4dd7-9ea2-b64e1e7e462b None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:58.209438 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fe1af-3015-4dd7-9ea2-b64e1e7e462b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:58.209717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fe1af-3015-4dd7-9ea2-b64e1e7e462b None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:58.210487 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7fe1af-3015-4dd7-9ea2-b64e1e7e462b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:58.211914 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7fe1af-3015-4dd7-9ea2-b64e1e7e462b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:58.220107 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.sql.core [None req-dc7fe1af-3015-4dd7-9ea2-b64e1e7e462b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 14:51:58.220107 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 14:51:58.220107 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [parameters: {'id': '7810346a4d9c4fbc9b86331b3d6621c5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 14:51:58.220107 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80158) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 14:51:58.238210 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-dc7fe1af-3015-4dd7-9ea2-b64e1e7e462b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 14:51:58.238210 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:58.238210 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 14:51:58.238210 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 14:51:58.238210 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 14:51:58.238210 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 14:51:58.238210 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 14:51:58.238210 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application result = self._query(query) May 19 14:51:58.238210 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 14:51:58.238210 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application conn.query(q) May 19 14:51:58.238210 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 14:51:58.238210 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 14:51:58.238210 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 14:51:58.238210 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application result.read() May 19 14:51:58.238210 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 14:51:58.239109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 14:51:58.239109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 14:51:58.239109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 14:51:58.239109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 14:51:58.239109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 14:51:58.239109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 14:51:58.239109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 14:51:58.239109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 14:51:58.239109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:51:58.239109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 14:51:58.239109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:51:58.239109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:58.239109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 14:51:58.239109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 14:51:58.239109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 19 14:51:58.239109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return ref.to_dict() May 19 14:51:58.239109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 14:51:58.239109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application next(self.gen) May 19 14:51:58.240376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 14:51:58.240376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application yield resource May 19 14:51:58.240376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 14:51:58.240376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application next(self.gen) May 19 14:51:58.240376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 14:51:58.240376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.session.rollback() May 19 14:51:58.240376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 14:51:58.240376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.force_reraise() May 19 14:51:58.240376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 14:51:58.240376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise self.value May 19 14:51:58.240376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 14:51:58.240376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 14:51:58.240376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 14:51:58.240376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application session.commit() May 19 14:51:58.240376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 14:51:58.240376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 14:51:58.240376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 14:51:58.241435 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._prepare_impl() May 19 14:51:58.241435 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 14:51:58.241435 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.session.flush() May 19 14:51:58.241435 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 14:51:58.241435 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._flush(objects) May 19 14:51:58.241435 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 14:51:58.241435 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 14:51:58.241435 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 14:51:58.241435 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application compat.raise_( May 19 14:51:58.241435 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 14:51:58.241435 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception May 19 14:51:58.241435 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 14:51:58.241435 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application flush_context.execute() May 19 14:51:58.241435 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 14:51:58.241435 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rec.execute(self) May 19 14:51:58.241435 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 14:51:58.241435 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 14:51:58.242290 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 14:51:58.242290 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 14:51:58.242290 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 14:51:58.242290 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 14:51:58.242290 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 14:51:58.242290 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 14:51:58.242290 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 14:51:58.242290 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 14:51:58.242290 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 14:51:58.242290 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 14:51:58.242290 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 14:51:58.242290 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 14:51:58.242290 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 14:51:58.242290 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 14:51:58.242290 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 14:51:58.242290 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception May 19 14:51:58.243077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 14:51:58.243077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 14:51:58.243077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 14:51:58.243077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 14:51:58.243077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 14:51:58.243077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application result = self._query(query) May 19 14:51:58.243077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 14:51:58.243077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application conn.query(q) May 19 14:51:58.243077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 14:51:58.243077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 14:51:58.243077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 14:51:58.243077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application result.read() May 19 14:51:58.243077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 14:51:58.243077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 14:51:58.243077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 14:51:58.243077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 14:51:58.243910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 14:51:58.243910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 14:51:58.243910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 14:51:58.243910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 14:51:58.243910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 19 14:51:58.243910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 19 14:51:58.243910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [parameters: {'id': '7810346a4d9c4fbc9b86331b3d6621c5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 19 14:51:58.243910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 14:51:58.243910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:51:58.243910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:51:58.243910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:51:58.243910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:58.243910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:58.243910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:58.243910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:58.243910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:58.244936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:58.244936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:58.244936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:58.244936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:58.244936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:58.244936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:58.244936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 19 14:51:58.244936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 19 14:51:58.244936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:58.244936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:58.244936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 19 14:51:58.244936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 19 14:51:58.244936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 14:51:58.244936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 14:51:58.244936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 19 14:51:58.244936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:51:58.245999 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 236/478] 10.222.0.24 () {60 vars in 1131 bytes} [Thu May 19 14:51:58 2022] POST /identity/v3/roles => generated 144 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:58.247161 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af59a31-9243-4fc3-b506-4ab40ee3f1eb None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:58.421709 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af59a31-9243-4fc3-b506-4ab40ee3f1eb None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:58.456663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5311b8-3727-433f-b5d8-5d529c6339c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:58.457480 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5311b8-3727-433f-b5d8-5d529c6339c8 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:58.457761 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5311b8-3727-433f-b5d8-5d529c6339c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:58.458036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5311b8-3727-433f-b5d8-5d529c6339c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:58.469620 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5311b8-3727-433f-b5d8-5d529c6339c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:51:58.477778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-3d5311b8-3727-433f-b5d8-5d529c6339c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:58.477778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:51:58.477778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:51:58.477778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:51:58.477778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:51:58.477778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:51:58.477778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:51:58.477778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:51:58.477778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:51:58.477778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:51:58.477778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:51:58.477778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:51:58.477778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:51:58.477778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:51:58.477778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:51:58.477778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:51:58.478647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:51:58.478647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:51:58.478647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:51:58.478647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:51:58.478647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:51:58.478647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:51:58.478647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:51:58.478647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:51:58.478647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:51:58.478647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:51:58.478647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:51:58.478647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:51:58.478647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:51:58.478647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:51:58.478647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:51:58.478647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:51:58.479907 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:51:58.479907 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:51:58.479907 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:51:58.479907 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:51:58.479907 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:51:58.479907 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:51:58.479907 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:51:58.479907 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:51:58.479907 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:51:58.479907 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:51:58.479907 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 19 14:51:58.479907 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:51:58.479907 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 243/479] 10.222.0.24 () {56 vars in 1114 bytes} [Thu May 19 14:51:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:51:58.484891 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7fe1af-3015-4dd7-9ea2-b64e1e7e462b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:51:58.524212 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:51:58.614191 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7fe1af-3015-4dd7-9ea2-b64e1e7e462b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:51:58.664095 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5fbee-0727-4de8-bcc0-e263f2d413e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:51:58.664836 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5fbee-0727-4de8-bcc0-e263f2d413e5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:58.665125 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5fbee-0727-4de8-bcc0-e263f2d413e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:58.665460 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5fbee-0727-4de8-bcc0-e263f2d413e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:58.666222 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5fbee-0727-4de8-bcc0-e263f2d413e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:51:58.666538 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5fbee-0727-4de8-bcc0-e263f2d413e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:51:58.667949 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5fbee-0727-4de8-bcc0-e263f2d413e5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:51:58.681236 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 237/480] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:51:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:51:59.923888 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af2b51-a5f2-48af-9d78-3ce06582bbb7 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:59.924400 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af2b51-a5f2-48af-9d78-3ce06582bbb7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:59.924475 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af2b51-a5f2-48af-9d78-3ce06582bbb7 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:59.926070 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 244/481] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:51:59.937607 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f147d5-bca0-4999-b892-781dd4e84677 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:51:59.938045 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f147d5-bca0-4999-b892-781dd4e84677 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:51:59.938219 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f147d5-bca0-4999-b892-781dd4e84677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:51:59.960150 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-02f147d5-bca0-4999-b892-781dd4e84677 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:51:59.961340 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-02f147d5-bca0-4999-b892-781dd4e84677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:00.038697 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 238/482] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:51:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:52:00.073124 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af2b51-a5f2-48af-9d78-3ce06582bbb7 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:00.114147 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:00.220190 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af2b51-a5f2-48af-9d78-3ce06582bbb7 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:00.267905 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a42560-1f61-4253-9a80-553ee2634964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:00.268709 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a42560-1f61-4253-9a80-553ee2634964 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:00.268993 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a42560-1f61-4253-9a80-553ee2634964 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:00.269269 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a42560-1f61-4253-9a80-553ee2634964 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:00.280960 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a42560-1f61-4253-9a80-553ee2634964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:00.291687 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-50a42560-1f61-4253-9a80-553ee2634964 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:00.291687 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:00.291687 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:00.291687 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:00.291687 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:00.291687 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:00.291687 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:00.291687 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:00.291687 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:00.291687 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:00.291687 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:00.291687 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:00.291687 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:00.291687 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:00.291687 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:00.291687 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:00.293500 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:00.293500 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:00.293500 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:00.293500 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:00.293500 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:00.293500 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:00.293500 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:00.293500 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:00.293500 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:00.293500 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:00.293500 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:00.293500 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:00.293500 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:00.293500 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:00.293500 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:00.293500 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:00.294843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:00.294843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:00.294843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:00.294843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:00.294843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:00.294843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:00.294843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:00.294843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:00.294843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:00.294843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:00.294843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:00.294843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:00.294843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 245/483] 10.222.0.24 () {56 vars in 1102 bytes} [Thu May 19 14:52:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:00.299264 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f147d5-bca0-4999-b892-781dd4e84677 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:00.321219 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:00.387884 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542abc4-0e52-4f18-a646-6bb8973624b8 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:00.388229 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542abc4-0e52-4f18-a646-6bb8973624b8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:00.388448 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542abc4-0e52-4f18-a646-6bb8973624b8 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:00.390075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 246/484] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:52:00.396791 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc7d37-77a9-4930-b720-dc5f72747d95 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:00.397070 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc7d37-77a9-4930-b720-dc5f72747d95 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:00.397349 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc7d37-77a9-4930-b720-dc5f72747d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:00.420924 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-decc7d37-77a9-4930-b720-dc5f72747d95 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:00.422753 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-decc7d37-77a9-4930-b720-dc5f72747d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:00.461177 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f147d5-bca0-4999-b892-781dd4e84677 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:00.532009 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576e634-ad31-442f-9bdd-81d03d8f7f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:00.532615 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576e634-ad31-442f-9bdd-81d03d8f7f1d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:00.532887 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 247/485] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:52:00.532995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576e634-ad31-442f-9bdd-81d03d8f7f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:00.533164 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576e634-ad31-442f-9bdd-81d03d8f7f1d None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:00.533919 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576e634-ad31-442f-9bdd-81d03d8f7f1d None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:00.534225 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576e634-ad31-442f-9bdd-81d03d8f7f1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:00.535635 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576e634-ad31-442f-9bdd-81d03d8f7f1d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:00.550450 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 239/486] 10.222.0.24 () {56 vars in 1103 bytes} [Thu May 19 14:52:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:00.556055 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc7d37-77a9-4930-b720-dc5f72747d95 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:00.558180 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576e634-ad31-442f-9bdd-81d03d8f7f1d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:00.583663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:00.711381 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc7d37-77a9-4930-b720-dc5f72747d95 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:00.747741 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b207174c-7137-4e11-9908-ef32b6e83ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:00.749182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207174c-7137-4e11-9908-ef32b6e83ddc None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:00.749743 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207174c-7137-4e11-9908-ef32b6e83ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:00.750276 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207174c-7137-4e11-9908-ef32b6e83ddc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:00.760708 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:00.762648 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b207174c-7137-4e11-9908-ef32b6e83ddc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:00.764378 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b207174c-7137-4e11-9908-ef32b6e83ddc None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:00.784595 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-b207174c-7137-4e11-9908-ef32b6e83ddc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:00.784595 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:00.784595 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:00.784595 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:00.784595 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:00.784595 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:00.784595 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:00.784595 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:00.784595 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:00.784595 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:00.784595 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:00.784595 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:00.784595 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:00.784595 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:00.784595 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:00.785458 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:00.785458 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:00.785458 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:00.785458 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:00.785458 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:00.785458 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:00.785458 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:00.785458 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:00.785458 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:00.785458 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:00.785458 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:00.785458 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:00.785458 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:00.785458 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:00.785458 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:00.785458 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:00.785458 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:00.786295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:00.786295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:00.786295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:00.786295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:00.788312 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 248/487] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:00.795941 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b207174c-7137-4e11-9908-ef32b6e83ddc None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:00.822362 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576e634-ad31-442f-9bdd-81d03d8f7f1d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:00.859892 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2f563-518e-4147-ac41-97332ebdda34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:00.861116 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2f563-518e-4147-ac41-97332ebdda34 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:00.861609 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2f563-518e-4147-ac41-97332ebdda34 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:00.862111 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2f563-518e-4147-ac41-97332ebdda34 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:00.875664 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2f563-518e-4147-ac41-97332ebdda34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:00.884318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-8bc2f563-518e-4147-ac41-97332ebdda34 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:00.884318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:00.884318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:00.884318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:00.884318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:00.884318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:00.884318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:00.884318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:00.884318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:00.884318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:00.884318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:00.884318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:00.884318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:00.884318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:00.884318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:00.884318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:00.885321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:00.885321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:00.885321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:00.885321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:00.885321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:00.885321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:00.885321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:00.885321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:00.885321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:00.885321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:00.885321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:00.885321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:00.885321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:00.885321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:00.885321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:00.885321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:00.886124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:00.886124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:00.886124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:00.886124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:00.886124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:00.886124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:00.886124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:00.886124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:00.886124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:00.886124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:00.886124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:00.886124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:00.889126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 240/488] 10.222.0.24 () {56 vars in 1102 bytes} [Thu May 19 14:52:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:00.898558 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2f563-518e-4147-ac41-97332ebdda34 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:00.925268 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:00.970861 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b207174c-7137-4e11-9908-ef32b6e83ddc None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:01.020629 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be2b88-e822-4a3a-a604-7b4da1309553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:01.021316 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be2b88-e822-4a3a-a604-7b4da1309553 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:01.021604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be2b88-e822-4a3a-a604-7b4da1309553 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:01.021877 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be2b88-e822-4a3a-a604-7b4da1309553 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:01.022611 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be2b88-e822-4a3a-a604-7b4da1309553 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:01.022920 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be2b88-e822-4a3a-a604-7b4da1309553 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:01.024324 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be2b88-e822-4a3a-a604-7b4da1309553 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:01.034439 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2f563-518e-4147-ac41-97332ebdda34 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:01.036760 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 249/489] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:01.041977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be2b88-e822-4a3a-a604-7b4da1309553 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:01.073322 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e726a3-7703-418d-aa11-46746bb7c79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:01.074453 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e726a3-7703-418d-aa11-46746bb7c79d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:01.074954 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e726a3-7703-418d-aa11-46746bb7c79d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:01.075458 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e726a3-7703-418d-aa11-46746bb7c79d None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:01.076465 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e726a3-7703-418d-aa11-46746bb7c79d None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:01.077002 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e726a3-7703-418d-aa11-46746bb7c79d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:01.079185 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e726a3-7703-418d-aa11-46746bb7c79d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:01.085091 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:01.090379 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 241/490] 10.222.0.24 () {56 vars in 1103 bytes} [Thu May 19 14:52:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:01.097415 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e726a3-7703-418d-aa11-46746bb7c79d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:01.191579 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be2b88-e822-4a3a-a604-7b4da1309553 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:01.232744 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e726a3-7703-418d-aa11-46746bb7c79d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:01.236751 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881166ae-f04d-4c53-ae5c-4227362f06a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:01.237780 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881166ae-f04d-4c53-ae5c-4227362f06a2 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:01.238271 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881166ae-f04d-4c53-ae5c-4227362f06a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:01.238779 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881166ae-f04d-4c53-ae5c-4227362f06a2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:01.241546 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:01.251890 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881166ae-f04d-4c53-ae5c-4227362f06a2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:01.254098 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881166ae-f04d-4c53-ae5c-4227362f06a2 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:01.272164 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5323e-f602-484f-88fd-0b35b6b2e18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:01.273018 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5323e-f602-484f-88fd-0b35b6b2e18c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:01.273308 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5323e-f602-484f-88fd-0b35b6b2e18c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:01.273588 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5323e-f602-484f-88fd-0b35b6b2e18c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:01.276051 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-881166ae-f04d-4c53-ae5c-4227362f06a2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:52:01.276051 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:01.276051 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:01.276051 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:01.276051 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:01.276051 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:01.276051 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:01.276051 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:01.276051 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:01.276051 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:01.276051 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:01.276051 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:01.276051 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:01.276051 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:01.276051 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:01.276051 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:01.276921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:01.276921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:01.276921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:01.276921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:01.276921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:01.276921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:01.276921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:01.276921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:01.276921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:01.276921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:01.276921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:01.276921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:01.276921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:01.276921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:01.276921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:01.276921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:01.276921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:01.276921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:01.277802 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:01.277802 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:01.277802 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:01.277802 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:01.277802 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:01.277802 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:01.277802 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:01.277802 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:01.277802 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:52:01.277802 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:01.280391 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 250/491] 10.222.0.24 () {56 vars in 1093 bytes} [Thu May 19 14:52:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:01.281903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a17bda-6470-48fe-a709-a85d0b469a3f None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:01.282323 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a17bda-6470-48fe-a709-a85d0b469a3f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:01.282754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a17bda-6470-48fe-a709-a85d0b469a3f None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:01.284173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 251/492] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:01.285766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a17bda-6470-48fe-a709-a85d0b469a3f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:01.297400 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5323e-f602-484f-88fd-0b35b6b2e18c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:01.299031 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5323e-f602-484f-88fd-0b35b6b2e18c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:01.325545 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-37e5323e-f602-484f-88fd-0b35b6b2e18c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:01.325545 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:01.325545 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:01.325545 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:01.325545 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:01.325545 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:01.325545 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:01.325545 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:01.325545 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:01.325545 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:01.325545 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:01.325545 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:01.325545 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:01.325545 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:01.325545 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:01.326630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:01.326630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:01.326630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:01.326630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:01.326630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:01.326630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:01.326630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:01.326630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:01.326630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:01.326630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:01.326630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:01.326630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:01.326630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:01.326630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:01.326630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:01.326630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:01.326630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:01.327543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:01.327543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:01.327543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:01.327543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:01.329337 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 242/493] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:01.331618 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537173b-0e14-4b8d-99f8-c1a167a0760c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:01.332057 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537173b-0e14-4b8d-99f8-c1a167a0760c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:01.332485 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5537173b-0e14-4b8d-99f8-c1a167a0760c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:01.355958 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-5537173b-0e14-4b8d-99f8-c1a167a0760c None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:01.357208 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5537173b-0e14-4b8d-99f8-c1a167a0760c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:01.414208 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:01.420576 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a17bda-6470-48fe-a709-a85d0b469a3f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:01.436582 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 243/494] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:52:01.438721 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7915d-0ed4-4b08-b0ad-2c5742499389 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:01.439236 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7915d-0ed4-4b08-b0ad-2c5742499389 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:01.439714 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7915d-0ed4-4b08-b0ad-2c5742499389 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:01.445073 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 244/495] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:01.445073 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7915d-0ed4-4b08-b0ad-2c5742499389 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:01.466174 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0059552-086d-4bd8-9c01-5c54da992091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:01.466840 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0059552-086d-4bd8-9c01-5c54da992091 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:01.467124 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0059552-086d-4bd8-9c01-5c54da992091 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:01.467431 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0059552-086d-4bd8-9c01-5c54da992091 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:01.468302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0059552-086d-4bd8-9c01-5c54da992091 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:01.468643 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0059552-086d-4bd8-9c01-5c54da992091 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:01.470085 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0059552-086d-4bd8-9c01-5c54da992091 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:01.515676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 252/496] 10.222.0.24 () {56 vars in 1133 bytes} [Thu May 19 14:52:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:01.515676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bc4b2-eef9-46b5-af4a-2558983a64c0 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:01.515676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bc4b2-eef9-46b5-af4a-2558983a64c0 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:01.515676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bc4b2-eef9-46b5-af4a-2558983a64c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:01.530608 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-602bc4b2-eef9-46b5-af4a-2558983a64c0 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:01.531906 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-602bc4b2-eef9-46b5-af4a-2558983a64c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:01.565089 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7915d-0ed4-4b08-b0ad-2c5742499389 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:01.582838 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:01.603655 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 253/497] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:52:01.604833 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bc4b2-eef9-46b5-af4a-2558983a64c0 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:01.613080 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666bc568-2b09-47a7-9308-1a13dce4bc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:01.614026 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bc568-2b09-47a7-9308-1a13dce4bc6a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:01.614527 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bc568-2b09-47a7-9308-1a13dce4bc6a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:01.615000 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bc568-2b09-47a7-9308-1a13dce4bc6a None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:01.616159 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666bc568-2b09-47a7-9308-1a13dce4bc6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:01.616706 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666bc568-2b09-47a7-9308-1a13dce4bc6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:01.618495 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666bc568-2b09-47a7-9308-1a13dce4bc6a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:01.636659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 245/498] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:01.637816 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666bc568-2b09-47a7-9308-1a13dce4bc6a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:01.683057 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:01.723792 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bc4b2-eef9-46b5-af4a-2558983a64c0 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:01.749078 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666bc568-2b09-47a7-9308-1a13dce4bc6a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:01.757996 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279943d1-1ad7-421e-ba1a-6c4028433124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:01.758787 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279943d1-1ad7-421e-ba1a-6c4028433124 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:01.759068 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279943d1-1ad7-421e-ba1a-6c4028433124 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:01.759385 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279943d1-1ad7-421e-ba1a-6c4028433124 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:01.769249 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279943d1-1ad7-421e-ba1a-6c4028433124 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:01.781506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5f8ec-1c1c-4dd4-ab0d-03fce937208e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:01.782197 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5f8ec-1c1c-4dd4-ab0d-03fce937208e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:01.782484 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5f8ec-1c1c-4dd4-ab0d-03fce937208e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:01.782571 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-279943d1-1ad7-421e-ba1a-6c4028433124 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:01.782571 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:01.782571 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:01.782571 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:01.782571 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:01.782571 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:01.782571 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:01.782571 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:01.782571 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:01.782571 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:01.782571 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:01.782571 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:01.782571 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:01.782571 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:01.782571 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:01.782571 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:01.783632 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:01.783632 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:01.783632 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:01.783632 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:01.783632 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:01.783632 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:01.783632 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:01.783632 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:01.783632 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:01.783632 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:01.783632 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:01.783632 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:01.783632 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:01.783632 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:01.783632 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:01.783632 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:01.784451 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:01.784451 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:01.784451 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:01.784451 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:01.784451 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:01.784451 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:01.784451 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:01.784451 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:01.784451 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:01.784451 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:01.784451 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:01.784451 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:01.785092 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5f8ec-1c1c-4dd4-ab0d-03fce937208e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:01.785159 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 254/499] 10.222.0.24 () {56 vars in 1102 bytes} [Thu May 19 14:52:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:01.785159 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279943d1-1ad7-421e-ba1a-6c4028433124 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:01.831172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:01.849267 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5f8ec-1c1c-4dd4-ab0d-03fce937208e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:01.850732 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5f8ec-1c1c-4dd4-ab0d-03fce937208e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:01.887876 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279943d1-1ad7-421e-ba1a-6c4028433124 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:01.890536 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:01.920801 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f159a5-c767-4568-be85-49d32550ca96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:01.921574 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f159a5-c767-4568-be85-49d32550ca96 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:01.922495 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f159a5-c767-4568-be85-49d32550ca96 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:01.922773 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f159a5-c767-4568-be85-49d32550ca96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:01.932599 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f159a5-c767-4568-be85-49d32550ca96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:01.940166 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-00f159a5-c767-4568-be85-49d32550ca96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:01.940166 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:01.940166 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:01.940166 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:01.940166 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:01.940166 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:01.940166 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:01.940166 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:01.940166 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:01.940166 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:01.940166 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:01.940166 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:01.940166 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:01.940166 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:01.940166 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:01.940166 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:01.941204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:01.941204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:01.941204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:01.941204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:01.941204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:01.941204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:01.941204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:01.941204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:01.941204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:01.941204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:01.941204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:01.941204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:01.941204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:01.941204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:01.941204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:01.941204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:01.942017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:01.942017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:01.942017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:01.942017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:01.942017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:01.942017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:01.942017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:01.942017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:01.942017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:01.942017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:01.942017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:01.942017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:01.942017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 255/500] 10.222.0.24 () {56 vars in 1102 bytes} [Thu May 19 14:52:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:01.942669 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f159a5-c767-4568-be85-49d32550ca96 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:01.952771 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 246/501] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:52:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:52:01.954280 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6573c54-b08a-4d9c-8e5a-6d815508480a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:01.954573 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6573c54-b08a-4d9c-8e5a-6d815508480a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:01.954941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6573c54-b08a-4d9c-8e5a-6d815508480a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:01.959434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 247/502] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:01.959434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6573c54-b08a-4d9c-8e5a-6d815508480a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:02.046427 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f159a5-c767-4568-be85-49d32550ca96 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:02.048572 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:02.066017 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6573c54-b08a-4d9c-8e5a-6d815508480a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:02.081110 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b3803-eb57-429d-8866-812f49a044ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:02.081946 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b3803-eb57-429d-8866-812f49a044ab None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:02.082174 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b3803-eb57-429d-8866-812f49a044ab None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:02.082441 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b3803-eb57-429d-8866-812f49a044ab None admin] PATH_INFO: `/v3/users/glance` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:02.089685 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b3803-eb57-429d-8866-812f49a044ab None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:02.091146 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39b3803-eb57-429d-8866-812f49a044ab None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:02.099345 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f7e11-8d02-4767-8f4d-7bab804c5423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:02.100016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f7e11-8d02-4767-8f4d-7bab804c5423 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:02.100307 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f7e11-8d02-4767-8f4d-7bab804c5423 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:02.100595 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f7e11-8d02-4767-8f4d-7bab804c5423 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:02.101340 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f7e11-8d02-4767-8f4d-7bab804c5423 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:02.101674 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f7e11-8d02-4767-8f4d-7bab804c5423 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:02.103035 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f7e11-8d02-4767-8f4d-7bab804c5423 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:02.105316 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-e39b3803-eb57-429d-8866-812f49a044ab None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 14:52:02.105316 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:02.105316 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:02.105316 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:02.105316 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:02.105316 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:02.105316 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:02.105316 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:02.105316 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:02.105316 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:02.105316 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:02.105316 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:02.105316 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:02.105316 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:02.105316 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:02.105316 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:02.106295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:02.106295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:02.106295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:02.106295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:02.106295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:02.106295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:02.106295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:02.106295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:02.106295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:02.106295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:02.106295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:02.106295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:02.106295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:02.106295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:02.106295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:02.106295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:02.106295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:02.106295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:02.107176 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:02.107176 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:02.107176 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:02.107176 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:02.107176 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:02.107176 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:02.107176 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:02.107176 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:02.107176 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 14:52:02.107176 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:02.107176 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 256/503] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:52:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:02.107766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b3803-eb57-429d-8866-812f49a044ab None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:02.112372 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 248/504] 10.222.0.24 () {56 vars in 1103 bytes} [Thu May 19 14:52:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:02.113200 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f7e11-8d02-4767-8f4d-7bab804c5423 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:02.116588 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:02.209595 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f7e11-8d02-4767-8f4d-7bab804c5423 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:02.209787 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b3803-eb57-429d-8866-812f49a044ab None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:02.241906 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa26b4-a5fc-4b0f-b08b-468dcb09e040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:02.242057 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf1092-1c3d-4d48-bf34-90fc08a6fb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:02.242656 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf1092-1c3d-4d48-bf34-90fc08a6fb78 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:02.242750 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa26b4-a5fc-4b0f-b08b-468dcb09e040 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:02.242933 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf1092-1c3d-4d48-bf34-90fc08a6fb78 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:02.243020 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa26b4-a5fc-4b0f-b08b-468dcb09e040 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:02.243224 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf1092-1c3d-4d48-bf34-90fc08a6fb78 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:02.243329 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa26b4-a5fc-4b0f-b08b-468dcb09e040 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:02.243977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf1092-1c3d-4d48-bf34-90fc08a6fb78 None admin] RBAC: Adding query filter params (name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:02.244253 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf1092-1c3d-4d48-bf34-90fc08a6fb78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:02.245887 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf1092-1c3d-4d48-bf34-90fc08a6fb78 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:02.253657 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 257/505] 10.222.0.24 () {56 vars in 1103 bytes} [Thu May 19 14:52:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:02.253830 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa26b4-a5fc-4b0f-b08b-468dcb09e040 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:02.254650 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3b16e-a71b-4651-acfd-19cfcf5f1232 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:02.254934 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3b16e-a71b-4651-acfd-19cfcf5f1232 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:02.255235 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3b16e-a71b-4651-acfd-19cfcf5f1232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:02.255388 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa26b4-a5fc-4b0f-b08b-468dcb09e040 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:02.271676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-8af3b16e-a71b-4651-acfd-19cfcf5f1232 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:02.272842 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8af3b16e-a71b-4651-acfd-19cfcf5f1232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:02.273685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-5cfa26b4-a5fc-4b0f-b08b-468dcb09e040 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:02.273685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:02.273685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:02.273685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:02.273685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:02.273685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:02.273685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:02.273685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:02.273685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:02.273685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:02.273685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:02.273685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:02.273685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:02.273685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:02.273685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:02.274608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:02.274608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:02.274608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:02.274608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:02.274608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:02.274608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:02.274608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:02.274608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:02.274608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:02.274608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:02.274608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:02.274608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:02.274608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:02.274608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:02.274608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:02.274608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:02.274608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:02.275512 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:02.275512 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:02.275512 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:02.275512 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:02.275512 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 249/506] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:02.275776 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa26b4-a5fc-4b0f-b08b-468dcb09e040 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:02.294567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:02.334710 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:02.352483 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 258/507] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:52:02.353789 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3b16e-a71b-4651-acfd-19cfcf5f1232 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:02.394129 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa26b4-a5fc-4b0f-b08b-468dcb09e040 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:02.427312 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7c8b4-b2f6-4db8-9c91-d21eae897db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:02.427984 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7c8b4-b2f6-4db8-9c91-d21eae897db7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:02.428273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7c8b4-b2f6-4db8-9c91-d21eae897db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:02.428554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7c8b4-b2f6-4db8-9c91-d21eae897db7 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:02.429384 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7c8b4-b2f6-4db8-9c91-d21eae897db7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:02.429695 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7c8b4-b2f6-4db8-9c91-d21eae897db7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:02.431125 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7c8b4-b2f6-4db8-9c91-d21eae897db7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:02.452379 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3b16e-a71b-4651-acfd-19cfcf5f1232 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:02.466509 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 250/508] 10.222.0.24 () {56 vars in 1137 bytes} [Thu May 19 14:52:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:02.467344 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7c8b4-b2f6-4db8-9c91-d21eae897db7 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:02.486439 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9a5b8-febb-449d-9702-86edad814200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:02.487253 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9a5b8-febb-449d-9702-86edad814200 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:02.487542 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9a5b8-febb-449d-9702-86edad814200 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:02.487813 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9a5b8-febb-449d-9702-86edad814200 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:02.497803 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9a5b8-febb-449d-9702-86edad814200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:02.499265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9a5b8-febb-449d-9702-86edad814200 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:02.517078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-0ed9a5b8-febb-449d-9702-86edad814200 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:02.517078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:02.517078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:02.517078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:02.517078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:02.517078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:02.517078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:02.517078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:02.517078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:02.517078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:02.517078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:02.517078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:02.517078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:02.517078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:02.517078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:02.517972 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:02.517972 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:02.517972 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:02.517972 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:02.517972 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:02.517972 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:02.517972 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:02.517972 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:02.517972 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:02.517972 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:02.517972 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:02.517972 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:02.517972 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:02.517972 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:02.517972 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:02.517972 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:02.517972 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:02.518803 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:02.518803 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:02.518803 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:02.518803 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:02.518803 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 259/509] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:02.519330 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9a5b8-febb-449d-9702-86edad814200 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:02.527268 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:02.570122 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7c8b4-b2f6-4db8-9c91-d21eae897db7 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:02.584271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:02.604317 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698edef2-10e8-4201-93a0-5e36d99886d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:02.605038 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698edef2-10e8-4201-93a0-5e36d99886d9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:02.605317 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698edef2-10e8-4201-93a0-5e36d99886d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:02.605588 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698edef2-10e8-4201-93a0-5e36d99886d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:02.615407 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698edef2-10e8-4201-93a0-5e36d99886d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:02.616347 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9a5b8-febb-449d-9702-86edad814200 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:02.616869 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698edef2-10e8-4201-93a0-5e36d99886d9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:02.634791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-698edef2-10e8-4201-93a0-5e36d99886d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:02.634791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:02.634791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:02.634791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:02.634791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:02.634791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:02.634791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:02.634791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:02.634791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:02.634791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:02.634791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:02.634791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:02.634791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:02.634791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:02.634791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:02.635671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:02.635671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:02.635671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:02.635671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:02.635671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:02.635671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:02.635671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:02.635671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:02.635671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:02.635671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:02.635671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:02.635671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:02.635671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:02.635671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:02.635671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:02.635671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:02.635671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:02.636546 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:02.636546 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:02.636546 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:02.636546 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:02.636546 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 251/510] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:02.636811 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698edef2-10e8-4201-93a0-5e36d99886d9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:02.650944 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b5204-5663-4059-93f6-947750e155f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:02.651628 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b5204-5663-4059-93f6-947750e155f6 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:02.651908 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b5204-5663-4059-93f6-947750e155f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:02.652180 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b5204-5663-4059-93f6-947750e155f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:02.652896 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b5204-5663-4059-93f6-947750e155f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:02.653200 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b5204-5663-4059-93f6-947750e155f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:02.654551 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b5204-5663-4059-93f6-947750e155f6 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:02.665892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 260/511] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:02.666663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b5204-5663-4059-93f6-947750e155f6 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:02.729502 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:02.734173 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698edef2-10e8-4201-93a0-5e36d99886d9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:02.764128 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b5204-5663-4059-93f6-947750e155f6 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:02.767715 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a3b1b-9d2d-4db1-8e24-37055e12c907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:02.768509 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a3b1b-9d2d-4db1-8e24-37055e12c907 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:02.768796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a3b1b-9d2d-4db1-8e24-37055e12c907 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:02.769073 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a3b1b-9d2d-4db1-8e24-37055e12c907 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:02.779258 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a3b1b-9d2d-4db1-8e24-37055e12c907 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:02.780717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a3b1b-9d2d-4db1-8e24-37055e12c907 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:02.796630 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d114d-b6c3-4699-950f-a2da9e4c83ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:02.797269 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d114d-b6c3-4699-950f-a2da9e4c83ae None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:02.797365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-ad4a3b1b-9d2d-4db1-8e24-37055e12c907 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:02.797365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:02.797365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:02.797365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:02.797365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:02.797365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:02.797365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:02.797365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:02.797365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:02.797365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:02.797365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:02.797365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:02.797365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:02.797365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:02.797365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:02.798289 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:02.798289 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:02.798289 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:02.798289 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:02.798289 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:02.798289 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:02.798289 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:02.798289 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:02.798289 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:02.798289 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:02.798289 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:02.798289 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:02.798289 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:02.798289 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:02.798289 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:02.798289 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:02.798289 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:02.799135 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:02.799135 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:02.799135 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:02.799135 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:02.799632 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d114d-b6c3-4699-950f-a2da9e4c83ae None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:02.799632 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d114d-b6c3-4699-950f-a2da9e4c83ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:02.799766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 252/512] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:02.799766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a3b1b-9d2d-4db1-8e24-37055e12c907 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:02.829661 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:02.873382 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d114d-b6c3-4699-950f-a2da9e4c83ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:02.874827 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d114d-b6c3-4699-950f-a2da9e4c83ae None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:02.907839 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a3b1b-9d2d-4db1-8e24-37055e12c907 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:02.936223 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:02.940978 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0537250-f3ac-4586-a1fe-8a1d7564b124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:02.941723 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0537250-f3ac-4586-a1fe-8a1d7564b124 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:02.942087 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0537250-f3ac-4586-a1fe-8a1d7564b124 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:02.942374 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0537250-f3ac-4586-a1fe-8a1d7564b124 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:02.943111 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0537250-f3ac-4586-a1fe-8a1d7564b124 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:02.943452 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0537250-f3ac-4586-a1fe-8a1d7564b124 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:02.944832 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0537250-f3ac-4586-a1fe-8a1d7564b124 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:02.956371 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 253/513] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:02.957229 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0537250-f3ac-4586-a1fe-8a1d7564b124 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:02.972825 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 261/514] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:52:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:52:02.973668 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d114d-b6c3-4699-950f-a2da9e4c83ae None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:03.035975 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:03.058895 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0537250-f3ac-4586-a1fe-8a1d7564b124 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:03.072001 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d114d-b6c3-4699-950f-a2da9e4c83ae None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:03.092083 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0b998-9a3a-4dcc-b323-c18562d12508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:03.092743 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0b998-9a3a-4dcc-b323-c18562d12508 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:03.093029 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0b998-9a3a-4dcc-b323-c18562d12508 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:03.093310 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0b998-9a3a-4dcc-b323-c18562d12508 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:03.094025 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0b998-9a3a-4dcc-b323-c18562d12508 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:03.094336 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0b998-9a3a-4dcc-b323-c18562d12508 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:03.095750 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0b998-9a3a-4dcc-b323-c18562d12508 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:03.104927 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ac109-1607-488c-8836-d2e6bf164a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:03.105709 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ac109-1607-488c-8836-d2e6bf164a5b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:03.105992 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ac109-1607-488c-8836-d2e6bf164a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:03.106269 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ac109-1607-488c-8836-d2e6bf164a5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:03.106537 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 254/515] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:03.107343 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0b998-9a3a-4dcc-b323-c18562d12508 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:03.113868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ac109-1607-488c-8836-d2e6bf164a5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:03.115349 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ac109-1607-488c-8836-d2e6bf164a5b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:03.130532 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-579ac109-1607-488c-8836-d2e6bf164a5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:03.130532 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:03.130532 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:03.130532 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:03.130532 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:03.130532 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:03.130532 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:03.130532 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:03.130532 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:03.130532 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:03.130532 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:03.130532 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:03.130532 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:03.130532 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:03.130532 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:03.131402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:03.131402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:03.131402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:03.131402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:03.131402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:03.131402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:03.131402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:03.131402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:03.131402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:03.131402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:03.131402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:03.131402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:03.131402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:03.131402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:03.131402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:03.131402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:03.131402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:03.132243 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:03.132243 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:03.132243 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:03.132243 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:03.132243 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:03.132243 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:03.132243 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:03.132243 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:03.132243 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 262/516] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:03.132827 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ac109-1607-488c-8836-d2e6bf164a5b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:03.164510 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:03.209192 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0b998-9a3a-4dcc-b323-c18562d12508 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:03.237202 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ac109-1607-488c-8836-d2e6bf164a5b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:03.241844 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486c454-311e-4e08-81fd-f7a8337c2add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:03.242505 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486c454-311e-4e08-81fd-f7a8337c2add None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:03.242790 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486c454-311e-4e08-81fd-f7a8337c2add None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:03.243066 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486c454-311e-4e08-81fd-f7a8337c2add None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:03.243820 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486c454-311e-4e08-81fd-f7a8337c2add None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:03.244127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486c454-311e-4e08-81fd-f7a8337c2add None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:03.245774 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486c454-311e-4e08-81fd-f7a8337c2add None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:03.252660 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:03.258597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 255/517] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:03.259500 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486c454-311e-4e08-81fd-f7a8337c2add None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:03.271457 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba19b95-d600-4a2b-8b62-71d5c3a24b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:03.272251 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba19b95-d600-4a2b-8b62-71d5c3a24b3d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:03.272532 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba19b95-d600-4a2b-8b62-71d5c3a24b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:03.272807 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba19b95-d600-4a2b-8b62-71d5c3a24b3d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:03.280238 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba19b95-d600-4a2b-8b62-71d5c3a24b3d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:03.282182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba19b95-d600-4a2b-8b62-71d5c3a24b3d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:03.295873 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-9ba19b95-d600-4a2b-8b62-71d5c3a24b3d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:52:03.295873 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:03.295873 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:03.295873 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:03.295873 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:03.295873 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:03.295873 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:03.295873 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:03.295873 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:03.295873 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:03.295873 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:03.295873 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:03.295873 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:03.295873 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:03.295873 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:03.295873 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:03.297345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:03.297345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:03.297345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:03.297345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:03.297345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:03.297345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:03.297345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:03.297345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:03.297345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:03.297345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:03.297345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:03.297345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:03.297345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:03.297345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:03.297345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:03.297345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:03.297345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:03.297345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:03.298247 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:03.298247 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:03.298247 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:03.298247 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:03.298247 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:03.298247 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:03.298247 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:03.298247 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:03.298247 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:52:03.298247 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:03.298247 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 263/518] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:52:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:03.298930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba19b95-d600-4a2b-8b62-71d5c3a24b3d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:03.357956 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486c454-311e-4e08-81fd-f7a8337c2add None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:03.385971 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:03.399748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43677dcc-0ce9-40c2-9fad-d81fd5a886cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:03.400550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43677dcc-0ce9-40c2-9fad-d81fd5a886cb None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:03.400836 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43677dcc-0ce9-40c2-9fad-d81fd5a886cb None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:03.401114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43677dcc-0ce9-40c2-9fad-d81fd5a886cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:03.404988 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba19b95-d600-4a2b-8b62-71d5c3a24b3d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:03.411790 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43677dcc-0ce9-40c2-9fad-d81fd5a886cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:03.413252 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43677dcc-0ce9-40c2-9fad-d81fd5a886cb None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:03.431189 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-43677dcc-0ce9-40c2-9fad-d81fd5a886cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:03.431189 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:03.431189 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:03.431189 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:03.431189 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:03.431189 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:03.431189 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:03.431189 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:03.431189 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:03.431189 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:03.431189 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:03.431189 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:03.431189 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:03.431189 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:03.431189 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:03.432176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:03.432176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:03.432176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:03.432176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:03.432176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:03.432176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:03.432176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:03.432176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:03.432176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:03.432176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:03.432176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:03.432176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:03.432176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:03.432176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:03.432176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:03.432176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:03.432176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:03.433006 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:03.433006 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:03.433006 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:03.433006 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:03.433006 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 256/519] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:03.433535 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43677dcc-0ce9-40c2-9fad-d81fd5a886cb None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:03.447469 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2514d1-b7bc-497a-8c86-893a18b852ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:03.448272 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2514d1-b7bc-497a-8c86-893a18b852ec None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:03.448558 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2514d1-b7bc-497a-8c86-893a18b852ec None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:03.448837 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2514d1-b7bc-497a-8c86-893a18b852ec None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:03.456280 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2514d1-b7bc-497a-8c86-893a18b852ec None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:03.457715 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2514d1-b7bc-497a-8c86-893a18b852ec None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:03.472083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-db2514d1-b7bc-497a-8c86-893a18b852ec None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 14:52:03.472083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:03.472083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:03.472083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:03.472083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:03.472083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:03.472083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:03.472083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:03.472083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:03.472083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:03.472083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:03.472083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:03.472083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:03.472083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:03.472083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:03.472083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:03.473142 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:03.473142 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:03.473142 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:03.473142 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:03.473142 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:03.473142 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:03.473142 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:03.473142 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:03.473142 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:03.473142 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:03.473142 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:03.473142 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:03.473142 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:03.473142 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:03.473142 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:03.473142 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:03.473142 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:03.473142 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:03.474381 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:03.474381 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:03.474381 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:03.474381 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:03.474381 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:03.474381 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:03.474381 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:03.474381 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:03.474381 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 14:52:03.474381 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:03.476270 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 264/520] 10.222.0.24 () {56 vars in 1102 bytes} [Thu May 19 14:52:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:03.477150 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2514d1-b7bc-497a-8c86-893a18b852ec None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:03.485373 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:03.534632 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43677dcc-0ce9-40c2-9fad-d81fd5a886cb None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:03.567939 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9126f-2c37-4d55-84e3-6a7aa0e76667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:03.568594 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9126f-2c37-4d55-84e3-6a7aa0e76667 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:03.568875 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9126f-2c37-4d55-84e3-6a7aa0e76667 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:03.569158 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9126f-2c37-4d55-84e3-6a7aa0e76667 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:03.569930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9126f-2c37-4d55-84e3-6a7aa0e76667 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:03.570239 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9126f-2c37-4d55-84e3-6a7aa0e76667 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:03.571725 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9126f-2c37-4d55-84e3-6a7aa0e76667 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:03.574365 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2514d1-b7bc-497a-8c86-893a18b852ec None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:03.588298 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 257/521] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:52:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:03.589081 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9126f-2c37-4d55-84e3-6a7aa0e76667 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:03.607809 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965896d0-be75-4c66-af67-1140c136c4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:03.608472 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965896d0-be75-4c66-af67-1140c136c4f4 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:03.608753 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965896d0-be75-4c66-af67-1140c136c4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:03.609049 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965896d0-be75-4c66-af67-1140c136c4f4 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:03.610287 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965896d0-be75-4c66-af67-1140c136c4f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:03.611758 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965896d0-be75-4c66-af67-1140c136c4f4 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:03.631873 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 265/522] 10.222.0.24 () {60 vars in 1132 bytes} [Thu May 19 14:52:03 2022] POST /identity/v3/users => generated 247 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:52:03.632669 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965896d0-be75-4c66-af67-1140c136c4f4 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:03.635106 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:03.714713 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9126f-2c37-4d55-84e3-6a7aa0e76667 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:03.728652 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:03.755513 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54694f4c-92a7-467e-8209-646fd4927355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:03.756198 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54694f4c-92a7-467e-8209-646fd4927355 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:03.756508 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54694f4c-92a7-467e-8209-646fd4927355 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:03.756752 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54694f4c-92a7-467e-8209-646fd4927355 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:03.757626 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54694f4c-92a7-467e-8209-646fd4927355 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:03.757907 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54694f4c-92a7-467e-8209-646fd4927355 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:03.758814 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965896d0-be75-4c66-af67-1140c136c4f4 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:03.759419 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54694f4c-92a7-467e-8209-646fd4927355 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:03.779864 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 258/523] 10.222.0.24 () {56 vars in 1137 bytes} [Thu May 19 14:52:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:03.781650 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54694f4c-92a7-467e-8209-646fd4927355 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:03.799079 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e518b-db7e-4fd5-b99b-674eb29dea21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:03.799795 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e518b-db7e-4fd5-b99b-674eb29dea21 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:03.800072 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e518b-db7e-4fd5-b99b-674eb29dea21 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:03.800341 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e518b-db7e-4fd5-b99b-674eb29dea21 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:03.801064 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e518b-db7e-4fd5-b99b-674eb29dea21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:03.801368 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e518b-db7e-4fd5-b99b-674eb29dea21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:03.802765 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e518b-db7e-4fd5-b99b-674eb29dea21 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:03.819274 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 266/524] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:03.819274 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e518b-db7e-4fd5-b99b-674eb29dea21 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:03.887494 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:03.899127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54694f4c-92a7-467e-8209-646fd4927355 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:03.928294 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e518b-db7e-4fd5-b99b-674eb29dea21 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:03.938109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f219766-4daf-4857-aacf-eb1b82465410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:03.938778 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f219766-4daf-4857-aacf-eb1b82465410 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:03.939177 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f219766-4daf-4857-aacf-eb1b82465410 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:03.939484 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f219766-4daf-4857-aacf-eb1b82465410 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:03.940323 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f219766-4daf-4857-aacf-eb1b82465410 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:03.940631 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f219766-4daf-4857-aacf-eb1b82465410 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:03.942191 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f219766-4daf-4857-aacf-eb1b82465410 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:03.965521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 259/525] 10.222.0.24 () {56 vars in 1139 bytes} [Thu May 19 14:52:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:03.965521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f219766-4daf-4857-aacf-eb1b82465410 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:03.967580 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6084a81-4ebd-4036-a62f-984c9cf6419c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:03.968264 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6084a81-4ebd-4036-a62f-984c9cf6419c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:03.969098 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6084a81-4ebd-4036-a62f-984c9cf6419c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:03.969377 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6084a81-4ebd-4036-a62f-984c9cf6419c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:03.970205 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6084a81-4ebd-4036-a62f-984c9cf6419c None admin] RBAC: Adding query filter params (role.id=4d4ff927beb7409996558ecf7143d419, scope.project.id=2633b53c336145bba3d4744dbdfe99b7, user.id=06fb8bb5aeb143ad95f33c3b43dbd346) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:03.970514 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6084a81-4ebd-4036-a62f-984c9cf6419c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:03.971964 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6084a81-4ebd-4036-a62f-984c9cf6419c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:03.977543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 267/526] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:52:03 2022] GET /identity/v3/role_assignments?user.id=06fb8bb5aeb143ad95f33c3b43dbd346&scope.project.id=2633b53c336145bba3d4744dbdfe99b7&role.id=4d4ff927beb7409996558ecf7143d419 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:03.978309 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6084a81-4ebd-4036-a62f-984c9cf6419c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:04.003176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:04.092940 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f219766-4daf-4857-aacf-eb1b82465410 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:04.129622 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6084a81-4ebd-4036-a62f-984c9cf6419c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:04.132345 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17c1b4-e8bd-45b5-ac58-ab26a5ea4368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:04.133305 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17c1b4-e8bd-45b5-ac58-ab26a5ea4368 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:04.133800 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17c1b4-e8bd-45b5-ac58-ab26a5ea4368 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:04.134321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17c1b4-e8bd-45b5-ac58-ab26a5ea4368 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:04.169431 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:04.180584 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b306727-4454-4853-b93a-8307c630b5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:04.181390 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b306727-4454-4853-b93a-8307c630b5d4 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:04.181672 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b306727-4454-4853-b93a-8307c630b5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:04.181945 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b306727-4454-4853-b93a-8307c630b5d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:04.191184 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b306727-4454-4853-b93a-8307c630b5d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:04.192709 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b306727-4454-4853-b93a-8307c630b5d4 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:04.212894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-3b306727-4454-4853-b93a-8307c630b5d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:04.212894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:04.212894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:04.212894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:04.212894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:04.212894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:04.212894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:04.212894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:04.212894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:04.212894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:04.212894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:04.212894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:04.212894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:04.212894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:04.212894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:04.213775 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:04.213775 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:04.213775 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:04.213775 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:04.213775 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:04.213775 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:04.213775 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:04.213775 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:04.213775 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:04.213775 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:04.213775 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:04.213775 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:04.213775 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:04.213775 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:04.213775 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:04.213775 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:04.213775 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:04.214589 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:04.214589 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:04.214589 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:04.214589 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:04.214589 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:04.214589 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:04.214589 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:04.214589 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:04.214987 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17c1b4-e8bd-45b5-ac58-ab26a5ea4368 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:04.214987 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17c1b4-e8bd-45b5-ac58-ab26a5ea4368 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:04.219496 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 268/527] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:04.221166 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b306727-4454-4853-b93a-8307c630b5d4 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:04.245063 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:04.341517 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 260/528] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:52:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:52:04.341517 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17c1b4-e8bd-45b5-ac58-ab26a5ea4368 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:04.357522 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b306727-4454-4853-b93a-8307c630b5d4 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:04.395095 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c766216-47f7-403b-b2ea-f8cc44989d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:04.396120 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c766216-47f7-403b-b2ea-f8cc44989d69 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:04.396604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c766216-47f7-403b-b2ea-f8cc44989d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:04.397102 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c766216-47f7-403b-b2ea-f8cc44989d69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:04.456415 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:04.471306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c766216-47f7-403b-b2ea-f8cc44989d69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:04.473038 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17c1b4-e8bd-45b5-ac58-ab26a5ea4368 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:04.473310 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c766216-47f7-403b-b2ea-f8cc44989d69 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:04.507375 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:04.519864 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7f90e-ae41-4ba8-ab95-eb52b2d358c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:04.521350 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7f90e-ae41-4ba8-ab95-eb52b2d358c4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:04.521905 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7f90e-ae41-4ba8-ab95-eb52b2d358c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:04.523786 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7f90e-ae41-4ba8-ab95-eb52b2d358c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:04.525232 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7f90e-ae41-4ba8-ab95-eb52b2d358c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:04.525995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7f90e-ae41-4ba8-ab95-eb52b2d358c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:04.527919 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7f90e-ae41-4ba8-ab95-eb52b2d358c4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:04.545094 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 261/529] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:52:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:04.546117 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7f90e-ae41-4ba8-ab95-eb52b2d358c4 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:04.607803 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 269/530] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:52:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:52:04.609222 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c766216-47f7-403b-b2ea-f8cc44989d69 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:04.658588 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7f90e-ae41-4ba8-ab95-eb52b2d358c4 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:04.702567 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789a885-e3a0-4cbd-ae70-7e033f963ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:04.703910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789a885-e3a0-4cbd-ae70-7e033f963ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:04.704299 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789a885-e3a0-4cbd-ae70-7e033f963ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:04.704679 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789a885-e3a0-4cbd-ae70-7e033f963ef4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:04.712680 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:04.719750 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789a885-e3a0-4cbd-ae70-7e033f963ef4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:04.721922 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789a885-e3a0-4cbd-ae70-7e033f963ef4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:04.732471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c766216-47f7-403b-b2ea-f8cc44989d69 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:04.740865 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-3789a885-e3a0-4cbd-ae70-7e033f963ef4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:04.740865 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:04.740865 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:04.740865 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:04.740865 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:04.740865 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:04.740865 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:04.740865 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:04.740865 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:04.740865 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:04.740865 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:04.740865 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:04.740865 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:04.740865 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:04.740865 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:04.741950 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:04.741950 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:04.741950 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:04.741950 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:04.741950 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:04.741950 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:04.741950 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:04.741950 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:04.741950 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:04.741950 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:04.741950 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:04.741950 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:04.741950 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:04.741950 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:04.741950 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:04.741950 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:04.741950 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:04.743005 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:04.743005 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:04.743005 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:04.743005 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:04.749128 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 262/531] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:04.750741 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789a885-e3a0-4cbd-ae70-7e033f963ef4 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:04.775571 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47c55e-551a-468a-a351-05f2f1bdf811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:04.776968 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47c55e-551a-468a-a351-05f2f1bdf811 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:04.777544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47c55e-551a-468a-a351-05f2f1bdf811 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:04.778108 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47c55e-551a-468a-a351-05f2f1bdf811 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:04.779373 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47c55e-551a-468a-a351-05f2f1bdf811 None admin] RBAC: Adding query filter params (role.id=4d4ff927beb7409996558ecf7143d419, scope.project.id=2633b53c336145bba3d4744dbdfe99b7, user.id=b1dc1d74631b4d69a3094e4e1e2a0ebd) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:04.779857 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47c55e-551a-468a-a351-05f2f1bdf811 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:04.782140 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47c55e-551a-468a-a351-05f2f1bdf811 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:04.790692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 270/532] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:52:04 2022] GET /identity/v3/role_assignments?user.id=b1dc1d74631b4d69a3094e4e1e2a0ebd&scope.project.id=2633b53c336145bba3d4744dbdfe99b7&role.id=4d4ff927beb7409996558ecf7143d419 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:04.791684 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47c55e-551a-468a-a351-05f2f1bdf811 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:04.806556 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:04.922091 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47c55e-551a-468a-a351-05f2f1bdf811 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:04.963974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5146eab-c80f-4257-be41-bec15bf22bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:04.965074 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5146eab-c80f-4257-be41-bec15bf22bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:04.965516 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5146eab-c80f-4257-be41-bec15bf22bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:04.965951 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5146eab-c80f-4257-be41-bec15bf22bd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:04.966683 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789a885-e3a0-4cbd-ae70-7e033f963ef4 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:04.966982 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5146eab-c80f-4257-be41-bec15bf22bd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:04.967459 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5146eab-c80f-4257-be41-bec15bf22bd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:04.969313 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5146eab-c80f-4257-be41-bec15bf22bd1 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:04.985468 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 271/533] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:04.993164 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5146eab-c80f-4257-be41-bec15bf22bd1 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:05.017268 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:05.055944 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637a530-8481-46aa-b740-5b950055e2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:05.056768 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637a530-8481-46aa-b740-5b950055e2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:05.057057 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637a530-8481-46aa-b740-5b950055e2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:05.057344 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637a530-8481-46aa-b740-5b950055e2c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:05.079525 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637a530-8481-46aa-b740-5b950055e2c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:05.081016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637a530-8481-46aa-b740-5b950055e2c8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:05.107720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-d637a530-8481-46aa-b740-5b950055e2c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:05.107720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:05.107720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:05.107720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:05.107720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:05.107720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:05.107720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:05.107720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:05.107720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:05.107720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:05.107720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:05.107720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:05.107720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:05.107720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:05.107720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:05.109729 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:05.109729 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:05.109729 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:05.109729 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:05.109729 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:05.109729 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:05.109729 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:05.109729 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:05.109729 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:05.109729 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:05.109729 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:05.109729 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:05.109729 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:05.109729 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:05.109729 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:05.109729 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:05.109729 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:05.110722 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:05.110722 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:05.110722 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:05.110722 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:05.116625 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 263/534] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:05.124080 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637a530-8481-46aa-b740-5b950055e2c8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:05.130797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5146eab-c80f-4257-be41-bec15bf22bd1 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:05.166474 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698b925-cd38-4152-8006-ce42e827469a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:05.167680 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698b925-cd38-4152-8006-ce42e827469a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:05.168156 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698b925-cd38-4152-8006-ce42e827469a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:05.168654 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698b925-cd38-4152-8006-ce42e827469a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:05.176590 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9698b925-cd38-4152-8006-ce42e827469a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:05.178390 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9698b925-cd38-4152-8006-ce42e827469a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:05.193725 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-9698b925-cd38-4152-8006-ce42e827469a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:05.193725 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:05.193725 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:05.193725 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:05.193725 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:05.193725 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:05.193725 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:05.193725 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:05.193725 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:05.193725 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:05.193725 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:05.193725 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:05.193725 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:05.193725 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:05.193725 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:05.194617 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:05.194617 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:05.194617 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:05.194617 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:05.194617 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:05.194617 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:05.194617 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:05.194617 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:05.194617 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:05.194617 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:05.194617 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:05.194617 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:05.194617 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:05.194617 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:05.194617 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:05.194617 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:05.194617 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:05.195482 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:05.195482 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:05.195482 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:05.195482 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:05.195482 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:05.195482 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:05.195482 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:05.195482 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:05.197918 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 272/535] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:05.211916 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698b925-cd38-4152-8006-ce42e827469a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:05.259697 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:05.266871 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637a530-8481-46aa-b740-5b950055e2c8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:05.301709 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:05.328473 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698b925-cd38-4152-8006-ce42e827469a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:05.360178 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7497e47-7621-4205-9d86-d2c1df6d5d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:05.360886 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7497e47-7621-4205-9d86-d2c1df6d5d4c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:05.361319 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7497e47-7621-4205-9d86-d2c1df6d5d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:05.361515 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7497e47-7621-4205-9d86-d2c1df6d5d4c None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:05.362284 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7497e47-7621-4205-9d86-d2c1df6d5d4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:05.362683 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7497e47-7621-4205-9d86-d2c1df6d5d4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:05.364209 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7497e47-7621-4205-9d86-d2c1df6d5d4c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:05.371738 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47c4df-826f-47a3-b0f2-af48def1e6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:05.372716 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47c4df-826f-47a3-b0f2-af48def1e6df None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:05.373188 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47c4df-826f-47a3-b0f2-af48def1e6df None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:05.373655 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47c4df-826f-47a3-b0f2-af48def1e6df None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:05.374708 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47c4df-826f-47a3-b0f2-af48def1e6df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:05.375746 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47c4df-826f-47a3-b0f2-af48def1e6df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:05.377372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47c4df-826f-47a3-b0f2-af48def1e6df None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:05.398387 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 264/536] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:05.403618 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7497e47-7621-4205-9d86-d2c1df6d5d4c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:05.419380 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 273/537] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:52:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:05.425739 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47c4df-826f-47a3-b0f2-af48def1e6df None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:05.592574 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7497e47-7621-4205-9d86-d2c1df6d5d4c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:05.629627 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad89e11-bb68-4e7b-982c-f96eb58b3374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:05.630766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad89e11-bb68-4e7b-982c-f96eb58b3374 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:05.631297 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad89e11-bb68-4e7b-982c-f96eb58b3374 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:05.631766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad89e11-bb68-4e7b-982c-f96eb58b3374 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:05.639140 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad89e11-bb68-4e7b-982c-f96eb58b3374 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:05.640981 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad89e11-bb68-4e7b-982c-f96eb58b3374 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:05.656339 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-4ad89e11-bb68-4e7b-982c-f96eb58b3374 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:05.656339 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:05.656339 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:05.656339 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:05.656339 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:05.656339 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:05.656339 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:05.656339 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:05.656339 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:05.656339 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:05.656339 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:05.656339 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:05.656339 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:05.656339 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:05.656339 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:05.657194 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:05.657194 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:05.657194 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:05.657194 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:05.657194 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:05.657194 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:05.657194 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:05.657194 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:05.657194 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:05.657194 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:05.657194 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:05.657194 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:05.657194 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:05.657194 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:05.657194 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:05.657194 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:05.657194 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:05.658027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:05.658027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:05.658027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:05.658027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:05.658027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:05.658027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:05.658027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:05.658027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:05.660852 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 265/538] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:05.667245 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47c4df-826f-47a3-b0f2-af48def1e6df None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:05.668291 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad89e11-bb68-4e7b-982c-f96eb58b3374 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:05.690666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:05.717486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:05.730131 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c4c43-0ca4-42c4-8901-48bffd47e03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:05.731025 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c4c43-0ca4-42c4-8901-48bffd47e03d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:05.731486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c4c43-0ca4-42c4-8901-48bffd47e03d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:05.731907 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c4c43-0ca4-42c4-8901-48bffd47e03d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:05.732911 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c4c43-0ca4-42c4-8901-48bffd47e03d None admin] RBAC: Adding query filter params (role.id=4d4ff927beb7409996558ecf7143d419, scope.project.id=2633b53c336145bba3d4744dbdfe99b7, user.id=ed3a61154a444a9cb925839f693208c9) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:05.733369 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c4c43-0ca4-42c4-8901-48bffd47e03d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:05.736397 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c4c43-0ca4-42c4-8901-48bffd47e03d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:05.749704 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 274/539] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:52:05 2022] GET /identity/v3/role_assignments?user.id=ed3a61154a444a9cb925839f693208c9&scope.project.id=2633b53c336145bba3d4744dbdfe99b7&role.id=4d4ff927beb7409996558ecf7143d419 => generated 259 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:05.827240 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad89e11-bb68-4e7b-982c-f96eb58b3374 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:05.884608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52c7f5-ed2e-4653-bc01-70383706c268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:05.885561 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52c7f5-ed2e-4653-bc01-70383706c268 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:05.885995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52c7f5-ed2e-4653-bc01-70383706c268 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:05.886410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52c7f5-ed2e-4653-bc01-70383706c268 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:05.887365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52c7f5-ed2e-4653-bc01-70383706c268 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:05.887838 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52c7f5-ed2e-4653-bc01-70383706c268 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:05.889432 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52c7f5-ed2e-4653-bc01-70383706c268 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:05.910682 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 266/540] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:52:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:05.916814 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c4c43-0ca4-42c4-8901-48bffd47e03d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:06.014168 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99977476-5343-4d86-bc13-5c13dec84165 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:06.014467 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99977476-5343-4d86-bc13-5c13dec84165 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:06.014752 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99977476-5343-4d86-bc13-5c13dec84165 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:06.018295 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 267/541] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:52:06.022620 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1f395-d611-4e54-88d2-d215c527fc3c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:06.022919 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1f395-d611-4e54-88d2-d215c527fc3c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:06.023227 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1f395-d611-4e54-88d2-d215c527fc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:06.044252 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b1f1f395-d611-4e54-88d2-d215c527fc3c None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:06.045492 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b1f1f395-d611-4e54-88d2-d215c527fc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:06.063461 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c4c43-0ca4-42c4-8901-48bffd47e03d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:06.110101 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffeaa46-df27-4938-b932-4345daa75f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:06.110774 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffeaa46-df27-4938-b932-4345daa75f4a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:06.111052 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffeaa46-df27-4938-b932-4345daa75f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:06.111347 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffeaa46-df27-4938-b932-4345daa75f4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:06.112191 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffeaa46-df27-4938-b932-4345daa75f4a None admin] RBAC: Adding query filter params (role.id=4d4ff927beb7409996558ecf7143d419, scope.project.id=2633b53c336145bba3d4744dbdfe99b7, user.id=2d089b5ee94e441ebbd084c2581a42df) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:06.112507 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffeaa46-df27-4938-b932-4345daa75f4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:06.113959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffeaa46-df27-4938-b932-4345daa75f4a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:06.126614 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 275/542] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:52:05 2022] GET /identity/v3/role_assignments?user.id=2d089b5ee94e441ebbd084c2581a42df&scope.project.id=2633b53c336145bba3d4744dbdfe99b7&role.id=4d4ff927beb7409996558ecf7143d419 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:06.175777 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:06.182090 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 268/543] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:52:06.206428 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffeaa46-df27-4938-b932-4345daa75f4a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:06.294186 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:06.363292 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffeaa46-df27-4938-b932-4345daa75f4a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:06.402113 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088dfd94-79ce-47b9-b867-bf0cd0e1f952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:06.402961 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dfd94-79ce-47b9-b867-bf0cd0e1f952 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:06.403268 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dfd94-79ce-47b9-b867-bf0cd0e1f952 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:06.403552 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dfd94-79ce-47b9-b867-bf0cd0e1f952 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:06.415387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088dfd94-79ce-47b9-b867-bf0cd0e1f952 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:06.423337 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-088dfd94-79ce-47b9-b867-bf0cd0e1f952 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:06.423337 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:06.423337 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:06.423337 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:06.423337 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:06.423337 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:06.423337 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:06.423337 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:06.423337 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:06.423337 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:06.423337 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:06.423337 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:06.423337 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:06.423337 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:06.423337 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:06.423337 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:06.424209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:06.424209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:06.424209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:06.424209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:06.424209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:06.424209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:06.424209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:06.424209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:06.424209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:06.424209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:06.424209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:06.424209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:06.424209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:06.424209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:06.424209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:06.424209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:06.425012 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:06.425012 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:06.425012 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:06.425012 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:06.425012 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:06.425012 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:06.425012 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:06.425012 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:06.425012 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:06.425012 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:06.425012 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:06.425012 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:06.425012 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 276/544] 10.222.0.24 () {56 vars in 1102 bytes} [Thu May 19 14:52:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:06.432552 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1f395-d611-4e54-88d2-d215c527fc3c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:06.456827 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e73b2f-7ce7-448e-8e4f-5399e28311c7 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:06.457124 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e73b2f-7ce7-448e-8e4f-5399e28311c7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:06.457409 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e73b2f-7ce7-448e-8e4f-5399e28311c7 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:06.459244 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 277/545] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:06.473322 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71131063-8a3c-4949-8988-1a7fea4556e7 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:06.473607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71131063-8a3c-4949-8988-1a7fea4556e7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:06.473884 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71131063-8a3c-4949-8988-1a7fea4556e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:06.502564 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-71131063-8a3c-4949-8988-1a7fea4556e7 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:06.503912 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-71131063-8a3c-4949-8988-1a7fea4556e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:06.561626 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1f395-d611-4e54-88d2-d215c527fc3c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:06.622650 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 278/546] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 19 14:52:06.629030 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169481d4-d2ae-468d-ac1e-c8a610e3fe4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:06.629935 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169481d4-d2ae-468d-ac1e-c8a610e3fe4f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:06.630420 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169481d4-d2ae-468d-ac1e-c8a610e3fe4f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:06.630909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169481d4-d2ae-468d-ac1e-c8a610e3fe4f None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:06.631888 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169481d4-d2ae-468d-ac1e-c8a610e3fe4f None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:06.632392 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169481d4-d2ae-468d-ac1e-c8a610e3fe4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:06.633984 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169481d4-d2ae-468d-ac1e-c8a610e3fe4f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:06.650459 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 269/547] 10.222.0.24 () {56 vars in 1103 bytes} [Thu May 19 14:52:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:06.655815 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71131063-8a3c-4949-8988-1a7fea4556e7 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:06.661822 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169481d4-d2ae-468d-ac1e-c8a610e3fe4f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:06.719629 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:06.739604 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:06.777623 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169481d4-d2ae-468d-ac1e-c8a610e3fe4f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:06.810730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71131063-8a3c-4949-8988-1a7fea4556e7 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:06.813382 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229f452-ff51-4c19-854b-1d59ba3609af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:06.814193 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229f452-ff51-4c19-854b-1d59ba3609af None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:06.814481 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229f452-ff51-4c19-854b-1d59ba3609af None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:06.814763 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229f452-ff51-4c19-854b-1d59ba3609af None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:06.836363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c229f452-ff51-4c19-854b-1d59ba3609af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:06.847182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-c229f452-ff51-4c19-854b-1d59ba3609af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:06.847182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:06.847182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:06.847182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:06.847182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:06.847182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:06.847182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:06.847182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:06.847182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:06.847182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:06.847182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:06.847182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:06.847182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:06.847182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:06.847182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:06.847182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:06.848077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:06.848077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:06.848077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:06.848077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:06.848077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:06.848077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:06.848077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:06.848077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:06.848077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:06.848077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:06.848077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:06.848077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:06.848077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:06.848077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:06.848077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:06.848077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:06.848930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:06.848930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:06.848930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:06.848930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:06.848930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:06.848930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:06.848930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:06.848930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:06.848930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:06.848930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:06.848930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:06.848930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:06.848930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 270/548] 10.222.0.24 () {56 vars in 1102 bytes} [Thu May 19 14:52:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:06.855060 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229f452-ff51-4c19-854b-1d59ba3609af None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:06.864542 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d128ea3-ccbf-483a-a283-f64eba638feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:06.865439 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d128ea3-ccbf-483a-a283-f64eba638feb None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:06.865787 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d128ea3-ccbf-483a-a283-f64eba638feb None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:06.866128 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d128ea3-ccbf-483a-a283-f64eba638feb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:06.891161 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d128ea3-ccbf-483a-a283-f64eba638feb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:06.892745 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d128ea3-ccbf-483a-a283-f64eba638feb None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:06.925561 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-9d128ea3-ccbf-483a-a283-f64eba638feb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:06.925561 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:06.925561 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:06.925561 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:06.925561 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:06.925561 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:06.925561 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:06.925561 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:06.925561 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:06.925561 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:06.925561 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:06.925561 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:06.925561 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:06.925561 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:06.925561 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:06.927110 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:06.927110 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:06.927110 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:06.927110 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:06.927110 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:06.927110 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:06.927110 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:06.927110 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:06.927110 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:06.927110 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:06.927110 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:06.927110 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:06.927110 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:06.927110 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:06.927110 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:06.927110 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:06.927110 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:06.928345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:06.928345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:06.928345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:06.928345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:06.932643 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 279/549] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:06.940170 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d128ea3-ccbf-483a-a283-f64eba638feb None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:07.017224 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229f452-ff51-4c19-854b-1d59ba3609af None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:07.057582 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:07.081419 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86b81c-9777-4f8d-a8c4-a5101c1eacea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:07.082099 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86b81c-9777-4f8d-a8c4-a5101c1eacea None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:07.082382 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86b81c-9777-4f8d-a8c4-a5101c1eacea None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:07.082659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86b81c-9777-4f8d-a8c4-a5101c1eacea None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:07.083422 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86b81c-9777-4f8d-a8c4-a5101c1eacea None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:07.083733 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86b81c-9777-4f8d-a8c4-a5101c1eacea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:07.085106 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86b81c-9777-4f8d-a8c4-a5101c1eacea None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:07.101545 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 271/550] 10.222.0.24 () {56 vars in 1103 bytes} [Thu May 19 14:52:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:07.107682 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d128ea3-ccbf-483a-a283-f64eba638feb None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:07.110456 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86b81c-9777-4f8d-a8c4-a5101c1eacea None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:07.111037 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:07.163042 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301daf51-50e6-4adb-9776-a3dd2a043454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:07.163980 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301daf51-50e6-4adb-9776-a3dd2a043454 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:07.164482 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301daf51-50e6-4adb-9776-a3dd2a043454 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:07.164944 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301daf51-50e6-4adb-9776-a3dd2a043454 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:07.166188 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301daf51-50e6-4adb-9776-a3dd2a043454 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:07.166710 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301daf51-50e6-4adb-9776-a3dd2a043454 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:07.168373 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301daf51-50e6-4adb-9776-a3dd2a043454 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:07.182462 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 280/551] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:07.188639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301daf51-50e6-4adb-9776-a3dd2a043454 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:07.301862 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301daf51-50e6-4adb-9776-a3dd2a043454 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:07.309807 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86b81c-9777-4f8d-a8c4-a5101c1eacea None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:07.363190 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d5004-79bf-4c4a-bd53-cce4010b3870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:07.364456 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d5004-79bf-4c4a-bd53-cce4010b3870 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:07.364966 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d5004-79bf-4c4a-bd53-cce4010b3870 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:07.365298 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d5004-79bf-4c4a-bd53-cce4010b3870 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:07.378325 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6345e-25c9-4aa6-b468-5d7355494753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:07.379140 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6345e-25c9-4aa6-b468-5d7355494753 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:07.379449 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6345e-25c9-4aa6-b468-5d7355494753 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:07.379726 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6345e-25c9-4aa6-b468-5d7355494753 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:07.388237 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d5004-79bf-4c4a-bd53-cce4010b3870 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:07.391013 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d5004-79bf-4c4a-bd53-cce4010b3870 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:07.397722 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6345e-25c9-4aa6-b468-5d7355494753 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:07.399241 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6345e-25c9-4aa6-b468-5d7355494753 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:07.419634 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-830d5004-79bf-4c4a-bd53-cce4010b3870 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:07.419634 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:07.419634 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:07.419634 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:07.419634 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:07.419634 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:07.419634 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:07.419634 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:07.419634 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:07.419634 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:07.419634 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:07.419634 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:07.419634 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:07.419634 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:07.419634 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:07.420650 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:07.420650 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:07.420650 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:07.420650 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:07.420650 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:07.420650 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:07.420650 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:07.420650 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:07.420650 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:07.420650 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:07.420650 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:07.420650 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:07.420650 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:07.420650 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:07.420650 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:07.420650 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:07.420650 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:07.421698 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:07.421698 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:07.421698 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:07.421698 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:07.421698 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 272/552] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:07.424763 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-aad6345e-25c9-4aa6-b468-5d7355494753 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 14:52:07.424763 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:07.424763 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:07.424763 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:07.424763 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:07.424763 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:07.424763 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:07.424763 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:07.424763 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:07.424763 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:07.424763 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:07.424763 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:07.424763 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:07.424763 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:07.424763 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:07.424763 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:07.426797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:07.426797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:07.426797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:07.426797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:07.426797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:07.426797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:07.426797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:07.426797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:07.426797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:07.426797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:07.426797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:07.426797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:07.426797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:07.426797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:07.426797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:07.426797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:07.426797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:07.426797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:07.429115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:07.429115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:07.429115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:07.429115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:07.429115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:07.429115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:07.429115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:07.429115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:07.429115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 14:52:07.429115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:07.429115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 281/553] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:52:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:07.435300 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d5004-79bf-4c4a-bd53-cce4010b3870 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:07.435526 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6345e-25c9-4aa6-b468-5d7355494753 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:07.481947 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:07.513963 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:07.616708 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d5004-79bf-4c4a-bd53-cce4010b3870 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:07.662550 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6345e-25c9-4aa6-b468-5d7355494753 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:07.684797 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106636f-f93b-40c5-ac3e-74480be5c4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:07.685479 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106636f-f93b-40c5-ac3e-74480be5c4a6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:07.685763 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106636f-f93b-40c5-ac3e-74480be5c4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:07.686038 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106636f-f93b-40c5-ac3e-74480be5c4a6 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:07.686878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106636f-f93b-40c5-ac3e-74480be5c4a6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:07.687240 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106636f-f93b-40c5-ac3e-74480be5c4a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:07.688699 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106636f-f93b-40c5-ac3e-74480be5c4a6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:07.716403 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb78f1a-8e02-404e-923a-e62232e1f289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:07.717066 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb78f1a-8e02-404e-923a-e62232e1f289 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:07.717343 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb78f1a-8e02-404e-923a-e62232e1f289 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:07.717616 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb78f1a-8e02-404e-923a-e62232e1f289 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:07.718401 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb78f1a-8e02-404e-923a-e62232e1f289 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:07.718711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb78f1a-8e02-404e-923a-e62232e1f289 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:07.720116 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb78f1a-8e02-404e-923a-e62232e1f289 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:07.725516 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 273/554] 10.222.0.24 () {56 vars in 1135 bytes} [Thu May 19 14:52:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:07.738892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 282/555] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:07.739812 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106636f-f93b-40c5-ac3e-74480be5c4a6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:07.743950 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb78f1a-8e02-404e-923a-e62232e1f289 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:07.836343 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:07.864594 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb78f1a-8e02-404e-923a-e62232e1f289 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:07.903545 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854073a-7b32-45b5-9a64-39ed3eba8352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:07.904661 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854073a-7b32-45b5-9a64-39ed3eba8352 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:07.905157 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:07.905625 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854073a-7b32-45b5-9a64-39ed3eba8352 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:07.907341 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854073a-7b32-45b5-9a64-39ed3eba8352 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:07.912784 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106636f-f93b-40c5-ac3e-74480be5c4a6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:07.919190 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d854073a-7b32-45b5-9a64-39ed3eba8352 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:07.920864 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d854073a-7b32-45b5-9a64-39ed3eba8352 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:07.939771 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-d854073a-7b32-45b5-9a64-39ed3eba8352 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:52:07.939771 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:07.939771 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:07.939771 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:07.939771 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:07.939771 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:07.939771 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:07.939771 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:07.939771 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:07.939771 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:07.939771 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:07.939771 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:07.939771 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:07.939771 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:07.939771 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:07.939771 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:07.941299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:07.941299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:07.941299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:07.941299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:07.941299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:07.941299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:07.941299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:07.941299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:07.941299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:07.941299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:07.941299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:07.941299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:07.941299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:07.941299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:07.941299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:07.941299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:07.941299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:07.941299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:07.943018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:07.943018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:07.943018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:07.943018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:07.943018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:07.943018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:07.943018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:07.943018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:07.943018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:52:07.943018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:07.945473 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 283/556] 10.222.0.24 () {56 vars in 1093 bytes} [Thu May 19 14:52:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:07.947130 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad8545-ab02-446d-bb02-84b8226ae17f None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:07.947586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad8545-ab02-446d-bb02-84b8226ae17f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:07.948010 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad8545-ab02-446d-bb02-84b8226ae17f None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:07.949700 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 284/557] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:07.950729 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad8545-ab02-446d-bb02-84b8226ae17f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:07.956277 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39490706-07ed-40af-b30a-1ea09ac62d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:07.956795 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39490706-07ed-40af-b30a-1ea09ac62d92 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:07.957153 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39490706-07ed-40af-b30a-1ea09ac62d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:07.957498 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39490706-07ed-40af-b30a-1ea09ac62d92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:08.034659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39490706-07ed-40af-b30a-1ea09ac62d92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:08.036326 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39490706-07ed-40af-b30a-1ea09ac62d92 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:08.086439 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad8545-ab02-446d-bb02-84b8226ae17f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:08.126173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb14acc-b41f-4872-87e8-2c47126c91ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:08.127739 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb14acc-b41f-4872-87e8-2c47126c91ee None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:08.128209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb14acc-b41f-4872-87e8-2c47126c91ee None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:08.128669 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb14acc-b41f-4872-87e8-2c47126c91ee None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:08.129809 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb14acc-b41f-4872-87e8-2c47126c91ee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:08.130306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb14acc-b41f-4872-87e8-2c47126c91ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:08.132093 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb14acc-b41f-4872-87e8-2c47126c91ee None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:08.142246 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:08.145277 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:08.158697 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 274/558] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:52:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:52:08.158697 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12803390-7319-4bda-b908-c138638aca92 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:08.158697 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12803390-7319-4bda-b908-c138638aca92 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:08.158697 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12803390-7319-4bda-b908-c138638aca92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:08.159567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 285/559] 10.222.0.24 () {56 vars in 1133 bytes} [Thu May 19 14:52:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:08.160616 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb14acc-b41f-4872-87e8-2c47126c91ee None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:08.182731 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-12803390-7319-4bda-b908-c138638aca92 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:08.184169 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-12803390-7319-4bda-b908-c138638aca92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:08.256084 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 275/560] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:52:08.257199 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12803390-7319-4bda-b908-c138638aca92 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:08.265626 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb14acc-b41f-4872-87e8-2c47126c91ee None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:08.324329 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03f2b9-370f-4171-8662-0cfd207e9801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:08.325132 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03f2b9-370f-4171-8662-0cfd207e9801 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:08.325411 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03f2b9-370f-4171-8662-0cfd207e9801 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:08.325686 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03f2b9-370f-4171-8662-0cfd207e9801 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:08.339477 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf03f2b9-370f-4171-8662-0cfd207e9801 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:08.341451 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf03f2b9-370f-4171-8662-0cfd207e9801 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:08.364866 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12803390-7319-4bda-b908-c138638aca92 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:08.366587 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-bf03f2b9-370f-4171-8662-0cfd207e9801 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:08.366587 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:08.366587 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:08.366587 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:08.366587 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:08.366587 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:08.366587 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:08.366587 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:08.366587 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:08.366587 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:08.366587 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:08.366587 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:08.366587 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:08.366587 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:08.366587 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:08.367457 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:08.367457 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:08.367457 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:08.367457 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:08.367457 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:08.367457 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:08.367457 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:08.367457 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:08.367457 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:08.367457 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:08.367457 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:08.367457 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:08.367457 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:08.367457 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:08.367457 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:08.367457 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:08.367457 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:08.368340 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:08.368340 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:08.368340 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:08.368340 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:08.369006 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 286/561] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:08.369834 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03f2b9-370f-4171-8662-0cfd207e9801 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:08.393802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:08.406288 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88bd59-48ed-4aba-95bb-1994d541c406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:08.407376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88bd59-48ed-4aba-95bb-1994d541c406 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:08.407753 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88bd59-48ed-4aba-95bb-1994d541c406 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:08.408147 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88bd59-48ed-4aba-95bb-1994d541c406 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:08.419930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc88bd59-48ed-4aba-95bb-1994d541c406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:08.422118 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc88bd59-48ed-4aba-95bb-1994d541c406 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:08.433646 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:08.443152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-dc88bd59-48ed-4aba-95bb-1994d541c406 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:08.443152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:08.443152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:08.443152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:08.443152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:08.443152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:08.443152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:08.443152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:08.443152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:08.443152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:08.443152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:08.443152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:08.443152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:08.443152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:08.443152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:08.444491 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:08.444491 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:08.444491 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:08.444491 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:08.444491 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:08.444491 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:08.444491 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:08.444491 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:08.444491 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:08.444491 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:08.444491 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:08.444491 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:08.444491 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:08.444491 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:08.444491 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:08.444491 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:08.444491 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:08.445424 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:08.445424 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:08.445424 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:08.445424 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:08.449718 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 276/562] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:08.450788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88bd59-48ed-4aba-95bb-1994d541c406 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:08.497577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03f2b9-370f-4171-8662-0cfd207e9801 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:08.536348 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9208d0-754e-4fc8-8515-c9071160132a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:08.537486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9208d0-754e-4fc8-8515-c9071160132a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:08.537953 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9208d0-754e-4fc8-8515-c9071160132a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:08.538447 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9208d0-754e-4fc8-8515-c9071160132a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:08.550565 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9208d0-754e-4fc8-8515-c9071160132a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:08.558930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88bd59-48ed-4aba-95bb-1994d541c406 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:08.559465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-8f9208d0-754e-4fc8-8515-c9071160132a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:08.559465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:08.559465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:08.559465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:08.559465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:08.559465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:08.559465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:08.559465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:08.559465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:08.559465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:08.559465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:08.559465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:08.559465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:08.559465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:08.559465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:08.559465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:08.560376 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:08.560376 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:08.560376 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:08.560376 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:08.560376 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:08.560376 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:08.560376 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:08.560376 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:08.560376 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:08.560376 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:08.560376 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:08.560376 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:08.560376 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:08.560376 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:08.560376 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:08.560376 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:08.561211 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:08.561211 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:08.561211 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:08.561211 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:08.561211 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:08.561211 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:08.561211 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:08.561211 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:08.561211 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:08.561211 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:08.561211 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:08.561211 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:08.564063 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 287/563] 10.222.0.24 () {56 vars in 1102 bytes} [Thu May 19 14:52:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:08.565073 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9208d0-754e-4fc8-8515-c9071160132a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:08.594963 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bd2fb-aa45-4e29-8c40-66b5bab2b46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:08.595666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bd2fb-aa45-4e29-8c40-66b5bab2b46c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:08.596142 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bd2fb-aa45-4e29-8c40-66b5bab2b46c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:08.596534 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bd2fb-aa45-4e29-8c40-66b5bab2b46c None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:08.597157 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bd2fb-aa45-4e29-8c40-66b5bab2b46c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:08.597473 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bd2fb-aa45-4e29-8c40-66b5bab2b46c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:08.598879 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bd2fb-aa45-4e29-8c40-66b5bab2b46c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:08.617110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 277/564] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:08.617110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bd2fb-aa45-4e29-8c40-66b5bab2b46c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:08.654605 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:08.681987 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9208d0-754e-4fc8-8515-c9071160132a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:08.691850 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:08.716050 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfb6e3-f373-41b6-8ab2-f6daedfa7934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:08.716707 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfb6e3-f373-41b6-8ab2-f6daedfa7934 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:08.716992 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfb6e3-f373-41b6-8ab2-f6daedfa7934 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:08.717268 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfb6e3-f373-41b6-8ab2-f6daedfa7934 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:08.717981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccfb6e3-f373-41b6-8ab2-f6daedfa7934 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:08.718814 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccfb6e3-f373-41b6-8ab2-f6daedfa7934 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:08.719881 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bd2fb-aa45-4e29-8c40-66b5bab2b46c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:08.720199 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccfb6e3-f373-41b6-8ab2-f6daedfa7934 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:08.731589 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 288/565] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:08.732378 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfb6e3-f373-41b6-8ab2-f6daedfa7934 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:08.757541 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559c290-0e08-4988-9e21-4c74d10b88b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:08.758211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559c290-0e08-4988-9e21-4c74d10b88b9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:08.758495 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559c290-0e08-4988-9e21-4c74d10b88b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:08.758770 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559c290-0e08-4988-9e21-4c74d10b88b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:08.759544 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0559c290-0e08-4988-9e21-4c74d10b88b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:08.759855 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0559c290-0e08-4988-9e21-4c74d10b88b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:08.761229 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0559c290-0e08-4988-9e21-4c74d10b88b9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:08.769135 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 278/566] 10.222.0.24 () {56 vars in 1103 bytes} [Thu May 19 14:52:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:08.770546 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27edfe-7260-475e-a597-71226b025be4 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:08.770842 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27edfe-7260-475e-a597-71226b025be4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:08.771125 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27edfe-7260-475e-a597-71226b025be4 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:08.772397 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 279/567] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:08.773470 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe04eb8-d44b-47f1-9ab1-8167e7e6d309 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:08.773741 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe04eb8-d44b-47f1-9ab1-8167e7e6d309 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:08.774020 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe04eb8-d44b-47f1-9ab1-8167e7e6d309 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:08.775982 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 280/568] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:08.775982 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe04eb8-d44b-47f1-9ab1-8167e7e6d309 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:08.834115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfb6e3-f373-41b6-8ab2-f6daedfa7934 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:08.868714 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfc905-8ef1-4520-bc22-2499c92053a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:08.869503 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfc905-8ef1-4520-bc22-2499c92053a9 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:08.869788 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfc905-8ef1-4520-bc22-2499c92053a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:08.870063 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfc905-8ef1-4520-bc22-2499c92053a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:08.876393 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:08.879441 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfc905-8ef1-4520-bc22-2499c92053a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:08.882126 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfc905-8ef1-4520-bc22-2499c92053a9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:08.882248 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe04eb8-d44b-47f1-9ab1-8167e7e6d309 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:08.898019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-66cfc905-8ef1-4520-bc22-2499c92053a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:08.898019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:08.898019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:08.898019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:08.898019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:08.898019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:08.898019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:08.898019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:08.898019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:08.898019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:08.898019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:08.898019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:08.898019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:08.898019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:08.898019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:08.899082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:08.899082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:08.899082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:08.899082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:08.899082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:08.899082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:08.899082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:08.899082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:08.899082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:08.899082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:08.899082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:08.899082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:08.899082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:08.899082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:08.899082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:08.899082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:08.899082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:08.900048 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:08.900048 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:08.900048 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:08.900048 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:08.900048 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:08.900048 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:08.900048 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:08.900048 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:08.900048 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 289/569] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:08.900048 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfc905-8ef1-4520-bc22-2499c92053a9 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:08.918694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836972e-515a-4958-bfb0-5571ba021653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:08.919519 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836972e-515a-4958-bfb0-5571ba021653 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:08.919802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836972e-515a-4958-bfb0-5571ba021653 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:08.920075 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836972e-515a-4958-bfb0-5571ba021653 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:08.926489 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836972e-515a-4958-bfb0-5571ba021653 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:08.927949 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836972e-515a-4958-bfb0-5571ba021653 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:08.929593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:08.941818 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-8836972e-515a-4958-bfb0-5571ba021653 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:08.941818 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:08.941818 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:08.941818 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:08.941818 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:08.941818 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:08.941818 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:08.941818 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:08.941818 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:08.941818 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:08.941818 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:08.941818 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:08.941818 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:08.941818 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:08.941818 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:08.942701 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:08.942701 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:08.942701 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:08.942701 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:08.942701 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:08.942701 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:08.942701 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:08.942701 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:08.942701 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:08.942701 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:08.942701 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:08.942701 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:08.942701 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:08.942701 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:08.942701 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:08.942701 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:08.942701 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:08.943630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:08.943630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:08.943630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:08.943630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:08.943630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:08.943630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:08.943630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:08.943630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:08.943630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 281/570] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:08.944437 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe9a68-fdc2-4a12-b8c3-69aeed40109a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:08.944528 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe9a68-fdc2-4a12-b8c3-69aeed40109a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:08.944806 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe9a68-fdc2-4a12-b8c3-69aeed40109a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:08.960790 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-11fe9a68-fdc2-4a12-b8c3-69aeed40109a None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:08.961957 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-11fe9a68-fdc2-4a12-b8c3-69aeed40109a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:09.002295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfc905-8ef1-4520-bc22-2499c92053a9 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:09.027109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 282/571] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:52:09.028451 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be163fd-e82f-46aa-b704-0cd0b6595f52 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:09.028743 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be163fd-e82f-46aa-b704-0cd0b6595f52 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:09.029020 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be163fd-e82f-46aa-b704-0cd0b6595f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:09.038236 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb381f6-3f1e-4dd2-8b43-b310bf31919a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:09.039021 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb381f6-3f1e-4dd2-8b43-b310bf31919a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:09.039325 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb381f6-3f1e-4dd2-8b43-b310bf31919a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:09.039598 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb381f6-3f1e-4dd2-8b43-b310bf31919a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:09.050232 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb381f6-3f1e-4dd2-8b43-b310bf31919a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:09.051725 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb381f6-3f1e-4dd2-8b43-b310bf31919a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:09.057339 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-5be163fd-e82f-46aa-b704-0cd0b6595f52 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:09.058531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5be163fd-e82f-46aa-b704-0cd0b6595f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:09.068879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-6bb381f6-3f1e-4dd2-8b43-b310bf31919a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:09.068879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:09.068879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:09.068879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:09.068879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:09.068879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:09.068879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:09.068879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:09.068879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:09.068879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:09.068879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:09.068879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:09.068879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:09.068879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:09.068879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:09.069892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:09.069892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:09.069892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:09.069892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:09.069892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:09.069892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:09.069892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:09.069892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:09.069892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:09.069892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:09.069892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:09.069892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:09.069892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:09.069892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:09.069892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:09.069892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:09.069892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:09.070790 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:09.070790 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:09.070790 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:09.070790 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:09.070790 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 290/572] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:09.071061 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb381f6-3f1e-4dd2-8b43-b310bf31919a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:09.126184 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 283/573] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:52:09.127027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be163fd-e82f-46aa-b704-0cd0b6595f52 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:09.145449 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:09.162819 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:09.182430 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb381f6-3f1e-4dd2-8b43-b310bf31919a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:09.215274 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f26be5-12c4-4fa7-b916-cc8cdb20f02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:09.215885 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f26be5-12c4-4fa7-b916-cc8cdb20f02b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:09.216167 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f26be5-12c4-4fa7-b916-cc8cdb20f02b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:09.216441 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f26be5-12c4-4fa7-b916-cc8cdb20f02b None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:09.217220 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f26be5-12c4-4fa7-b916-cc8cdb20f02b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:09.217525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f26be5-12c4-4fa7-b916-cc8cdb20f02b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:09.218962 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f26be5-12c4-4fa7-b916-cc8cdb20f02b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:09.230348 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be163fd-e82f-46aa-b704-0cd0b6595f52 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:09.235889 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 291/574] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:52:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:09.235889 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f26be5-12c4-4fa7-b916-cc8cdb20f02b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:09.265241 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb61ab-8d36-464c-881d-4ce84de2c263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:09.265895 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb61ab-8d36-464c-881d-4ce84de2c263 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:09.266179 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb61ab-8d36-464c-881d-4ce84de2c263 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:09.266455 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb61ab-8d36-464c-881d-4ce84de2c263 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:09.267264 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb61ab-8d36-464c-881d-4ce84de2c263 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:09.267575 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb61ab-8d36-464c-881d-4ce84de2c263 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:09.268998 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb61ab-8d36-464c-881d-4ce84de2c263 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:09.280036 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 284/575] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:52:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:09.281318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb61ab-8d36-464c-881d-4ce84de2c263 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:09.341475 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f26be5-12c4-4fa7-b916-cc8cdb20f02b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:09.358858 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:09.375496 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f686c-52fd-4e2b-9295-5a7a5493b3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:09.376280 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f686c-52fd-4e2b-9295-5a7a5493b3fd None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:09.376561 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f686c-52fd-4e2b-9295-5a7a5493b3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:09.376835 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f686c-52fd-4e2b-9295-5a7a5493b3fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:09.380650 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb61ab-8d36-464c-881d-4ce84de2c263 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:09.391074 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f686c-52fd-4e2b-9295-5a7a5493b3fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:09.398929 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-785f686c-52fd-4e2b-9295-5a7a5493b3fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:09.398929 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:09.398929 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:09.398929 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:09.398929 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:09.398929 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:09.398929 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:09.398929 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:09.398929 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:09.398929 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:09.398929 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:09.398929 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:09.398929 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:09.398929 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:09.398929 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:09.398929 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:09.400071 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:09.400071 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:09.400071 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:09.400071 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:09.400071 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:09.400071 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:09.400071 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:09.400071 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:09.400071 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:09.400071 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:09.400071 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:09.400071 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:09.400071 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:09.400071 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:09.400071 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:09.400071 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:09.401097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:09.401097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:09.401097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:09.401097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:09.401097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:09.401097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:09.401097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:09.401097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:09.401097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:09.401097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:09.401097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:09.401097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:09.401097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 292/576] 10.222.0.24 () {56 vars in 1102 bytes} [Thu May 19 14:52:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:09.401097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f686c-52fd-4e2b-9295-5a7a5493b3fd None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:09.403823 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:09.416978 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e130f-4d4f-446b-814b-246b119b6089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:09.417648 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e130f-4d4f-446b-814b-246b119b6089 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:09.417938 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e130f-4d4f-446b-814b-246b119b6089 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:09.418220 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e130f-4d4f-446b-814b-246b119b6089 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:09.418943 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e130f-4d4f-446b-814b-246b119b6089 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:09.419296 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e130f-4d4f-446b-814b-246b119b6089 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:09.420685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e130f-4d4f-446b-814b-246b119b6089 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:09.432314 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 285/577] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:09.433380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e130f-4d4f-446b-814b-246b119b6089 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:09.503071 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f686c-52fd-4e2b-9295-5a7a5493b3fd None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:09.530358 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e130f-4d4f-446b-814b-246b119b6089 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:09.535756 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31dd27-fb8d-415d-a599-918719577a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:09.536550 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31dd27-fb8d-415d-a599-918719577a83 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:09.536835 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31dd27-fb8d-415d-a599-918719577a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:09.537114 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31dd27-fb8d-415d-a599-918719577a83 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:09.547049 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31dd27-fb8d-415d-a599-918719577a83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:09.554868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-3e31dd27-fb8d-415d-a599-918719577a83 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:09.554868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:09.554868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:09.554868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:09.554868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:09.554868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:09.554868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:09.554868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:09.554868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:09.554868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:09.554868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:09.554868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:09.554868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:09.554868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:09.554868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:09.554868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:09.556018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:09.556018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:09.556018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:09.556018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:09.556018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:09.556018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:09.556018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:09.556018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:09.556018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:09.556018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:09.556018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:09.556018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:09.556018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:09.556018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:09.556018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:09.556018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:09.557090 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:09.557090 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:09.557090 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:09.557090 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:09.557090 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:09.557090 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:09.557090 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:09.557090 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:09.557090 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:09.557090 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:09.557090 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:09.557090 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:09.557090 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 293/578] 10.222.0.24 () {56 vars in 1102 bytes} [Thu May 19 14:52:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:09.557090 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31dd27-fb8d-415d-a599-918719577a83 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:09.567952 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc9aa3-a80a-41b3-9647-8865ac788c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:09.568606 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc9aa3-a80a-41b3-9647-8865ac788c45 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:09.568891 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc9aa3-a80a-41b3-9647-8865ac788c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:09.569173 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc9aa3-a80a-41b3-9647-8865ac788c45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:09.569997 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc9aa3-a80a-41b3-9647-8865ac788c45 None admin] RBAC: Adding query filter params (role.id=4d4ff927beb7409996558ecf7143d419, scope.project.id=2633b53c336145bba3d4744dbdfe99b7, user.id=8ecbeee0c1cf4c58be6c22aa11d7ff5a) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:09.570314 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc9aa3-a80a-41b3-9647-8865ac788c45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:09.571784 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc9aa3-a80a-41b3-9647-8865ac788c45 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:09.577373 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 286/579] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:52:09 2022] GET /identity/v3/role_assignments?user.id=8ecbeee0c1cf4c58be6c22aa11d7ff5a&scope.project.id=2633b53c336145bba3d4744dbdfe99b7&role.id=4d4ff927beb7409996558ecf7143d419 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:09.578704 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc9aa3-a80a-41b3-9647-8865ac788c45 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:09.581194 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:09.629349 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:09.675558 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31dd27-fb8d-415d-a599-918719577a83 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:09.691503 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc9aa3-a80a-41b3-9647-8865ac788c45 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:09.717442 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f511adf-56aa-4437-9f08-5e6e96cbd6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:09.718768 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f511adf-56aa-4437-9f08-5e6e96cbd6a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:09.719300 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f511adf-56aa-4437-9f08-5e6e96cbd6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:09.719813 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f511adf-56aa-4437-9f08-5e6e96cbd6a6 None admin] PATH_INFO: `/v3/projects/2633b53c336145bba3d4744dbdfe99b7/users/06fb8bb5aeb143ad95f33c3b43dbd346/roles/4d4ff927beb7409996558ecf7143d419` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:09.727561 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd4bcd-0c6c-43ca-a3a0-27969a88e1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:09.728251 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd4bcd-0c6c-43ca-a3a0-27969a88e1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:09.728541 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd4bcd-0c6c-43ca-a3a0-27969a88e1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:09.728820 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd4bcd-0c6c-43ca-a3a0-27969a88e1b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:09.729579 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd4bcd-0c6c-43ca-a3a0-27969a88e1b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:09.729891 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd4bcd-0c6c-43ca-a3a0-27969a88e1b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:09.731377 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd4bcd-0c6c-43ca-a3a0-27969a88e1b0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:09.739498 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f511adf-56aa-4437-9f08-5e6e96cbd6a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=2633b53c336145bba3d4744dbdfe99b7, user_id=06fb8bb5aeb143ad95f33c3b43dbd346, role_id=4d4ff927beb7409996558ecf7143d419)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:09.740842 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 287/580] 10.222.0.24 () {56 vars in 1103 bytes} [Thu May 19 14:52:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:09.741511 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f511adf-56aa-4437-9f08-5e6e96cbd6a6 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:09.741752 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd4bcd-0c6c-43ca-a3a0-27969a88e1b0 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:09.763340 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 294/581] 10.222.0.24 () {58 vars in 1439 bytes} [Thu May 19 14:52:09 2022] PUT /identity/v3/projects/2633b53c336145bba3d4744dbdfe99b7/users/06fb8bb5aeb143ad95f33c3b43dbd346/roles/4d4ff927beb7409996558ecf7143d419 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:52:09.764807 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f511adf-56aa-4437-9f08-5e6e96cbd6a6 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:09.845079 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:09.887026 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f511adf-56aa-4437-9f08-5e6e96cbd6a6 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:09.901514 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd4bcd-0c6c-43ca-a3a0-27969a88e1b0 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:09.915624 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:09.928214 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f65d6-348b-4677-9017-421cda2d25f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:09.929270 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f65d6-348b-4677-9017-421cda2d25f6 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:09.930388 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f65d6-348b-4677-9017-421cda2d25f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:09.930943 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f65d6-348b-4677-9017-421cda2d25f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:09.932345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f65d6-348b-4677-9017-421cda2d25f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:09.932845 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f65d6-348b-4677-9017-421cda2d25f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:09.935298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f65d6-348b-4677-9017-421cda2d25f6 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:09.946839 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 295/582] 10.222.0.24 () {56 vars in 1103 bytes} [Thu May 19 14:52:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:09.951237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f65d6-348b-4677-9017-421cda2d25f6 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:09.954565 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9badba90-da84-4419-9393-efde542f49df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:09.956738 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badba90-da84-4419-9393-efde542f49df None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:09.957188 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badba90-da84-4419-9393-efde542f49df None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:09.957647 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badba90-da84-4419-9393-efde542f49df None admin] PATH_INFO: `/v3/users/glance` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:09.968711 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9badba90-da84-4419-9393-efde542f49df None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:09.970375 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9badba90-da84-4419-9393-efde542f49df None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:09.989843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-9badba90-da84-4419-9393-efde542f49df None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 14:52:09.989843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:09.989843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:09.989843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:09.989843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:09.989843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:09.989843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:09.989843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:09.989843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:09.989843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:09.989843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:09.989843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:09.989843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:09.989843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:09.989843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:09.989843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:09.991037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:09.991037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:09.991037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:09.991037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:09.991037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:09.991037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:09.991037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:09.991037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:09.991037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:09.991037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:09.991037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:09.991037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:09.991037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:09.991037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:09.991037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:09.991037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:09.991037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:09.991037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:09.992177 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:09.992177 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:09.992177 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:09.992177 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:09.992177 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:09.992177 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:09.992177 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:09.992177 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:09.992177 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 14:52:09.992177 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:09.993554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 288/583] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:52:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:09.994359 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9badba90-da84-4419-9393-efde542f49df None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:10.068151 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f65d6-348b-4677-9017-421cda2d25f6 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:10.113336 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171dd5ca-b85a-41a8-a499-e19b55bebbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:10.113677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9badba90-da84-4419-9393-efde542f49df None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:10.114623 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171dd5ca-b85a-41a8-a499-e19b55bebbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:10.115345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171dd5ca-b85a-41a8-a499-e19b55bebbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:10.115773 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171dd5ca-b85a-41a8-a499-e19b55bebbc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:10.131937 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171dd5ca-b85a-41a8-a499-e19b55bebbc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:10.134065 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171dd5ca-b85a-41a8-a499-e19b55bebbc8 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:10.139738 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:10.152286 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8b6ce-0542-4806-83e0-f1ceaeed4910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:10.153086 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8b6ce-0542-4806-83e0-f1ceaeed4910 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:10.153375 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8b6ce-0542-4806-83e0-f1ceaeed4910 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:10.153660 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8b6ce-0542-4806-83e0-f1ceaeed4910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:10.161630 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-171dd5ca-b85a-41a8-a499-e19b55bebbc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:10.161630 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:10.161630 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:10.161630 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:10.161630 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:10.161630 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:10.161630 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:10.161630 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:10.161630 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:10.161630 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:10.161630 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:10.161630 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:10.161630 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:10.161630 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:10.161630 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:10.164954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:10.164954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:10.164954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:10.164954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:10.164954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:10.164954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:10.164954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:10.164954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:10.164954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:10.164954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:10.164954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:10.164954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:10.164954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:10.164954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:10.164954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:10.164954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:10.164954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:10.165848 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:10.165848 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:10.165848 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:10.165848 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:10.165848 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 296/584] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:10.166138 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171dd5ca-b85a-41a8-a499-e19b55bebbc8 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:10.173248 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8b6ce-0542-4806-83e0-f1ceaeed4910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:10.175640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8b6ce-0542-4806-83e0-f1ceaeed4910 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:10.200781 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-15d8b6ce-0542-4806-83e0-f1ceaeed4910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:10.200781 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:10.200781 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:10.200781 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:10.200781 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:10.200781 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:10.200781 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:10.200781 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:10.200781 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:10.200781 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:10.200781 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:10.200781 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:10.200781 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:10.200781 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:10.200781 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:10.201922 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:10.201922 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:10.201922 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:10.201922 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:10.201922 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:10.201922 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:10.201922 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:10.201922 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:10.201922 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:10.201922 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:10.201922 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:10.201922 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:10.201922 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:10.201922 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:10.201922 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:10.201922 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:10.201922 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:10.202956 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:10.202956 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:10.202956 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:10.202956 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:10.202956 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 289/585] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:10.203263 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8b6ce-0542-4806-83e0-f1ceaeed4910 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:10.214416 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:10.288974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171dd5ca-b85a-41a8-a499-e19b55bebbc8 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:10.314370 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8b6ce-0542-4806-83e0-f1ceaeed4910 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:10.329877 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9c92d-9a83-49a6-96cc-8e36bc71a92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:10.331052 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9c92d-9a83-49a6-96cc-8e36bc71a92d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:10.331513 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9c92d-9a83-49a6-96cc-8e36bc71a92d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:10.331926 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9c92d-9a83-49a6-96cc-8e36bc71a92d None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:10.333538 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a9c92d-9a83-49a6-96cc-8e36bc71a92d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:10.334148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a9c92d-9a83-49a6-96cc-8e36bc71a92d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:10.336021 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a9c92d-9a83-49a6-96cc-8e36bc71a92d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:10.357804 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 297/586] 10.222.0.24 () {56 vars in 1137 bytes} [Thu May 19 14:52:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:10.359428 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9c92d-9a83-49a6-96cc-8e36bc71a92d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:10.365420 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb395ffa-87b0-4017-98ca-50b338f514b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:10.366105 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb395ffa-87b0-4017-98ca-50b338f514b0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:10.366395 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb395ffa-87b0-4017-98ca-50b338f514b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:10.366677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb395ffa-87b0-4017-98ca-50b338f514b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:10.367446 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb395ffa-87b0-4017-98ca-50b338f514b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:10.367763 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb395ffa-87b0-4017-98ca-50b338f514b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:10.369255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb395ffa-87b0-4017-98ca-50b338f514b0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:10.382878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 290/587] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:10.383781 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb395ffa-87b0-4017-98ca-50b338f514b0 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:10.422566 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:10.468888 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:10.487267 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9c92d-9a83-49a6-96cc-8e36bc71a92d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:10.508341 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb395ffa-87b0-4017-98ca-50b338f514b0 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:10.532906 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5289fdf-3b2b-44a9-abe5-937c641c550f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:10.533573 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5289fdf-3b2b-44a9-abe5-937c641c550f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:10.533856 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5289fdf-3b2b-44a9-abe5-937c641c550f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:10.534133 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5289fdf-3b2b-44a9-abe5-937c641c550f None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:10.534856 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5289fdf-3b2b-44a9-abe5-937c641c550f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:10.535163 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5289fdf-3b2b-44a9-abe5-937c641c550f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:10.536759 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5289fdf-3b2b-44a9-abe5-937c641c550f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:10.549514 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 298/588] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:10.550467 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5289fdf-3b2b-44a9-abe5-937c641c550f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:10.551297 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05f6ad-4a9b-4e32-b0eb-aac459aa48ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:10.552348 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05f6ad-4a9b-4e32-b0eb-aac459aa48ea None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:10.552903 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05f6ad-4a9b-4e32-b0eb-aac459aa48ea None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:10.553450 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05f6ad-4a9b-4e32-b0eb-aac459aa48ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:10.564690 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05f6ad-4a9b-4e32-b0eb-aac459aa48ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:10.566454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05f6ad-4a9b-4e32-b0eb-aac459aa48ea None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:10.585262 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-2b05f6ad-4a9b-4e32-b0eb-aac459aa48ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:10.585262 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:10.585262 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:10.585262 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:10.585262 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:10.585262 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:10.585262 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:10.585262 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:10.585262 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:10.585262 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:10.585262 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:10.585262 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:10.585262 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:10.585262 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:10.585262 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:10.586166 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:10.586166 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:10.586166 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:10.586166 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:10.586166 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:10.586166 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:10.586166 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:10.586166 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:10.586166 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:10.586166 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:10.586166 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:10.586166 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:10.586166 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:10.586166 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:10.586166 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:10.586166 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:10.586166 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:10.587050 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:10.587050 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:10.587050 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:10.587050 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:10.594243 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 291/589] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:10.595410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05f6ad-4a9b-4e32-b0eb-aac459aa48ea None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:10.660897 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5289fdf-3b2b-44a9-abe5-937c641c550f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:10.685958 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:10.698079 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a6c70-4fd3-4277-830b-c302bb42a50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:10.699115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a6c70-4fd3-4277-830b-c302bb42a50e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:10.699622 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a6c70-4fd3-4277-830b-c302bb42a50e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:10.699932 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05f6ad-4a9b-4e32-b0eb-aac459aa48ea None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:10.700209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a6c70-4fd3-4277-830b-c302bb42a50e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:10.710071 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a6c70-4fd3-4277-830b-c302bb42a50e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:10.712145 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a6c70-4fd3-4277-830b-c302bb42a50e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:10.729541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-1c2a6c70-4fd3-4277-830b-c302bb42a50e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:52:10.729541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:10.729541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:10.729541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:10.729541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:10.729541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:10.729541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:10.729541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:10.729541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:10.729541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:10.729541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:10.729541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:10.729541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:10.729541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:10.729541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:10.729541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:10.730699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:10.730699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:10.730699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:10.730699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:10.730699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:10.730699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:10.730699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:10.730699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:10.730699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:10.730699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:10.730699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:10.730699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:10.730699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:10.730699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:10.730699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:10.730699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:10.730699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:10.730699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:10.731879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:10.731879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:10.731879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:10.731879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:10.731879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:10.731879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:10.731879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:10.731879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:10.731879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:52:10.731879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:10.738776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 299/590] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:52:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:10.739769 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a6c70-4fd3-4277-830b-c302bb42a50e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:10.742041 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78470c4b-91ec-4891-a007-62f9fc5ed549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:10.742946 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78470c4b-91ec-4891-a007-62f9fc5ed549 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:10.743374 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78470c4b-91ec-4891-a007-62f9fc5ed549 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:10.743756 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78470c4b-91ec-4891-a007-62f9fc5ed549 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:10.744342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:10.753747 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78470c4b-91ec-4891-a007-62f9fc5ed549 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:10.755529 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78470c4b-91ec-4891-a007-62f9fc5ed549 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:10.772223 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-78470c4b-91ec-4891-a007-62f9fc5ed549 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 14:52:10.772223 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:10.772223 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:10.772223 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:10.772223 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:10.772223 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:10.772223 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:10.772223 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:10.772223 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:10.772223 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:10.772223 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:10.772223 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:10.772223 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:10.772223 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:10.772223 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:10.772223 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:10.773318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:10.773318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:10.773318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:10.773318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:10.773318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:10.773318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:10.773318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:10.773318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:10.773318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:10.773318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:10.773318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:10.773318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:10.773318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:10.773318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:10.773318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:10.773318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:10.773318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:10.773318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:10.774465 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:10.774465 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:10.774465 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:10.774465 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:10.774465 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:10.774465 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:10.774465 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:10.774465 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:10.774465 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 14:52:10.774465 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:10.776548 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 292/591] 10.222.0.24 () {56 vars in 1102 bytes} [Thu May 19 14:52:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:10.777268 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78470c4b-91ec-4891-a007-62f9fc5ed549 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:10.852868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a6c70-4fd3-4277-830b-c302bb42a50e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:10.884972 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78470c4b-91ec-4891-a007-62f9fc5ed549 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:10.889079 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17821e5a-d974-40db-8b3f-9330d510d16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:10.889909 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17821e5a-d974-40db-8b3f-9330d510d16e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:10.890887 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17821e5a-d974-40db-8b3f-9330d510d16e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:10.891432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17821e5a-d974-40db-8b3f-9330d510d16e None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:10.892301 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17821e5a-d974-40db-8b3f-9330d510d16e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:10.892752 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17821e5a-d974-40db-8b3f-9330d510d16e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:10.894273 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17821e5a-d974-40db-8b3f-9330d510d16e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:10.907503 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 300/592] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:10.908589 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17821e5a-d974-40db-8b3f-9330d510d16e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:10.932232 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e6577-e592-402f-9669-2dfc7b9eb1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:10.933158 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e6577-e592-402f-9669-2dfc7b9eb1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:10.933590 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e6577-e592-402f-9669-2dfc7b9eb1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:10.934014 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e6577-e592-402f-9669-2dfc7b9eb1d9 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:10.935115 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e6577-e592-402f-9669-2dfc7b9eb1d9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:10.935592 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e6577-e592-402f-9669-2dfc7b9eb1d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:10.937953 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e6577-e592-402f-9669-2dfc7b9eb1d9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:10.963385 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 293/593] 10.222.0.24 () {56 vars in 1137 bytes} [Thu May 19 14:52:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:10.963385 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e6577-e592-402f-9669-2dfc7b9eb1d9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:10.969423 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:10.982580 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:11.026399 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17821e5a-d974-40db-8b3f-9330d510d16e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:11.063029 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a818f8d-6ba5-4f4e-81e3-460355a17927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:11.064101 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a818f8d-6ba5-4f4e-81e3-460355a17927 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:11.064604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a818f8d-6ba5-4f4e-81e3-460355a17927 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:11.065092 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a818f8d-6ba5-4f4e-81e3-460355a17927 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:11.066142 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a818f8d-6ba5-4f4e-81e3-460355a17927 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:11.066751 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a818f8d-6ba5-4f4e-81e3-460355a17927 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:11.068521 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a818f8d-6ba5-4f4e-81e3-460355a17927 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:11.070285 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e6577-e592-402f-9669-2dfc7b9eb1d9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:11.088760 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 301/594] 10.222.0.24 () {56 vars in 1139 bytes} [Thu May 19 14:52:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:11.090070 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a818f8d-6ba5-4f4e-81e3-460355a17927 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:11.106354 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e77ee0-ab98-4619-b9ad-ea4f3a9a9015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:11.107146 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e77ee0-ab98-4619-b9ad-ea4f3a9a9015 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:11.107464 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e77ee0-ab98-4619-b9ad-ea4f3a9a9015 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:11.107739 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e77ee0-ab98-4619-b9ad-ea4f3a9a9015 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:11.115840 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e77ee0-ab98-4619-b9ad-ea4f3a9a9015 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:11.117437 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e77ee0-ab98-4619-b9ad-ea4f3a9a9015 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:11.133137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-33e77ee0-ab98-4619-b9ad-ea4f3a9a9015 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:11.133137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:11.133137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:11.133137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:11.133137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:11.133137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:11.133137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:11.133137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:11.133137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:11.133137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:11.133137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:11.133137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:11.133137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:11.133137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:11.133137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:11.134037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:11.134037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:11.134037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:11.134037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:11.134037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:11.134037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:11.134037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:11.134037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:11.134037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:11.134037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:11.134037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:11.134037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:11.134037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:11.134037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:11.134037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:11.134037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:11.134037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:11.135989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:11.135989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:11.135989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:11.135989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:11.135989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:11.135989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:11.135989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:11.135989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:11.139069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 294/595] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:11.139905 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e77ee0-ab98-4619-b9ad-ea4f3a9a9015 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:11.203035 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a818f8d-6ba5-4f4e-81e3-460355a17927 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:11.213301 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:11.230703 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:11.244862 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edcfd5-9e70-434d-b1c5-9192e94f4b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:11.246189 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edcfd5-9e70-434d-b1c5-9192e94f4b4e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:11.246768 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edcfd5-9e70-434d-b1c5-9192e94f4b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:11.247397 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edcfd5-9e70-434d-b1c5-9192e94f4b4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:11.254041 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e77ee0-ab98-4619-b9ad-ea4f3a9a9015 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:11.259114 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edcfd5-9e70-434d-b1c5-9192e94f4b4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:11.260820 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1edcfd5-9e70-434d-b1c5-9192e94f4b4e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:11.279579 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-b1edcfd5-9e70-434d-b1c5-9192e94f4b4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:11.279579 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:11.279579 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:11.279579 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:11.279579 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:11.279579 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:11.279579 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:11.279579 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:11.279579 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:11.279579 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:11.279579 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:11.279579 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:11.279579 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:11.279579 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:11.279579 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:11.280503 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:11.280503 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:11.280503 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:11.280503 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:11.280503 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:11.280503 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:11.280503 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:11.280503 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:11.280503 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:11.280503 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:11.280503 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:11.280503 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:11.280503 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:11.280503 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:11.280503 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:11.280503 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:11.280503 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:11.281419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:11.281419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:11.281419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:11.281419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:11.288901 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087ef91-f48f-4fe0-b8df-1abb9a77a48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:11.289206 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 302/596] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:11.289701 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087ef91-f48f-4fe0-b8df-1abb9a77a48b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:11.289990 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087ef91-f48f-4fe0-b8df-1abb9a77a48b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:11.290272 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087ef91-f48f-4fe0-b8df-1abb9a77a48b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:11.290913 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edcfd5-9e70-434d-b1c5-9192e94f4b4e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:11.302523 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087ef91-f48f-4fe0-b8df-1abb9a77a48b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:11.304126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087ef91-f48f-4fe0-b8df-1abb9a77a48b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:11.330016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-0087ef91-f48f-4fe0-b8df-1abb9a77a48b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:11.330016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:11.330016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:11.330016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:11.330016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:11.330016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:11.330016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:11.330016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:11.330016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:11.330016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:11.330016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:11.330016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:11.330016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:11.330016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:11.330016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:11.330921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:11.330921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:11.330921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:11.330921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:11.330921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:11.330921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:11.330921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:11.330921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:11.330921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:11.330921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:11.330921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:11.330921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:11.330921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:11.330921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:11.330921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:11.330921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:11.330921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:11.332987 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:11.332987 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:11.332987 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:11.332987 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:11.332987 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 295/597] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:11.332987 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087ef91-f48f-4fe0-b8df-1abb9a77a48b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:11.407947 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edcfd5-9e70-434d-b1c5-9192e94f4b4e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:11.441986 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087ef91-f48f-4fe0-b8df-1abb9a77a48b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:11.447153 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee42d4-ad82-489f-8c1b-e8b9863e8f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:11.448089 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee42d4-ad82-489f-8c1b-e8b9863e8f5e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:11.448616 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee42d4-ad82-489f-8c1b-e8b9863e8f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:11.449099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee42d4-ad82-489f-8c1b-e8b9863e8f5e None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:11.450254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee42d4-ad82-489f-8c1b-e8b9863e8f5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:11.450766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee42d4-ad82-489f-8c1b-e8b9863e8f5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:11.453097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee42d4-ad82-489f-8c1b-e8b9863e8f5e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:11.461630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:11.468925 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 303/598] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:52:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:11.470393 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee42d4-ad82-489f-8c1b-e8b9863e8f5e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:11.485534 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad771735-ea6c-421a-ae78-9e6e798e0449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:11.486214 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad771735-ea6c-421a-ae78-9e6e798e0449 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:11.486507 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad771735-ea6c-421a-ae78-9e6e798e0449 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:11.486797 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad771735-ea6c-421a-ae78-9e6e798e0449 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:11.487629 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad771735-ea6c-421a-ae78-9e6e798e0449 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:11.487982 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad771735-ea6c-421a-ae78-9e6e798e0449 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:11.489812 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad771735-ea6c-421a-ae78-9e6e798e0449 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:11.507625 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 296/599] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:11.508485 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad771735-ea6c-421a-ae78-9e6e798e0449 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:11.510462 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:11.585503 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee42d4-ad82-489f-8c1b-e8b9863e8f5e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:11.624969 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad771735-ea6c-421a-ae78-9e6e798e0449 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:11.625906 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da751311-c2a0-4334-9ef7-206d275be7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:11.626595 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da751311-c2a0-4334-9ef7-206d275be7ca None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:11.626877 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da751311-c2a0-4334-9ef7-206d275be7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:11.627153 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da751311-c2a0-4334-9ef7-206d275be7ca None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:11.628286 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da751311-c2a0-4334-9ef7-206d275be7ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:11.628617 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da751311-c2a0-4334-9ef7-206d275be7ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:11.631188 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da751311-c2a0-4334-9ef7-206d275be7ca None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:11.648900 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 304/600] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:11.649916 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da751311-c2a0-4334-9ef7-206d275be7ca None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:11.676370 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14ee7d-12c4-4f23-bb75-e7ee55af0abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:11.677645 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14ee7d-12c4-4f23-bb75-e7ee55af0abf None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:11.678564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14ee7d-12c4-4f23-bb75-e7ee55af0abf None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:11.679029 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14ee7d-12c4-4f23-bb75-e7ee55af0abf None admin] PATH_INFO: `/v3/projects/2633b53c336145bba3d4744dbdfe99b7/users/b1dc1d74631b4d69a3094e4e1e2a0ebd/roles/4d4ff927beb7409996558ecf7143d419` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:11.698213 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14ee7d-12c4-4f23-bb75-e7ee55af0abf None admin] RBAC: Authorizing `identity:create_grant(project_id=2633b53c336145bba3d4744dbdfe99b7, user_id=b1dc1d74631b4d69a3094e4e1e2a0ebd, role_id=4d4ff927beb7409996558ecf7143d419)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:11.700420 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14ee7d-12c4-4f23-bb75-e7ee55af0abf None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:11.719259 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 297/601] 10.222.0.24 () {58 vars in 1439 bytes} [Thu May 19 14:52:11 2022] PUT /identity/v3/projects/2633b53c336145bba3d4744dbdfe99b7/users/b1dc1d74631b4d69a3094e4e1e2a0ebd/roles/4d4ff927beb7409996558ecf7143d419 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:52:11.721032 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14ee7d-12c4-4f23-bb75-e7ee55af0abf None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:11.759864 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:11.761892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:11.783925 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da751311-c2a0-4334-9ef7-206d275be7ca None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:11.868681 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea89881-ec8a-4bf9-a2e7-19275837ce66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:11.869810 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea89881-ec8a-4bf9-a2e7-19275837ce66 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:11.870091 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea89881-ec8a-4bf9-a2e7-19275837ce66 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:11.870619 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea89881-ec8a-4bf9-a2e7-19275837ce66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:11.883602 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea89881-ec8a-4bf9-a2e7-19275837ce66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:11.885709 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea89881-ec8a-4bf9-a2e7-19275837ce66 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:11.903288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-0ea89881-ec8a-4bf9-a2e7-19275837ce66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:11.903288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:11.903288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:11.903288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:11.903288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:11.903288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:11.903288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:11.903288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:11.903288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:11.903288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:11.903288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:11.903288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:11.903288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:11.903288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:11.903288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:11.904254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:11.904254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:11.904254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:11.904254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:11.904254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:11.904254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:11.904254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:11.904254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:11.904254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:11.904254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:11.904254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:11.904254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:11.904254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:11.904254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:11.904254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:11.904254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:11.904254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:11.905195 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:11.905195 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:11.905195 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:11.905195 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:11.905195 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:11.905195 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:11.905195 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:11.905195 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:11.907616 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14ee7d-12c4-4f23-bb75-e7ee55af0abf None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:11.908874 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 305/602] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:11.910952 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05759f0-b787-4b65-8dd1-ce2f44700312 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:11.911506 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05759f0-b787-4b65-8dd1-ce2f44700312 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:11.911976 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05759f0-b787-4b65-8dd1-ce2f44700312 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:11.918755 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 306/603] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:11.920220 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05759f0-b787-4b65-8dd1-ce2f44700312 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:11.949075 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916ac85-525c-49db-a716-5de133dd59c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:11.950241 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916ac85-525c-49db-a716-5de133dd59c8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:11.950793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916ac85-525c-49db-a716-5de133dd59c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:11.951292 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916ac85-525c-49db-a716-5de133dd59c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:11.960702 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916ac85-525c-49db-a716-5de133dd59c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:11.962406 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916ac85-525c-49db-a716-5de133dd59c8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:11.985050 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-6916ac85-525c-49db-a716-5de133dd59c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:11.985050 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:11.985050 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:11.985050 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:11.985050 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:11.985050 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:11.985050 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:11.985050 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:11.985050 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:11.985050 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:11.985050 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:11.985050 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:11.985050 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:11.985050 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:11.985050 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:11.986921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:11.986921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:11.986921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:11.986921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:11.986921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:11.986921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:11.986921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:11.986921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:11.986921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:11.986921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:11.986921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:11.986921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:11.986921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:11.986921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:11.986921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:11.986921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:11.986921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:11.989046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:11.989046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:11.989046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:11.989046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:11.989046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:11.989046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:11.989046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:11.989046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:11.992616 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 298/604] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:11.994776 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4185fb-3ccc-49d5-bcf7-ff81b65d98fe None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:11.995735 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4185fb-3ccc-49d5-bcf7-ff81b65d98fe None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:11.996425 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4185fb-3ccc-49d5-bcf7-ff81b65d98fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:12.023071 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-df4185fb-3ccc-49d5-bcf7-ff81b65d98fe None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:12.025292 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-df4185fb-3ccc-49d5-bcf7-ff81b65d98fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:12.067174 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05759f0-b787-4b65-8dd1-ce2f44700312 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:12.106726 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3634ea2-6fc0-4e2d-b629-26a2fa419eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:12.107415 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3634ea2-6fc0-4e2d-b629-26a2fa419eca None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:12.107700 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3634ea2-6fc0-4e2d-b629-26a2fa419eca None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:12.107976 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3634ea2-6fc0-4e2d-b629-26a2fa419eca None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:12.109277 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3634ea2-6fc0-4e2d-b629-26a2fa419eca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:12.109588 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3634ea2-6fc0-4e2d-b629-26a2fa419eca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:12.111006 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3634ea2-6fc0-4e2d-b629-26a2fa419eca None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:12.123586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 307/605] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:52:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:12.124935 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3634ea2-6fc0-4e2d-b629-26a2fa419eca None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:12.126068 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 299/606] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:52:12.127847 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609794cb-1143-4fe8-972d-88f6f030bd3e None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:12.129222 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609794cb-1143-4fe8-972d-88f6f030bd3e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:12.129664 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609794cb-1143-4fe8-972d-88f6f030bd3e None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:12.131111 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 300/607] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:12.131948 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609794cb-1143-4fe8-972d-88f6f030bd3e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:12.140915 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:12.156575 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:12.234988 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3634ea2-6fc0-4e2d-b629-26a2fa419eca None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:12.250854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609794cb-1143-4fe8-972d-88f6f030bd3e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:12.270372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355940a-033c-4bc0-b299-c6c49c03b3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:12.271031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355940a-033c-4bc0-b299-c6c49c03b3b9 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:12.271359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355940a-033c-4bc0-b299-c6c49c03b3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:12.271635 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355940a-033c-4bc0-b299-c6c49c03b3b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:12.272421 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355940a-033c-4bc0-b299-c6c49c03b3b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:12.272728 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355940a-033c-4bc0-b299-c6c49c03b3b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:12.274170 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355940a-033c-4bc0-b299-c6c49c03b3b9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:12.286072 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 308/608] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:52:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:12.287309 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc9111-2e67-49b4-afa6-97a026598723 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:12.287593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc9111-2e67-49b4-afa6-97a026598723 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:12.287869 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc9111-2e67-49b4-afa6-97a026598723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:12.296051 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae658ac3-fc13-4b09-bb0a-16f46e17efee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:12.297670 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae658ac3-fc13-4b09-bb0a-16f46e17efee None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:12.298128 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae658ac3-fc13-4b09-bb0a-16f46e17efee None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:12.298556 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae658ac3-fc13-4b09-bb0a-16f46e17efee None admin] PATH_INFO: `/v3/projects/2633b53c336145bba3d4744dbdfe99b7/users/ed3a61154a444a9cb925839f693208c9/roles/4d4ff927beb7409996558ecf7143d419` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:12.304448 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-07fc9111-2e67-49b4-afa6-97a026598723 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:12.305637 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-07fc9111-2e67-49b4-afa6-97a026598723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:12.316559 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae658ac3-fc13-4b09-bb0a-16f46e17efee None admin] RBAC: Authorizing `identity:create_grant(project_id=2633b53c336145bba3d4744dbdfe99b7, user_id=ed3a61154a444a9cb925839f693208c9, role_id=4d4ff927beb7409996558ecf7143d419)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:12.318730 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae658ac3-fc13-4b09-bb0a-16f46e17efee None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:12.340796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 301/609] 10.222.0.24 () {58 vars in 1439 bytes} [Thu May 19 14:52:12 2022] PUT /identity/v3/projects/2633b53c336145bba3d4744dbdfe99b7/users/ed3a61154a444a9cb925839f693208c9/roles/4d4ff927beb7409996558ecf7143d419 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:52:12.342024 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae658ac3-fc13-4b09-bb0a-16f46e17efee None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:12.403258 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 309/610] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:52:12.404701 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc9111-2e67-49b4-afa6-97a026598723 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:12.410590 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:12.437683 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:12.490185 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae658ac3-fc13-4b09-bb0a-16f46e17efee None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:12.533548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc9111-2e67-49b4-afa6-97a026598723 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:12.539315 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb7a7c-a9ba-40ca-86bd-12c74e68d90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:12.540124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb7a7c-a9ba-40ca-86bd-12c74e68d90b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:12.540405 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb7a7c-a9ba-40ca-86bd-12c74e68d90b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:12.540678 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb7a7c-a9ba-40ca-86bd-12c74e68d90b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:12.552695 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb7a7c-a9ba-40ca-86bd-12c74e68d90b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:12.560688 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-1efb7a7c-a9ba-40ca-86bd-12c74e68d90b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:12.560688 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:12.560688 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:12.560688 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:12.560688 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:12.560688 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:12.560688 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:12.560688 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:12.560688 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:12.560688 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:12.560688 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:12.560688 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:12.560688 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:12.560688 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:12.560688 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:12.560688 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:12.561658 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:12.561658 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:12.561658 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:12.561658 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:12.561658 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:12.561658 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:12.561658 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:12.561658 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:12.561658 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:12.561658 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:12.561658 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:12.561658 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:12.561658 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:12.561658 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:12.561658 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:12.561658 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:12.562589 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:12.562589 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:12.562589 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:12.562589 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:12.562589 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:12.562589 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:12.562589 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:12.562589 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:12.562589 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:12.562589 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:12.562589 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:12.562589 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:12.562589 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 302/611] 10.222.0.24 () {56 vars in 1102 bytes} [Thu May 19 14:52:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:12.563380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb7a7c-a9ba-40ca-86bd-12c74e68d90b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:12.582534 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31572fac-1fb5-40dc-ba4d-bcc4c61dd3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:12.583608 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31572fac-1fb5-40dc-ba4d-bcc4c61dd3e5 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:12.583957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31572fac-1fb5-40dc-ba4d-bcc4c61dd3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:12.584308 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31572fac-1fb5-40dc-ba4d-bcc4c61dd3e5 None admin] PATH_INFO: `/v3/projects/2633b53c336145bba3d4744dbdfe99b7/users/2d089b5ee94e441ebbd084c2581a42df/roles/4d4ff927beb7409996558ecf7143d419` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:12.601039 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31572fac-1fb5-40dc-ba4d-bcc4c61dd3e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=2633b53c336145bba3d4744dbdfe99b7, user_id=2d089b5ee94e441ebbd084c2581a42df, role_id=4d4ff927beb7409996558ecf7143d419)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:12.602695 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31572fac-1fb5-40dc-ba4d-bcc4c61dd3e5 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:12.625108 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 310/612] 10.222.0.24 () {58 vars in 1439 bytes} [Thu May 19 14:52:12 2022] PUT /identity/v3/projects/2633b53c336145bba3d4744dbdfe99b7/users/2d089b5ee94e441ebbd084c2581a42df/roles/4d4ff927beb7409996558ecf7143d419 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:52:12.626263 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31572fac-1fb5-40dc-ba4d-bcc4c61dd3e5 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:12.714151 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb7a7c-a9ba-40ca-86bd-12c74e68d90b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:12.730103 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:12.775778 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:12.793321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b77dee-29a6-415f-922d-b5f33feba314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:12.794135 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b77dee-29a6-415f-922d-b5f33feba314 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:12.794420 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b77dee-29a6-415f-922d-b5f33feba314 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:12.794693 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b77dee-29a6-415f-922d-b5f33feba314 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:12.812744 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31572fac-1fb5-40dc-ba4d-bcc4c61dd3e5 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:12.818139 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b77dee-29a6-415f-922d-b5f33feba314 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:12.835294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-22b77dee-29a6-415f-922d-b5f33feba314 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:12.835294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:12.835294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:12.835294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:12.835294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:12.835294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:12.835294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:12.835294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:12.835294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:12.835294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:12.835294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:12.835294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:12.835294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:12.835294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:12.835294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:12.835294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:12.836316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:12.836316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:12.836316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:12.836316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:12.836316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:12.836316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:12.836316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:12.836316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:12.836316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:12.836316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:12.836316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:12.836316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:12.836316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:12.836316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:12.836316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:12.836316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:12.837155 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:12.837155 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:12.837155 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:12.837155 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:12.837155 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:12.837155 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:12.837155 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:12.837155 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:12.837155 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:12.837155 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:12.837155 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:12.837155 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:12.837155 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 303/613] 10.222.0.24 () {56 vars in 1102 bytes} [Thu May 19 14:52:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:12.842662 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b77dee-29a6-415f-922d-b5f33feba314 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:12.893666 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cca19-9b0d-423f-b7f1-3f8c4a76c36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:12.894976 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cca19-9b0d-423f-b7f1-3f8c4a76c36e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:12.895524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cca19-9b0d-423f-b7f1-3f8c4a76c36e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:12.896325 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cca19-9b0d-423f-b7f1-3f8c4a76c36e None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:12.898036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72cca19-9b0d-423f-b7f1-3f8c4a76c36e None admin] RBAC: Adding query filter params (name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:12.899005 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72cca19-9b0d-423f-b7f1-3f8c4a76c36e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:12.900655 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72cca19-9b0d-423f-b7f1-3f8c4a76c36e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:12.911408 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 311/614] 10.222.0.24 () {56 vars in 1103 bytes} [Thu May 19 14:52:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:12.916691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cca19-9b0d-423f-b7f1-3f8c4a76c36e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:12.960464 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b77dee-29a6-415f-922d-b5f33feba314 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:13.016978 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445e75b-37c3-465e-b341-47e6b8c05259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:13.017913 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445e75b-37c3-465e-b341-47e6b8c05259 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:13.018210 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445e75b-37c3-465e-b341-47e6b8c05259 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:13.018493 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445e75b-37c3-465e-b341-47e6b8c05259 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:13.019712 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445e75b-37c3-465e-b341-47e6b8c05259 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:13.020031 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445e75b-37c3-465e-b341-47e6b8c05259 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:13.021427 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445e75b-37c3-465e-b341-47e6b8c05259 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:13.043152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 304/615] 10.222.0.24 () {56 vars in 1103 bytes} [Thu May 19 14:52:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:13.046822 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445e75b-37c3-465e-b341-47e6b8c05259 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:13.049123 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cca19-9b0d-423f-b7f1-3f8c4a76c36e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:13.103324 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:13.105375 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:13.163154 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445e75b-37c3-465e-b341-47e6b8c05259 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:13.164463 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47e593-caa4-44e2-831c-bde4e0a61e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:13.165326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47e593-caa4-44e2-831c-bde4e0a61e42 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:13.165543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47e593-caa4-44e2-831c-bde4e0a61e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:13.165817 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47e593-caa4-44e2-831c-bde4e0a61e42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:13.199886 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47e593-caa4-44e2-831c-bde4e0a61e42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:13.201348 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47e593-caa4-44e2-831c-bde4e0a61e42 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:13.202017 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a433d-f125-43bd-b24a-c2d038198d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:13.203706 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a433d-f125-43bd-b24a-c2d038198d71 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:13.204226 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a433d-f125-43bd-b24a-c2d038198d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:13.204745 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a433d-f125-43bd-b24a-c2d038198d71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:13.216874 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798a433d-f125-43bd-b24a-c2d038198d71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:13.218760 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798a433d-f125-43bd-b24a-c2d038198d71 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:13.237956 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-798a433d-f125-43bd-b24a-c2d038198d71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:13.237956 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:13.237956 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:13.237956 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:13.237956 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:13.237956 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:13.237956 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:13.237956 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:13.237956 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:13.237956 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:13.237956 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:13.237956 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:13.237956 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:13.237956 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:13.237956 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:13.238926 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:13.238926 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:13.238926 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:13.238926 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:13.238926 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:13.238926 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:13.238926 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:13.238926 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:13.238926 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:13.238926 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:13.238926 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:13.238926 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:13.238926 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:13.238926 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:13.238926 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:13.238926 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:13.238926 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:13.239846 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:13.239846 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:13.239846 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:13.239846 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:13.242096 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 305/616] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:13.247265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-7e47e593-caa4-44e2-831c-bde4e0a61e42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:13.247265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:13.247265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:13.247265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:13.247265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:13.247265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:13.247265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:13.247265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:13.247265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:13.247265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:13.247265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:13.247265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:13.247265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:13.247265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:13.247265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:13.248483 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:13.248483 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:13.248483 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:13.248483 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:13.248483 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:13.248483 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:13.248483 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:13.248483 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:13.248483 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:13.248483 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:13.248483 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:13.248483 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:13.248483 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:13.248483 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:13.248483 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:13.248483 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:13.248483 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:13.249868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:13.249868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:13.249868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:13.249868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:13.249868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 312/617] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:13.251125 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a433d-f125-43bd-b24a-c2d038198d71 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:13.252158 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47e593-caa4-44e2-831c-bde4e0a61e42 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:13.406397 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47e593-caa4-44e2-831c-bde4e0a61e42 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:13.458408 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a433d-f125-43bd-b24a-c2d038198d71 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:13.460033 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:13.493457 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d9071-f0eb-4589-bcdb-73b0019ee2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:13.494133 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d9071-f0eb-4589-bcdb-73b0019ee2ef None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:13.494433 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d9071-f0eb-4589-bcdb-73b0019ee2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:13.494718 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d9071-f0eb-4589-bcdb-73b0019ee2ef None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:13.495726 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d9071-f0eb-4589-bcdb-73b0019ee2ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:13.496041 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d9071-f0eb-4589-bcdb-73b0019ee2ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:13.497425 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d9071-f0eb-4589-bcdb-73b0019ee2ef None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:13.507897 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec1396-b5c2-4692-ba5f-cae29ecdcb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:13.508580 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec1396-b5c2-4692-ba5f-cae29ecdcb26 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:13.508864 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec1396-b5c2-4692-ba5f-cae29ecdcb26 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:13.509145 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec1396-b5c2-4692-ba5f-cae29ecdcb26 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:13.509878 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec1396-b5c2-4692-ba5f-cae29ecdcb26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:13.510195 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec1396-b5c2-4692-ba5f-cae29ecdcb26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:13.510574 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 306/618] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:13.511759 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec1396-b5c2-4692-ba5f-cae29ecdcb26 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:13.518163 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d9071-f0eb-4589-bcdb-73b0019ee2ef None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:13.538388 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 313/619] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:13.548227 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec1396-b5c2-4692-ba5f-cae29ecdcb26 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:13.632646 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:13.652224 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d9071-f0eb-4589-bcdb-73b0019ee2ef None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:13.694669 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d25f87-1236-43a1-ac9c-30b53eb733eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:13.696971 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d25f87-1236-43a1-ac9c-30b53eb733eb None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:13.698590 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d25f87-1236-43a1-ac9c-30b53eb733eb None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:13.699075 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d25f87-1236-43a1-ac9c-30b53eb733eb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:13.715310 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d25f87-1236-43a1-ac9c-30b53eb733eb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:13.719157 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d25f87-1236-43a1-ac9c-30b53eb733eb None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:13.754013 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-90d25f87-1236-43a1-ac9c-30b53eb733eb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:52:13.754013 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:13.754013 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:13.754013 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:13.754013 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:13.754013 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:13.754013 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:13.754013 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:13.754013 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:13.754013 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:13.754013 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:13.754013 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:13.754013 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:13.754013 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:13.754013 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:13.754013 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:13.755027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:13.755027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:13.755027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:13.755027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:13.755027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:13.755027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:13.755027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:13.755027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:13.755027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:13.755027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:13.755027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:13.755027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:13.755027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:13.755027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:13.755027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:13.755027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:13.755027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:13.755027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:13.755996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:13.755996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:13.755996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:13.755996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:13.755996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:13.755996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:13.755996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:13.755996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:13.755996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:52:13.755996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:13.767264 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 307/620] 10.222.0.24 () {56 vars in 1093 bytes} [Thu May 19 14:52:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:13.772901 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d25f87-1236-43a1-ac9c-30b53eb733eb None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:13.800882 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:13.805829 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec1396-b5c2-4692-ba5f-cae29ecdcb26 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:13.888037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d25f87-1236-43a1-ac9c-30b53eb733eb None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:13.896770 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42411d9-e24e-4cb1-b5a2-283c75e23c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:13.897692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42411d9-e24e-4cb1-b5a2-283c75e23c49 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:13.898080 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42411d9-e24e-4cb1-b5a2-283c75e23c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:13.898728 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42411d9-e24e-4cb1-b5a2-283c75e23c49 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:13.916239 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42411d9-e24e-4cb1-b5a2-283c75e23c49 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:13.917694 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42411d9-e24e-4cb1-b5a2-283c75e23c49 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:13.935907 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aadb7e7-12b6-4ebc-a7cc-fad9e4b82369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:13.936600 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadb7e7-12b6-4ebc-a7cc-fad9e4b82369 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:13.936925 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadb7e7-12b6-4ebc-a7cc-fad9e4b82369 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:13.937212 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadb7e7-12b6-4ebc-a7cc-fad9e4b82369 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:13.938063 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aadb7e7-12b6-4ebc-a7cc-fad9e4b82369 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:13.938382 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aadb7e7-12b6-4ebc-a7cc-fad9e4b82369 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:13.939888 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aadb7e7-12b6-4ebc-a7cc-fad9e4b82369 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:13.940104 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-e42411d9-e24e-4cb1-b5a2-283c75e23c49 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 14:52:13.940104 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:13.940104 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:13.940104 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:13.940104 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:13.940104 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:13.940104 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:13.940104 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:13.940104 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:13.940104 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:13.940104 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:13.940104 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:13.940104 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:13.940104 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:13.940104 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:13.940104 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:13.940977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:13.940977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:13.940977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:13.940977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:13.940977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:13.940977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:13.940977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:13.940977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:13.940977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:13.940977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:13.940977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:13.940977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:13.940977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:13.940977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:13.940977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:13.940977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:13.940977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:13.940977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:13.941882 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:13.941882 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:13.941882 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:13.941882 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:13.941882 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:13.941882 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:13.941882 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:13.941882 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:13.941882 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 14:52:13.941882 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:13.944574 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 314/621] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:52:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:13.950564 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42411d9-e24e-4cb1-b5a2-283c75e23c49 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:13.982195 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 308/622] 10.222.0.24 () {56 vars in 1133 bytes} [Thu May 19 14:52:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:13.987789 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aadb7e7-12b6-4ebc-a7cc-fad9e4b82369 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:14.050615 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:14.065749 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42411d9-e24e-4cb1-b5a2-283c75e23c49 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:14.104214 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87492062-b0c8-42b5-bd9b-e264ae87f831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:14.105336 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87492062-b0c8-42b5-bd9b-e264ae87f831 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:14.106581 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87492062-b0c8-42b5-bd9b-e264ae87f831 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:14.107722 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87492062-b0c8-42b5-bd9b-e264ae87f831 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:14.109488 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87492062-b0c8-42b5-bd9b-e264ae87f831 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:14.111067 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87492062-b0c8-42b5-bd9b-e264ae87f831 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:14.113440 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87492062-b0c8-42b5-bd9b-e264ae87f831 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:14.153698 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 315/623] 10.222.0.24 () {56 vars in 1135 bytes} [Thu May 19 14:52:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:14.159682 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:14.162708 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87492062-b0c8-42b5-bd9b-e264ae87f831 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:14.184249 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aadb7e7-12b6-4ebc-a7cc-fad9e4b82369 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:14.223809 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40695607-5de6-4542-8caf-4b329a47ce4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:14.224467 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40695607-5de6-4542-8caf-4b329a47ce4f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:14.224754 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40695607-5de6-4542-8caf-4b329a47ce4f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:14.225034 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40695607-5de6-4542-8caf-4b329a47ce4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:14.299039 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40695607-5de6-4542-8caf-4b329a47ce4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:14.301285 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40695607-5de6-4542-8caf-4b329a47ce4f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:14.303863 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87492062-b0c8-42b5-bd9b-e264ae87f831 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:14.350949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83ac57-09e3-4afb-9cfe-b2102f143478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:14.352187 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83ac57-09e3-4afb-9cfe-b2102f143478 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:14.352694 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83ac57-09e3-4afb-9cfe-b2102f143478 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:14.353165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83ac57-09e3-4afb-9cfe-b2102f143478 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:14.369218 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83ac57-09e3-4afb-9cfe-b2102f143478 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:14.371627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83ac57-09e3-4afb-9cfe-b2102f143478 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:14.380742 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:14.392181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-9c83ac57-09e3-4afb-9cfe-b2102f143478 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:14.392181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:14.392181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:14.392181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:14.392181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:14.392181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:14.392181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:14.392181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:14.392181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:14.392181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:14.392181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:14.392181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:14.392181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:14.392181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:14.392181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:14.393103 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:14.393103 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:14.393103 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:14.393103 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:14.393103 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:14.393103 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:14.393103 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:14.393103 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:14.393103 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:14.393103 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:14.393103 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:14.393103 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:14.393103 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:14.393103 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:14.393103 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:14.393103 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:14.393103 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:14.393998 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:14.393998 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:14.393998 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:14.393998 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:14.396256 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 316/624] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:14.397802 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0797c5-667e-4b5d-9bf7-08c0076de375 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:14.398299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0797c5-667e-4b5d-9bf7-08c0076de375 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:14.398786 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0797c5-667e-4b5d-9bf7-08c0076de375 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:14.404495 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:14.404775 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 317/625] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:14.405812 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0797c5-667e-4b5d-9bf7-08c0076de375 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:14.433990 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 309/626] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:52:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:52:14.433990 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1428f8-c080-4bf5-bc2b-f0244b230d0d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:14.433990 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1428f8-c080-4bf5-bc2b-f0244b230d0d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:14.433990 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1428f8-c080-4bf5-bc2b-f0244b230d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:14.452356 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ed1428f8-c080-4bf5-bc2b-f0244b230d0d None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:14.453558 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ed1428f8-c080-4bf5-bc2b-f0244b230d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:14.527309 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 310/627] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:52:14.528197 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1428f8-c080-4bf5-bc2b-f0244b230d0d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:14.529174 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0797c5-667e-4b5d-9bf7-08c0076de375 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:14.567161 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc887bf-4a04-4a4a-adba-bfce2cc28d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:14.568211 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc887bf-4a04-4a4a-adba-bfce2cc28d03 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:14.568718 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc887bf-4a04-4a4a-adba-bfce2cc28d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:14.569318 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc887bf-4a04-4a4a-adba-bfce2cc28d03 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:14.570378 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc887bf-4a04-4a4a-adba-bfce2cc28d03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:14.570906 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc887bf-4a04-4a4a-adba-bfce2cc28d03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:14.572515 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc887bf-4a04-4a4a-adba-bfce2cc28d03 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:14.587965 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 318/628] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:14.589127 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc887bf-4a04-4a4a-adba-bfce2cc28d03 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:14.659859 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:14.665484 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1428f8-c080-4bf5-bc2b-f0244b230d0d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:14.681013 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:14.710860 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc887bf-4a04-4a4a-adba-bfce2cc28d03 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:14.715937 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82308f6a-093c-4d03-9579-15c2c20cbb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:14.716924 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82308f6a-093c-4d03-9579-15c2c20cbb8d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:14.717349 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82308f6a-093c-4d03-9579-15c2c20cbb8d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:14.717789 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82308f6a-093c-4d03-9579-15c2c20cbb8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:14.730800 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82308f6a-093c-4d03-9579-15c2c20cbb8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:14.732650 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82308f6a-093c-4d03-9579-15c2c20cbb8d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:14.749521 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea177c7-6f2d-4d8e-b009-3a9871cd4a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:14.750471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea177c7-6f2d-4d8e-b009-3a9871cd4a9e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:14.750825 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea177c7-6f2d-4d8e-b009-3a9871cd4a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:14.751222 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea177c7-6f2d-4d8e-b009-3a9871cd4a9e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:14.753669 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-82308f6a-093c-4d03-9579-15c2c20cbb8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:14.753669 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:14.753669 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:14.753669 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:14.753669 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:14.753669 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:14.753669 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:14.753669 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:14.753669 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:14.753669 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:14.753669 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:14.753669 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:14.753669 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:14.753669 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:14.753669 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:14.754531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:14.754531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:14.754531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:14.754531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:14.754531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:14.754531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:14.754531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:14.754531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:14.754531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:14.754531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:14.754531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:14.754531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:14.754531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:14.754531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:14.754531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:14.754531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:14.754531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:14.755466 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:14.755466 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:14.755466 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:14.755466 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:14.762139 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 311/629] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:14.762139 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82308f6a-093c-4d03-9579-15c2c20cbb8d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:14.768259 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea177c7-6f2d-4d8e-b009-3a9871cd4a9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:14.776277 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-dea177c7-6f2d-4d8e-b009-3a9871cd4a9e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:14.776277 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:14.776277 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:14.776277 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:14.776277 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:14.776277 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:14.776277 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:14.776277 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:14.776277 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:14.776277 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:14.776277 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:14.776277 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:14.776277 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:14.776277 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:14.776277 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:14.776277 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:14.777208 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:14.777208 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:14.777208 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:14.777208 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:14.777208 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:14.777208 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:14.777208 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:14.777208 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:14.777208 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:14.777208 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:14.777208 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:14.777208 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:14.777208 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:14.777208 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:14.777208 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:14.777208 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:14.778036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:14.778036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:14.778036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:14.778036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:14.778036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:14.778036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:14.778036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:14.778036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:14.778036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:14.778036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:14.778036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:14.778036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:14.782787 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 319/630] 10.222.0.24 () {56 vars in 1102 bytes} [Thu May 19 14:52:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:14.783726 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea177c7-6f2d-4d8e-b009-3a9871cd4a9e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:14.872688 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82308f6a-093c-4d03-9579-15c2c20cbb8d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:14.892836 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea177c7-6f2d-4d8e-b009-3a9871cd4a9e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:14.908626 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ed013-d9f1-45b6-895e-30a7aafe9b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:14.909944 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ed013-d9f1-45b6-895e-30a7aafe9b3a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:14.910135 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ed013-d9f1-45b6-895e-30a7aafe9b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:14.910720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ed013-d9f1-45b6-895e-30a7aafe9b3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:14.912784 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:14.918761 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ed013-d9f1-45b6-895e-30a7aafe9b3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:14.920275 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ed013-d9f1-45b6-895e-30a7aafe9b3a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:14.932620 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c5b38-80cc-49aa-8b54-fe5aeaec85e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:14.933288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c5b38-80cc-49aa-8b54-fe5aeaec85e2 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:14.933572 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c5b38-80cc-49aa-8b54-fe5aeaec85e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:14.933846 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c5b38-80cc-49aa-8b54-fe5aeaec85e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:14.934206 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-4a8ed013-d9f1-45b6-895e-30a7aafe9b3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:14.934206 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:14.934206 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:14.934206 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:14.934206 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:14.934206 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:14.934206 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:14.934206 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:14.934206 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:14.934206 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:14.934206 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:14.934206 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:14.934206 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:14.934206 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:14.934206 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:14.935072 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:14.935072 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:14.935072 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:14.935072 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:14.935072 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:14.935072 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:14.935072 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:14.935072 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:14.935072 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:14.935072 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:14.935072 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:14.935072 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:14.935072 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:14.935072 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:14.935072 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:14.935072 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:14.935072 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:14.936245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:14.936245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:14.936245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:14.936245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:14.936245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:14.936245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:14.936245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:14.936245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:14.936726 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c5b38-80cc-49aa-8b54-fe5aeaec85e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:14.936726 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c5b38-80cc-49aa-8b54-fe5aeaec85e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:14.936726 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c5b38-80cc-49aa-8b54-fe5aeaec85e2 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:14.940178 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 312/631] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:14.940807 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ed013-d9f1-45b6-895e-30a7aafe9b3a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:14.948548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 320/632] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:14.949904 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbabfd-0095-4f07-8137-daf0d7e7d51f None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:14.950193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbabfd-0095-4f07-8137-daf0d7e7d51f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:14.950499 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbabfd-0095-4f07-8137-daf0d7e7d51f None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:14.955313 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 321/633] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:14.955313 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbabfd-0095-4f07-8137-daf0d7e7d51f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:14.977044 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:15.060822 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ed013-d9f1-45b6-895e-30a7aafe9b3a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:15.064450 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbabfd-0095-4f07-8137-daf0d7e7d51f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:15.101413 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056b955-1ec0-4294-8366-f1e2b6dce07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:15.102089 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056b955-1ec0-4294-8366-f1e2b6dce07f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:15.102376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056b955-1ec0-4294-8366-f1e2b6dce07f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:15.102653 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056b955-1ec0-4294-8366-f1e2b6dce07f None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:15.103435 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056b955-1ec0-4294-8366-f1e2b6dce07f None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:15.103538 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c244a74-5899-4d16-8e6f-1822dd5c1f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:15.103752 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056b955-1ec0-4294-8366-f1e2b6dce07f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:15.104204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c244a74-5899-4d16-8e6f-1822dd5c1f8f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:15.104486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c244a74-5899-4d16-8e6f-1822dd5c1f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:15.104761 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c244a74-5899-4d16-8e6f-1822dd5c1f8f None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:15.105131 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056b955-1ec0-4294-8366-f1e2b6dce07f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:15.105555 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c244a74-5899-4d16-8e6f-1822dd5c1f8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:15.105867 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c244a74-5899-4d16-8e6f-1822dd5c1f8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:15.107314 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c244a74-5899-4d16-8e6f-1822dd5c1f8f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:15.113821 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 313/634] 10.222.0.24 () {56 vars in 1103 bytes} [Thu May 19 14:52:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:15.114822 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056b955-1ec0-4294-8366-f1e2b6dce07f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:15.123635 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 322/635] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:52:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:15.125274 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65077d4d-2eaa-47d2-97e7-c2cf77a7c5d0 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:15.125567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65077d4d-2eaa-47d2-97e7-c2cf77a7c5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:15.125846 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65077d4d-2eaa-47d2-97e7-c2cf77a7c5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:15.143966 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-65077d4d-2eaa-47d2-97e7-c2cf77a7c5d0 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:15.145191 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-65077d4d-2eaa-47d2-97e7-c2cf77a7c5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:15.178402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:15.210084 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:15.227248 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 323/636] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:52:15.227248 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65077d4d-2eaa-47d2-97e7-c2cf77a7c5d0 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:15.234176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056b955-1ec0-4294-8366-f1e2b6dce07f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:15.269297 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09835407-ba03-45c2-b3e2-cb288445e81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:15.270099 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09835407-ba03-45c2-b3e2-cb288445e81e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:15.270385 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09835407-ba03-45c2-b3e2-cb288445e81e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:15.270664 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09835407-ba03-45c2-b3e2-cb288445e81e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:15.277184 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09835407-ba03-45c2-b3e2-cb288445e81e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:15.278624 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09835407-ba03-45c2-b3e2-cb288445e81e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:15.292410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-09835407-ba03-45c2-b3e2-cb288445e81e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:15.292410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:15.292410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:15.292410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:15.292410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:15.292410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:15.292410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:15.292410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:15.292410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:15.292410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:15.292410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:15.292410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:15.292410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:15.292410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:15.292410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:15.293445 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:15.293445 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:15.293445 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:15.293445 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:15.293445 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:15.293445 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:15.293445 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:15.293445 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:15.293445 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:15.293445 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:15.293445 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:15.293445 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:15.293445 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:15.293445 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:15.293445 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:15.293445 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:15.293445 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:15.294539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:15.294539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:15.294539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:15.294539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:15.294539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:15.294539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:15.294539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:15.294539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:15.294539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 314/637] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:15.294539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09835407-ba03-45c2-b3e2-cb288445e81e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:15.334212 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65077d4d-2eaa-47d2-97e7-c2cf77a7c5d0 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:15.367681 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71085a5-e8dc-4c65-95e4-2f12c990d59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:15.368479 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71085a5-e8dc-4c65-95e4-2f12c990d59e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:15.368762 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71085a5-e8dc-4c65-95e4-2f12c990d59e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:15.369038 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71085a5-e8dc-4c65-95e4-2f12c990d59e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:15.379683 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71085a5-e8dc-4c65-95e4-2f12c990d59e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:15.381126 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71085a5-e8dc-4c65-95e4-2f12c990d59e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:15.393704 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09835407-ba03-45c2-b3e2-cb288445e81e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:15.398920 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-f71085a5-e8dc-4c65-95e4-2f12c990d59e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:15.398920 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:15.398920 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:15.398920 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:15.398920 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:15.398920 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:15.398920 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:15.398920 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:15.398920 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:15.398920 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:15.398920 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:15.398920 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:15.398920 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:15.398920 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:15.398920 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:15.399793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:15.399793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:15.399793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:15.399793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:15.399793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:15.399793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:15.399793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:15.399793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:15.399793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:15.399793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:15.399793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:15.399793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:15.399793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:15.399793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:15.399793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:15.399793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:15.399793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:15.400667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:15.400667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:15.400667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:15.400667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:15.400667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 324/638] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:15.400943 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71085a5-e8dc-4c65-95e4-2f12c990d59e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:15.424508 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:15.432012 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec96205-ea12-4167-ab7c-3980820eb8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:15.432856 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec96205-ea12-4167-ab7c-3980820eb8f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:15.433147 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec96205-ea12-4167-ab7c-3980820eb8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:15.433465 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec96205-ea12-4167-ab7c-3980820eb8f6 None admin] PATH_INFO: `/v3/projects/2633b53c336145bba3d4744dbdfe99b7/users/8ecbeee0c1cf4c58be6c22aa11d7ff5a/roles/4d4ff927beb7409996558ecf7143d419` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:15.449228 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec96205-ea12-4167-ab7c-3980820eb8f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=2633b53c336145bba3d4744dbdfe99b7, user_id=8ecbeee0c1cf4c58be6c22aa11d7ff5a, role_id=4d4ff927beb7409996558ecf7143d419)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:15.450685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec96205-ea12-4167-ab7c-3980820eb8f6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:15.453404 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:15.464167 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 315/639] 10.222.0.24 () {58 vars in 1439 bytes} [Thu May 19 14:52:15 2022] PUT /identity/v3/projects/2633b53c336145bba3d4744dbdfe99b7/users/8ecbeee0c1cf4c58be6c22aa11d7ff5a/roles/4d4ff927beb7409996558ecf7143d419 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:52:15.465425 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268e809-1310-47ef-9371-e2bd315d5b1a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:15.465721 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268e809-1310-47ef-9371-e2bd315d5b1a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:15.465999 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268e809-1310-47ef-9371-e2bd315d5b1a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:15.467298 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 316/640] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:15.468074 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268e809-1310-47ef-9371-e2bd315d5b1a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:15.524311 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71085a5-e8dc-4c65-95e4-2f12c990d59e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:15.566240 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d73914-33c8-4baf-825b-e9a5dbed3a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:15.567099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d73914-33c8-4baf-825b-e9a5dbed3a97 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:15.567422 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d73914-33c8-4baf-825b-e9a5dbed3a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:15.567702 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d73914-33c8-4baf-825b-e9a5dbed3a97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:15.579719 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d73914-33c8-4baf-825b-e9a5dbed3a97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:15.587627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-62d73914-33c8-4baf-825b-e9a5dbed3a97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:15.587627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:15.587627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:15.587627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:15.587627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:15.587627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:15.587627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:15.587627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:15.587627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:15.587627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:15.587627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:15.587627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:15.587627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:15.587627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:15.587627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:15.587627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:15.588891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:15.588891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:15.588891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:15.588891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:15.588891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:15.588891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:15.588891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:15.588891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:15.588891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:15.588891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:15.588891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:15.588891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:15.588891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:15.588891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:15.588891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:15.588891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:15.589737 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:15.589737 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:15.589737 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:15.589737 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:15.589737 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:15.589737 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:15.589737 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:15.589737 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:15.589737 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:15.589737 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:15.589737 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:15.589737 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:15.589737 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 325/641] 10.222.0.24 () {56 vars in 1102 bytes} [Thu May 19 14:52:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:15.589737 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d73914-33c8-4baf-825b-e9a5dbed3a97 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:15.602354 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268e809-1310-47ef-9371-e2bd315d5b1a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:15.644716 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9544d0-1286-4fd4-b19e-e601edbe063d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:15.644716 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9544d0-1286-4fd4-b19e-e601edbe063d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:15.645016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9544d0-1286-4fd4-b19e-e601edbe063d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:15.645259 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9544d0-1286-4fd4-b19e-e601edbe063d None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:15.646023 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9544d0-1286-4fd4-b19e-e601edbe063d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:15.646335 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9544d0-1286-4fd4-b19e-e601edbe063d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:15.648839 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9544d0-1286-4fd4-b19e-e601edbe063d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:15.662194 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 317/642] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:52:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:15.663534 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e4435-9a7a-4280-9040-1256d8b57dd3 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:15.663838 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e4435-9a7a-4280-9040-1256d8b57dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:15.664199 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e4435-9a7a-4280-9040-1256d8b57dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:15.683137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-914e4435-9a7a-4280-9040-1256d8b57dd3 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:15.684314 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-914e4435-9a7a-4280-9040-1256d8b57dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:15.694624 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:15.715877 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d73914-33c8-4baf-825b-e9a5dbed3a97 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:15.739993 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:15.752572 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e793f-c264-4e07-bbe1-4510ff9fbbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:15.753358 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e793f-c264-4e07-bbe1-4510ff9fbbbf None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:15.753639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e793f-c264-4e07-bbe1-4510ff9fbbbf None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:15.753917 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e793f-c264-4e07-bbe1-4510ff9fbbbf None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:15.754647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e793f-c264-4e07-bbe1-4510ff9fbbbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:15.754958 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e793f-c264-4e07-bbe1-4510ff9fbbbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:15.756353 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e793f-c264-4e07-bbe1-4510ff9fbbbf None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:15.767485 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 318/643] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:52:15.769836 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e4435-9a7a-4280-9040-1256d8b57dd3 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:15.773355 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 326/644] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:15.774245 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e793f-c264-4e07-bbe1-4510ff9fbbbf None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:15.875403 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e4435-9a7a-4280-9040-1256d8b57dd3 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:15.879418 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e793f-c264-4e07-bbe1-4510ff9fbbbf None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:15.915144 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf3051-93d1-4f5e-82fa-4c4341e68c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:15.915835 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf3051-93d1-4f5e-82fa-4c4341e68c32 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:15.916115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf3051-93d1-4f5e-82fa-4c4341e68c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:15.916445 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf3051-93d1-4f5e-82fa-4c4341e68c32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:15.917209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf3051-93d1-4f5e-82fa-4c4341e68c32 None admin] RBAC: Adding query filter params (role.id=4d4ff927beb7409996558ecf7143d419, scope.project.id=2633b53c336145bba3d4744dbdfe99b7, user.id=06fb8bb5aeb143ad95f33c3b43dbd346) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:15.917519 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf3051-93d1-4f5e-82fa-4c4341e68c32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:15.918941 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf3051-93d1-4f5e-82fa-4c4341e68c32 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:15.919134 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42e09b-ca2c-4016-a053-7cb8cc54576c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:15.920157 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42e09b-ca2c-4016-a053-7cb8cc54576c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:15.920597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42e09b-ca2c-4016-a053-7cb8cc54576c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:15.921530 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42e09b-ca2c-4016-a053-7cb8cc54576c None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:15.922705 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42e09b-ca2c-4016-a053-7cb8cc54576c None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:15.923188 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42e09b-ca2c-4016-a053-7cb8cc54576c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:15.925375 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42e09b-ca2c-4016-a053-7cb8cc54576c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:15.935696 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 327/645] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:52:15 2022] GET /identity/v3/role_assignments?user.id=06fb8bb5aeb143ad95f33c3b43dbd346&scope.project.id=2633b53c336145bba3d4744dbdfe99b7&role.id=4d4ff927beb7409996558ecf7143d419 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:15.935696 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf3051-93d1-4f5e-82fa-4c4341e68c32 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:15.941113 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:15.949346 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 319/646] 10.222.0.24 () {56 vars in 1103 bytes} [Thu May 19 14:52:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:15.951252 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42e09b-ca2c-4016-a053-7cb8cc54576c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:16.009058 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:16.080864 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42e09b-ca2c-4016-a053-7cb8cc54576c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:16.092186 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf3051-93d1-4f5e-82fa-4c4341e68c32 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:16.127240 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b6261-2514-4bc3-9ffb-3a53f54df912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:16.128083 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b6261-2514-4bc3-9ffb-3a53f54df912 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:16.128083 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b6261-2514-4bc3-9ffb-3a53f54df912 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:16.128502 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b6261-2514-4bc3-9ffb-3a53f54df912 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:16.137149 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c494da2-1849-4367-ab04-b1ffc4407331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:16.138173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c494da2-1849-4367-ab04-b1ffc4407331 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:16.138602 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c494da2-1849-4367-ab04-b1ffc4407331 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:16.139010 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c494da2-1849-4367-ab04-b1ffc4407331 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:16.145761 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b6261-2514-4bc3-9ffb-3a53f54df912 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:16.148331 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c494da2-1849-4367-ab04-b1ffc4407331 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:16.149961 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c494da2-1849-4367-ab04-b1ffc4407331 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:16.155175 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-b35b6261-2514-4bc3-9ffb-3a53f54df912 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:16.155175 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:16.155175 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:16.155175 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:16.155175 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:16.155175 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:16.155175 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:16.155175 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:16.155175 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:16.155175 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:16.155175 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:16.155175 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:16.155175 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:16.155175 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:16.155175 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:16.155175 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:16.156473 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:16.156473 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:16.156473 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:16.156473 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:16.156473 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:16.156473 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:16.156473 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:16.156473 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:16.156473 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:16.156473 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:16.156473 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:16.156473 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:16.156473 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:16.156473 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:16.156473 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:16.156473 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:16.157574 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:16.157574 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:16.157574 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:16.157574 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:16.157574 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:16.157574 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:16.157574 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:16.157574 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:16.157574 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:16.157574 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:16.157574 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:16.157574 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:16.158518 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 320/647] 10.222.0.24 () {56 vars in 1102 bytes} [Thu May 19 14:52:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:16.159749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b6261-2514-4bc3-9ffb-3a53f54df912 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:16.169186 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-6c494da2-1849-4367-ab04-b1ffc4407331 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 19 14:52:16.169186 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:16.169186 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:16.169186 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:16.169186 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:16.169186 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:16.169186 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:16.169186 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:16.169186 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:16.169186 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:16.169186 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:16.169186 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:16.169186 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:16.169186 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:16.169186 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:16.169186 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:16.170344 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:16.170344 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:16.170344 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:16.170344 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:16.170344 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:16.170344 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:16.170344 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:16.170344 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:16.170344 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:16.170344 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:16.170344 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:16.170344 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:16.170344 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:16.170344 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:16.170344 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:16.170344 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:16.170344 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:16.170344 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:16.171596 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:16.171596 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:16.171596 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:16.171596 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:16.171596 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:16.171596 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:16.171596 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:16.171596 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:16.171596 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 19 14:52:16.171596 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:16.171596 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 328/648] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:52:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:16.172340 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c494da2-1849-4367-ab04-b1ffc4407331 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:16.250374 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:16.296865 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b6261-2514-4bc3-9ffb-3a53f54df912 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:16.307093 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:16.308027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c494da2-1849-4367-ab04-b1ffc4407331 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:16.347903 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208998d0-1c37-4112-8b6f-c48e38acd38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:16.348833 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208998d0-1c37-4112-8b6f-c48e38acd38d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:16.349185 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208998d0-1c37-4112-8b6f-c48e38acd38d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:16.349526 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208998d0-1c37-4112-8b6f-c48e38acd38d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:16.360252 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37862110-aad2-48fe-8451-dceabd48ef44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:16.361668 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37862110-aad2-48fe-8451-dceabd48ef44 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:16.361813 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208998d0-1c37-4112-8b6f-c48e38acd38d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:16.362227 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37862110-aad2-48fe-8451-dceabd48ef44 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:16.362643 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37862110-aad2-48fe-8451-dceabd48ef44 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:16.363548 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208998d0-1c37-4112-8b6f-c48e38acd38d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:16.363734 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37862110-aad2-48fe-8451-dceabd48ef44 None admin] RBAC: Adding query filter params (name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:16.364378 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37862110-aad2-48fe-8451-dceabd48ef44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:16.366541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37862110-aad2-48fe-8451-dceabd48ef44 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:16.377796 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 329/649] 10.222.0.24 () {56 vars in 1103 bytes} [Thu May 19 14:52:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:16.378861 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37862110-aad2-48fe-8451-dceabd48ef44 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:16.386692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-208998d0-1c37-4112-8b6f-c48e38acd38d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:16.386692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:16.386692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:16.386692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:16.386692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:16.386692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:16.386692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:16.386692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:16.386692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:16.386692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:16.386692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:16.386692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:16.386692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:16.386692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:16.386692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:16.387721 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:16.387721 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:16.387721 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:16.387721 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:16.387721 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:16.387721 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:16.387721 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:16.387721 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:16.387721 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:16.387721 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:16.387721 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:16.387721 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:16.387721 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:16.387721 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:16.387721 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:16.387721 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:16.387721 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:16.388828 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:16.388828 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:16.388828 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:16.388828 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:16.390123 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 321/650] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:16.395027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208998d0-1c37-4112-8b6f-c48e38acd38d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:16.503623 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208998d0-1c37-4112-8b6f-c48e38acd38d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:16.524126 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37862110-aad2-48fe-8451-dceabd48ef44 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:16.538249 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cb848-68c9-48df-a0e7-c9d6567b8678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:16.538909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cb848-68c9-48df-a0e7-c9d6567b8678 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:16.539208 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cb848-68c9-48df-a0e7-c9d6567b8678 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:16.539496 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cb848-68c9-48df-a0e7-c9d6567b8678 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:16.551317 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9cb848-68c9-48df-a0e7-c9d6567b8678 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:16.552734 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9cb848-68c9-48df-a0e7-c9d6567b8678 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:16.557833 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:16.569611 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b1001-258f-47f3-9f30-ff7cb8e3b04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:16.570650 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b1001-258f-47f3-9f30-ff7cb8e3b04d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:16.571133 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b1001-258f-47f3-9f30-ff7cb8e3b04d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:16.571642 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b1001-258f-47f3-9f30-ff7cb8e3b04d None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:16.571748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-8b9cb848-68c9-48df-a0e7-c9d6567b8678 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:16.571748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:16.571748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:16.571748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:16.571748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:16.571748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:16.571748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:16.571748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:16.571748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:16.571748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:16.571748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:16.571748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:16.571748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:16.571748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:16.571748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:16.572559 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:16.572559 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:16.572559 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:16.572559 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:16.572559 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:16.572559 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:16.572559 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:16.572559 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:16.572559 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:16.572559 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:16.572559 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:16.572559 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:16.572559 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:16.572559 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:16.572559 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:16.572559 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:16.572559 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:16.573433 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:16.573433 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:16.573433 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:16.573433 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:16.574921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b1001-258f-47f3-9f30-ff7cb8e3b04d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:16.575479 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b1001-258f-47f3-9f30-ff7cb8e3b04d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:16.577113 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b1001-258f-47f3-9f30-ff7cb8e3b04d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:16.577614 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 322/651] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:16.578581 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cb848-68c9-48df-a0e7-c9d6567b8678 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:16.595286 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:16.598960 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 330/652] 10.222.0.24 () {56 vars in 1137 bytes} [Thu May 19 14:52:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:16.599952 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b1001-258f-47f3-9f30-ff7cb8e3b04d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:16.696870 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cb848-68c9-48df-a0e7-c9d6567b8678 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:16.709672 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b1001-258f-47f3-9f30-ff7cb8e3b04d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:16.732180 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8448ddd-bb24-4ec6-b714-495d52996f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:16.733142 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8448ddd-bb24-4ec6-b714-495d52996f02 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:16.734124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8448ddd-bb24-4ec6-b714-495d52996f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:16.734575 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8448ddd-bb24-4ec6-b714-495d52996f02 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:16.735639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8448ddd-bb24-4ec6-b714-495d52996f02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:16.736155 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8448ddd-bb24-4ec6-b714-495d52996f02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:16.737544 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8448ddd-bb24-4ec6-b714-495d52996f02 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:16.755059 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 323/653] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:16.755059 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8448ddd-bb24-4ec6-b714-495d52996f02 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:16.759448 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a769d-adf1-4967-a7eb-2b6e2759e554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:16.760379 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a769d-adf1-4967-a7eb-2b6e2759e554 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:16.760881 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a769d-adf1-4967-a7eb-2b6e2759e554 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:16.761361 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a769d-adf1-4967-a7eb-2b6e2759e554 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:16.762292 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a769d-adf1-4967-a7eb-2b6e2759e554 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:16.762809 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a769d-adf1-4967-a7eb-2b6e2759e554 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:16.764995 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a769d-adf1-4967-a7eb-2b6e2759e554 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:16.782843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 331/654] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:16.784147 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a769d-adf1-4967-a7eb-2b6e2759e554 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:16.833352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:16.837983 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:16.869750 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8448ddd-bb24-4ec6-b714-495d52996f02 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:16.895462 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a769d-adf1-4967-a7eb-2b6e2759e554 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:16.907563 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4fb7a5-b387-4d3e-8c3c-6bc21977aadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:16.908524 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fb7a5-b387-4d3e-8c3c-6bc21977aadc None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:16.909080 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fb7a5-b387-4d3e-8c3c-6bc21977aadc None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:16.909692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fb7a5-b387-4d3e-8c3c-6bc21977aadc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:16.931838 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a54ee-4b6d-4616-b285-55b26998028f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:16.932721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a54ee-4b6d-4616-b285-55b26998028f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:16.933004 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a54ee-4b6d-4616-b285-55b26998028f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:16.933299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a54ee-4b6d-4616-b285-55b26998028f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:16.942392 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a54ee-4b6d-4616-b285-55b26998028f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:16.943909 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a54ee-4b6d-4616-b285-55b26998028f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:16.959191 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-ed0a54ee-4b6d-4616-b285-55b26998028f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:52:16.959191 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:16.959191 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:16.959191 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:16.959191 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:16.959191 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:16.959191 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:16.959191 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:16.959191 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:16.959191 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:16.959191 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:16.959191 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:16.959191 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:16.959191 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:16.959191 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:16.959191 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:16.960165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:16.960165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:16.960165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:16.960165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:16.960165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:16.960165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:16.960165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:16.960165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:16.960165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:16.960165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:16.960165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:16.960165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:16.960165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:16.960165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:16.960165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:16.960165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:16.960165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:16.960165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:16.961131 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:16.961131 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:16.961131 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:16.961131 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:16.961131 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:16.961131 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:16.961131 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:16.961131 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:16.961131 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:52:16.961131 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:16.964967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 332/655] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:52:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:16.965806 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a54ee-4b6d-4616-b285-55b26998028f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:16.998975 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4fb7a5-b387-4d3e-8c3c-6bc21977aadc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:17.000815 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4fb7a5-b387-4d3e-8c3c-6bc21977aadc None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:17.072523 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:17.075397 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a54ee-4b6d-4616-b285-55b26998028f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:17.078302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:17.113475 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 324/656] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:52:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:52:17.113475 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4fb7a5-b387-4d3e-8c3c-6bc21977aadc None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:17.118288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54679883-db73-451f-975c-f2867e5cc13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:17.119144 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54679883-db73-451f-975c-f2867e5cc13e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:17.119456 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54679883-db73-451f-975c-f2867e5cc13e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:17.119732 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54679883-db73-451f-975c-f2867e5cc13e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:17.127898 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54679883-db73-451f-975c-f2867e5cc13e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:17.129282 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54679883-db73-451f-975c-f2867e5cc13e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:17.145237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-54679883-db73-451f-975c-f2867e5cc13e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 19 14:52:17.145237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:17.145237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:17.145237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:17.145237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:17.145237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:17.145237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:17.145237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:17.145237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:17.145237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:17.145237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:17.145237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:17.145237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:17.145237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:17.145237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:17.145237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:17.146193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:17.146193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:17.146193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:17.146193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:17.146193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:17.146193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:17.146193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:17.146193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:17.146193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:17.146193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:17.146193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:17.146193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:17.146193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:17.146193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:17.146193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:17.146193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:17.146193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:17.146193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:17.147120 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:17.147120 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:17.147120 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:17.147120 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:17.147120 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:17.147120 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:17.147120 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:17.147120 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:17.147120 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 19 14:52:17.147120 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:17.147120 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 333/657] 10.222.0.24 () {56 vars in 1102 bytes} [Thu May 19 14:52:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:17.147755 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54679883-db73-451f-975c-f2867e5cc13e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:17.225376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4fb7a5-b387-4d3e-8c3c-6bc21977aadc None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:17.257822 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54679883-db73-451f-975c-f2867e5cc13e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:17.266897 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bd0dd-fe13-456a-aadc-38fdb810da85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:17.267845 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bd0dd-fe13-456a-aadc-38fdb810da85 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:17.268399 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bd0dd-fe13-456a-aadc-38fdb810da85 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:17.268891 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bd0dd-fe13-456a-aadc-38fdb810da85 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:17.270039 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516bd0dd-fe13-456a-aadc-38fdb810da85 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:17.270557 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516bd0dd-fe13-456a-aadc-38fdb810da85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:17.272259 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516bd0dd-fe13-456a-aadc-38fdb810da85 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:17.293222 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 325/658] 10.222.0.24 () {56 vars in 1137 bytes} [Thu May 19 14:52:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:17.294686 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bd0dd-fe13-456a-aadc-38fdb810da85 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:17.296152 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989bab7-1b2c-4ef5-a361-c05115ea7e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:17.297041 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989bab7-1b2c-4ef5-a361-c05115ea7e8d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:17.297429 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989bab7-1b2c-4ef5-a361-c05115ea7e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:17.297728 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989bab7-1b2c-4ef5-a361-c05115ea7e8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:17.310045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989bab7-1b2c-4ef5-a361-c05115ea7e8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:17.313411 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989bab7-1b2c-4ef5-a361-c05115ea7e8d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:17.332776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-d989bab7-1b2c-4ef5-a361-c05115ea7e8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:17.332776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:17.332776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:17.332776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:17.332776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:17.332776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:17.332776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:17.332776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:17.332776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:17.332776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:17.332776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:17.332776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:17.332776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:17.332776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:17.332776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:17.333689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:17.333689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:17.333689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:17.333689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:17.333689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:17.333689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:17.333689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:17.333689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:17.333689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:17.333689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:17.333689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:17.333689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:17.333689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:17.333689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:17.333689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:17.333689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:17.333689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:17.334577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:17.334577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:17.334577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:17.334577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:17.338659 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 334/659] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:17.339766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989bab7-1b2c-4ef5-a361-c05115ea7e8d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:17.340778 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:17.361702 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:17.421330 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bd0dd-fe13-456a-aadc-38fdb810da85 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:17.452831 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989bab7-1b2c-4ef5-a361-c05115ea7e8d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:17.458454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a34a29-23f8-4dfa-b297-20e76817bfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:17.459285 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a34a29-23f8-4dfa-b297-20e76817bfee None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:17.459682 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a34a29-23f8-4dfa-b297-20e76817bfee None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:17.460062 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a34a29-23f8-4dfa-b297-20e76817bfee None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:17.461004 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a34a29-23f8-4dfa-b297-20e76817bfee None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:17.461587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a34a29-23f8-4dfa-b297-20e76817bfee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:17.463071 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a34a29-23f8-4dfa-b297-20e76817bfee None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:17.483296 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 326/660] 10.222.0.24 () {56 vars in 1139 bytes} [Thu May 19 14:52:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:17.484390 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a34a29-23f8-4dfa-b297-20e76817bfee None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:17.490589 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e73e7-484c-4b7c-95fc-bd056e9afa78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:17.491495 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e73e7-484c-4b7c-95fc-bd056e9afa78 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:17.491921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e73e7-484c-4b7c-95fc-bd056e9afa78 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:17.492354 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e73e7-484c-4b7c-95fc-bd056e9afa78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:17.565872 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e73e7-484c-4b7c-95fc-bd056e9afa78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:17.567708 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e73e7-484c-4b7c-95fc-bd056e9afa78 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:17.575093 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:17.588735 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:17.597923 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a34a29-23f8-4dfa-b297-20e76817bfee None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:17.642241 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c90998-26d0-4029-8612-248c93fee60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:17.643129 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c90998-26d0-4029-8612-248c93fee60e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:17.643568 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c90998-26d0-4029-8612-248c93fee60e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:17.644147 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c90998-26d0-4029-8612-248c93fee60e None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:17.645010 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c90998-26d0-4029-8612-248c93fee60e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:17.645427 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c90998-26d0-4029-8612-248c93fee60e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:17.648225 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c90998-26d0-4029-8612-248c93fee60e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:17.669010 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 327/661] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:17.669010 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c90998-26d0-4029-8612-248c93fee60e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:17.690559 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 335/662] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:52:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:52:17.691703 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e73e7-484c-4b7c-95fc-bd056e9afa78 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:17.773848 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c90998-26d0-4029-8612-248c93fee60e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:17.798742 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e73e7-484c-4b7c-95fc-bd056e9afa78 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:17.811044 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590009d-2167-4bc3-910a-bf9f76e84d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:17.811917 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590009d-2167-4bc3-910a-bf9f76e84d33 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:17.812211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590009d-2167-4bc3-910a-bf9f76e84d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:17.812492 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590009d-2167-4bc3-910a-bf9f76e84d33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:17.816277 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:17.831116 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:17.834717 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb54009-c8e6-414b-881d-58bd5fca1460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:17.835563 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb54009-c8e6-414b-881d-58bd5fca1460 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:17.835841 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb54009-c8e6-414b-881d-58bd5fca1460 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:17.836111 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb54009-c8e6-414b-881d-58bd5fca1460 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:17.843477 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb54009-c8e6-414b-881d-58bd5fca1460 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:17.844849 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb54009-c8e6-414b-881d-58bd5fca1460 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:17.859163 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-8fb54009-c8e6-414b-881d-58bd5fca1460 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:17.859163 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:17.859163 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:17.859163 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:17.859163 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:17.859163 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:17.859163 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:17.859163 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:17.859163 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:17.859163 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:17.859163 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:17.859163 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:17.859163 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:17.859163 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:17.859163 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:17.860099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:17.860099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:17.860099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:17.860099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:17.860099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:17.860099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:17.860099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:17.860099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:17.860099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:17.860099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:17.860099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:17.860099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:17.860099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:17.860099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:17.860099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:17.860099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:17.860099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:17.860978 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:17.860978 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:17.860978 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:17.860978 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:17.860978 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:17.860978 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:17.860978 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:17.860978 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:17.860978 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 336/663] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:17.861464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb54009-c8e6-414b-881d-58bd5fca1460 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:17.897146 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d590009d-2167-4bc3-910a-bf9f76e84d33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:17.898599 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d590009d-2167-4bc3-910a-bf9f76e84d33 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:17.970983 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb54009-c8e6-414b-881d-58bd5fca1460 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:18.005008 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c151af7-e2b2-4917-8c2c-cc348e94b839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:18.010017 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 328/664] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:52:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:52:18.010170 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c151af7-e2b2-4917-8c2c-cc348e94b839 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:18.010170 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c151af7-e2b2-4917-8c2c-cc348e94b839 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:18.010170 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c151af7-e2b2-4917-8c2c-cc348e94b839 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:18.010390 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6ba41-7b78-4cbd-aa8d-5339379490fd None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:18.010390 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6ba41-7b78-4cbd-aa8d-5339379490fd None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:18.010390 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6ba41-7b78-4cbd-aa8d-5339379490fd None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:18.010390 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 329/665] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:18.010390 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6ba41-7b78-4cbd-aa8d-5339379490fd None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:18.023096 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c151af7-e2b2-4917-8c2c-cc348e94b839 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:18.024999 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c151af7-e2b2-4917-8c2c-cc348e94b839 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:18.045383 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-7c151af7-e2b2-4917-8c2c-cc348e94b839 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:18.045383 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:18.045383 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:18.045383 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:18.045383 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:18.045383 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:18.045383 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:18.045383 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:18.045383 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:18.045383 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:18.045383 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:18.045383 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:18.045383 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:18.045383 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:18.045383 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:18.046306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:18.046306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:18.046306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:18.046306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:18.046306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:18.046306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:18.046306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:18.046306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:18.046306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:18.046306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:18.046306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:18.046306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:18.046306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:18.046306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:18.046306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:18.046306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:18.046306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:18.047192 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:18.047192 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:18.047192 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:18.047192 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:18.047192 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 337/666] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:18.047503 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c151af7-e2b2-4917-8c2c-cc348e94b839 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:18.069270 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:18.080055 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:18.129085 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6ba41-7b78-4cbd-aa8d-5339379490fd None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:18.154491 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c151af7-e2b2-4917-8c2c-cc348e94b839 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:18.163046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96b321-e90e-4c2d-bae3-c62b9bcda60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:18.163931 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96b321-e90e-4c2d-bae3-c62b9bcda60e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:18.164215 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96b321-e90e-4c2d-bae3-c62b9bcda60e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:18.164490 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96b321-e90e-4c2d-bae3-c62b9bcda60e None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:18.165523 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96b321-e90e-4c2d-bae3-c62b9bcda60e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:18.165644 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96b321-e90e-4c2d-bae3-c62b9bcda60e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:18.167044 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96b321-e90e-4c2d-bae3-c62b9bcda60e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:18.180755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 330/667] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:52:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:18.182248 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eb7ac-1cc9-4c4e-b791-a64146789a3c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:18.182604 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eb7ac-1cc9-4c4e-b791-a64146789a3c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:18.182895 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eb7ac-1cc9-4c4e-b791-a64146789a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:18.196097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888f2c0-66f6-4722-8b41-3f6eba598829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:18.196916 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888f2c0-66f6-4722-8b41-3f6eba598829 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:18.197197 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888f2c0-66f6-4722-8b41-3f6eba598829 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:18.197469 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888f2c0-66f6-4722-8b41-3f6eba598829 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:18.204222 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7e8eb7ac-1cc9-4c4e-b791-a64146789a3c None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:18.206036 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7e8eb7ac-1cc9-4c4e-b791-a64146789a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:18.210171 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888f2c0-66f6-4722-8b41-3f6eba598829 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:18.211693 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888f2c0-66f6-4722-8b41-3f6eba598829 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:18.234036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-a888f2c0-66f6-4722-8b41-3f6eba598829 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:18.234036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:18.234036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:18.234036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:18.234036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:18.234036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:18.234036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:18.234036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:18.234036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:18.234036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:18.234036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:18.234036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:18.234036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:18.234036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:18.234036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:18.234981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:18.234981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:18.234981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:18.234981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:18.234981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:18.234981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:18.234981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:18.234981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:18.234981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:18.234981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:18.234981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:18.234981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:18.234981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:18.234981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:18.234981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:18.234981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:18.234981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:18.240834 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:18.240834 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:18.240834 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:18.240834 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:18.240834 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 338/668] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:18.240834 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888f2c0-66f6-4722-8b41-3f6eba598829 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:18.277566 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 331/669] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:52:18.278724 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8eb7ac-1cc9-4c4e-b791-a64146789a3c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:18.318635 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:18.346295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:18.366901 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888f2c0-66f6-4722-8b41-3f6eba598829 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:18.389211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8eb7ac-1cc9-4c4e-b791-a64146789a3c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:18.400588 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83100b31-9a04-4da0-9f47-5d4fcd4f030e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:18.401251 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83100b31-9a04-4da0-9f47-5d4fcd4f030e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:18.401536 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83100b31-9a04-4da0-9f47-5d4fcd4f030e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:18.401815 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83100b31-9a04-4da0-9f47-5d4fcd4f030e None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:18.402539 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83100b31-9a04-4da0-9f47-5d4fcd4f030e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:18.402847 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83100b31-9a04-4da0-9f47-5d4fcd4f030e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:18.404261 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83100b31-9a04-4da0-9f47-5d4fcd4f030e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:18.416202 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 339/670] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:18.416990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83100b31-9a04-4da0-9f47-5d4fcd4f030e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:18.427063 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aee844-a118-4746-8c36-cb1c2c33995d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:18.428102 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aee844-a118-4746-8c36-cb1c2c33995d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:18.428390 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aee844-a118-4746-8c36-cb1c2c33995d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:18.428986 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aee844-a118-4746-8c36-cb1c2c33995d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:18.429826 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aee844-a118-4746-8c36-cb1c2c33995d None admin] RBAC: Adding query filter params (role.id=4d4ff927beb7409996558ecf7143d419, scope.project.id=2633b53c336145bba3d4744dbdfe99b7, user.id=b1dc1d74631b4d69a3094e4e1e2a0ebd) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:18.430142 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aee844-a118-4746-8c36-cb1c2c33995d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:18.431608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aee844-a118-4746-8c36-cb1c2c33995d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:18.437319 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 332/671] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:52:18 2022] GET /identity/v3/role_assignments?user.id=b1dc1d74631b4d69a3094e4e1e2a0ebd&scope.project.id=2633b53c336145bba3d4744dbdfe99b7&role.id=4d4ff927beb7409996558ecf7143d419 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:18.438074 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aee844-a118-4746-8c36-cb1c2c33995d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:18.537481 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83100b31-9a04-4da0-9f47-5d4fcd4f030e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:18.555622 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:18.559143 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aee844-a118-4746-8c36-cb1c2c33995d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:18.575439 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b35f5-76ed-481a-b603-25f0db8c2988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:18.576116 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b35f5-76ed-481a-b603-25f0db8c2988 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:18.576404 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b35f5-76ed-481a-b603-25f0db8c2988 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:18.576678 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b35f5-76ed-481a-b603-25f0db8c2988 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:18.577428 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b35f5-76ed-481a-b603-25f0db8c2988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:18.577736 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b35f5-76ed-481a-b603-25f0db8c2988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:18.579125 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b35f5-76ed-481a-b603-25f0db8c2988 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:18.589119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:18.597819 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 340/672] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:18.599383 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f9851-8c8e-463f-a29c-a34a17a7bff0 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:18.599678 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f9851-8c8e-463f-a29c-a34a17a7bff0 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:18.599956 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f9851-8c8e-463f-a29c-a34a17a7bff0 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:18.600251 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2d60d-b9db-426b-bd32-18496cb5d6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:18.601057 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2d60d-b9db-426b-bd32-18496cb5d6cd None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:18.603364 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 341/673] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:18.603535 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2d60d-b9db-426b-bd32-18496cb5d6cd None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:18.603535 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2d60d-b9db-426b-bd32-18496cb5d6cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:18.603688 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f9851-8c8e-463f-a29c-a34a17a7bff0 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:18.617677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2d60d-b9db-426b-bd32-18496cb5d6cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:18.625766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-82f2d60d-b9db-426b-bd32-18496cb5d6cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:18.625766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:18.625766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:18.625766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:18.625766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:18.625766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:18.625766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:18.625766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:18.625766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:18.625766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:18.625766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:18.625766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:18.625766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:18.625766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:18.625766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:18.625766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:18.626755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:18.626755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:18.626755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:18.626755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:18.626755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:18.626755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:18.626755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:18.626755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:18.626755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:18.626755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:18.626755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:18.626755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:18.626755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:18.626755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:18.626755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:18.626755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:18.627636 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:18.627636 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:18.627636 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:18.627636 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:18.627636 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:18.627636 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:18.627636 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:18.627636 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:18.627636 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:18.627636 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:18.627636 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:18.627636 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:18.627636 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 333/674] 10.222.0.24 () {56 vars in 1102 bytes} [Thu May 19 14:52:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:18.628798 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2d60d-b9db-426b-bd32-18496cb5d6cd None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:18.729233 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f9851-8c8e-463f-a29c-a34a17a7bff0 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:18.740184 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2d60d-b9db-426b-bd32-18496cb5d6cd None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:18.766700 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6fef4-3cb9-434a-92ef-1e460b22ecea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:18.767511 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6fef4-3cb9-434a-92ef-1e460b22ecea None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:18.767796 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6fef4-3cb9-434a-92ef-1e460b22ecea None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:18.768075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6fef4-3cb9-434a-92ef-1e460b22ecea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:18.774659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0678308-5528-4c37-98e9-858b74dc98cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:18.775229 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6fef4-3cb9-434a-92ef-1e460b22ecea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:18.775479 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0678308-5528-4c37-98e9-858b74dc98cf None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:18.775762 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0678308-5528-4c37-98e9-858b74dc98cf None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:18.776035 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0678308-5528-4c37-98e9-858b74dc98cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:18.776621 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6fef4-3cb9-434a-92ef-1e460b22ecea None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:18.783381 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0678308-5528-4c37-98e9-858b74dc98cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:18.784881 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0678308-5528-4c37-98e9-858b74dc98cf None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:18.791692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-9fb6fef4-3cb9-434a-92ef-1e460b22ecea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:18.791692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:18.791692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:18.791692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:18.791692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:18.791692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:18.791692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:18.791692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:18.791692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:18.791692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:18.791692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:18.791692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:18.791692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:18.791692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:18.791692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:18.792548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:18.792548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:18.792548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:18.792548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:18.792548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:18.792548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:18.792548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:18.792548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:18.792548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:18.792548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:18.792548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:18.792548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:18.792548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:18.792548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:18.792548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:18.792548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:18.792548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:18.793434 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:18.793434 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:18.793434 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:18.793434 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:18.793434 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:18.793434 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:18.793434 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:18.793434 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:18.793434 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 342/675] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:18.794438 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b9e56-1064-4360-a8e2-411d76e22aca None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:18.794726 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b9e56-1064-4360-a8e2-411d76e22aca None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:18.795005 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b9e56-1064-4360-a8e2-411d76e22aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:18.802829 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-b0678308-5528-4c37-98e9-858b74dc98cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:18.802829 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:18.802829 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:18.802829 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:18.802829 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:18.802829 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:18.802829 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:18.802829 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:18.802829 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:18.802829 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:18.802829 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:18.802829 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:18.802829 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:18.802829 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:18.802829 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:18.803748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:18.803748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:18.803748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:18.803748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:18.803748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:18.803748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:18.803748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:18.803748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:18.803748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:18.803748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:18.803748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:18.803748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:18.803748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:18.803748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:18.803748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:18.803748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:18.803748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:18.804640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:18.804640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:18.804640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:18.804640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:18.804640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:18.804640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:18.804640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:18.804640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:18.807872 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 334/676] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:18.808181 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0678308-5528-4c37-98e9-858b74dc98cf None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:18.814272 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-903b9e56-1064-4360-a8e2-411d76e22aca None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:18.815483 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-903b9e56-1064-4360-a8e2-411d76e22aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:18.831026 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:18.873890 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:18.891603 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 343/677] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:52:18.892281 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b9e56-1064-4360-a8e2-411d76e22aca None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:18.923182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0678308-5528-4c37-98e9-858b74dc98cf None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:18.957867 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c47ac7-f543-43c7-a4a7-dc3d53a7bae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:18.958536 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c47ac7-f543-43c7-a4a7-dc3d53a7bae6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:18.958817 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c47ac7-f543-43c7-a4a7-dc3d53a7bae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:18.959088 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c47ac7-f543-43c7-a4a7-dc3d53a7bae6 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:18.959869 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c47ac7-f543-43c7-a4a7-dc3d53a7bae6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:18.960302 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c47ac7-f543-43c7-a4a7-dc3d53a7bae6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:18.961567 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c47ac7-f543-43c7-a4a7-dc3d53a7bae6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:18.972453 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 335/678] 10.222.0.24 () {56 vars in 1103 bytes} [Thu May 19 14:52:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:18.973206 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c47ac7-f543-43c7-a4a7-dc3d53a7bae6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:19.008469 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b9e56-1064-4360-a8e2-411d76e22aca None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:19.046839 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33655b9d-8fb2-4e91-a5dc-05dd0ac4a86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:19.047636 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33655b9d-8fb2-4e91-a5dc-05dd0ac4a86e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:19.047927 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33655b9d-8fb2-4e91-a5dc-05dd0ac4a86e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:19.048205 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33655b9d-8fb2-4e91-a5dc-05dd0ac4a86e None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:19.049319 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33655b9d-8fb2-4e91-a5dc-05dd0ac4a86e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:19.049319 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33655b9d-8fb2-4e91-a5dc-05dd0ac4a86e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:19.050746 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33655b9d-8fb2-4e91-a5dc-05dd0ac4a86e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:19.069670 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 344/679] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:52:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:19.069670 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33655b9d-8fb2-4e91-a5dc-05dd0ac4a86e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:19.071076 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:19.092123 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c47ac7-f543-43c7-a4a7-dc3d53a7bae6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:19.122168 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:19.129539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5387e-6b7f-4dc4-b6b6-4b80ece3a55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:19.130214 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5387e-6b7f-4dc4-b6b6-4b80ece3a55c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:19.130498 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5387e-6b7f-4dc4-b6b6-4b80ece3a55c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:19.130776 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5387e-6b7f-4dc4-b6b6-4b80ece3a55c None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:19.131602 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5387e-6b7f-4dc4-b6b6-4b80ece3a55c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:19.131919 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5387e-6b7f-4dc4-b6b6-4b80ece3a55c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:19.133362 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5387e-6b7f-4dc4-b6b6-4b80ece3a55c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:19.146475 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 336/680] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:52:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:19.147300 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5387e-6b7f-4dc4-b6b6-4b80ece3a55c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:19.176744 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33655b9d-8fb2-4e91-a5dc-05dd0ac4a86e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:19.213837 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e9353-ed56-47ca-8daf-481c04825292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:19.214628 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e9353-ed56-47ca-8daf-481c04825292 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:19.214909 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e9353-ed56-47ca-8daf-481c04825292 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:19.215181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e9353-ed56-47ca-8daf-481c04825292 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:19.226153 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e9353-ed56-47ca-8daf-481c04825292 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:19.234548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-bb7e9353-ed56-47ca-8daf-481c04825292 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:52:19.234548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:19.234548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:19.234548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:19.234548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:19.234548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:19.234548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:19.234548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:19.234548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:19.234548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:19.234548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:19.234548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:19.234548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:19.234548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:19.234548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:19.234548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:19.235499 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:19.235499 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:19.235499 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:19.235499 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:19.235499 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:19.235499 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:19.235499 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:19.235499 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:19.235499 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:19.235499 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:19.235499 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:19.235499 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:19.235499 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:19.235499 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:19.235499 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:19.235499 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:19.236326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:19.236326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:19.236326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:19.236326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:19.236326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:19.236326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:19.236326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:19.236326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:19.236326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:19.236326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:19.236326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:52:19.236326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:19.236326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 345/681] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:52:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:19.237638 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e9353-ed56-47ca-8daf-481c04825292 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:19.257357 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5387e-6b7f-4dc4-b6b6-4b80ece3a55c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:19.292583 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c846c-abac-4bc6-b499-c73b4cb9de09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:19.293426 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c846c-abac-4bc6-b499-c73b4cb9de09 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:19.293712 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c846c-abac-4bc6-b499-c73b4cb9de09 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:19.293991 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c846c-abac-4bc6-b499-c73b4cb9de09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:19.304472 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c846c-abac-4bc6-b499-c73b4cb9de09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:19.305930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c846c-abac-4bc6-b499-c73b4cb9de09 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:19.308274 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:19.329796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-723c846c-abac-4bc6-b499-c73b4cb9de09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:19.329796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:19.329796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:19.329796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:19.329796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:19.329796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:19.329796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:19.329796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:19.329796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:19.329796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:19.329796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:19.329796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:19.329796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:19.329796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:19.329796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:19.330825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:19.330825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:19.330825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:19.330825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:19.330825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:19.330825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:19.330825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:19.330825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:19.330825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:19.330825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:19.330825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:19.330825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:19.330825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:19.330825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:19.330825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:19.330825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:19.330825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:19.331798 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:19.331798 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:19.331798 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:19.331798 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:19.331798 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 337/682] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:19.332071 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c846c-abac-4bc6-b499-c73b4cb9de09 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:19.358006 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e9353-ed56-47ca-8daf-481c04825292 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:19.369946 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:19.396792 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303aa9b4-88d3-46d5-912a-92e7396e2d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:19.397450 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303aa9b4-88d3-46d5-912a-92e7396e2d88 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:19.397735 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303aa9b4-88d3-46d5-912a-92e7396e2d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:19.398010 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303aa9b4-88d3-46d5-912a-92e7396e2d88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:19.398833 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303aa9b4-88d3-46d5-912a-92e7396e2d88 None admin] RBAC: Adding query filter params (role.id=4d4ff927beb7409996558ecf7143d419, scope.project.id=2633b53c336145bba3d4744dbdfe99b7, user.id=ed3a61154a444a9cb925839f693208c9) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:19.399333 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303aa9b4-88d3-46d5-912a-92e7396e2d88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:19.400613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303aa9b4-88d3-46d5-912a-92e7396e2d88 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:19.411570 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 346/683] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:52:19 2022] GET /identity/v3/role_assignments?user.id=ed3a61154a444a9cb925839f693208c9&scope.project.id=2633b53c336145bba3d4744dbdfe99b7&role.id=4d4ff927beb7409996558ecf7143d419 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:19.413083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303aa9b4-88d3-46d5-912a-92e7396e2d88 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:19.461723 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c846c-abac-4bc6-b499-c73b4cb9de09 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:19.515667 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebed2b7-6c06-4400-91a0-1b4f25d86778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:19.516738 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebed2b7-6c06-4400-91a0-1b4f25d86778 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:19.517233 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebed2b7-6c06-4400-91a0-1b4f25d86778 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:19.518355 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebed2b7-6c06-4400-91a0-1b4f25d86778 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:19.519799 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebed2b7-6c06-4400-91a0-1b4f25d86778 None admin] RBAC: Adding query filter params (role.id=4d4ff927beb7409996558ecf7143d419, scope.project.id=2633b53c336145bba3d4744dbdfe99b7, user.id=2d089b5ee94e441ebbd084c2581a42df) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:19.520342 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebed2b7-6c06-4400-91a0-1b4f25d86778 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:19.523083 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebed2b7-6c06-4400-91a0-1b4f25d86778 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:19.531381 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303aa9b4-88d3-46d5-912a-92e7396e2d88 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:19.533640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 338/684] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:52:19 2022] GET /identity/v3/role_assignments?user.id=2d089b5ee94e441ebbd084c2581a42df&scope.project.id=2633b53c336145bba3d4744dbdfe99b7&role.id=4d4ff927beb7409996558ecf7143d419 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:19.535716 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebed2b7-6c06-4400-91a0-1b4f25d86778 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:19.569818 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c61c6-8aad-4f14-a167-d088085ade1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:19.570423 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c61c6-8aad-4f14-a167-d088085ade1b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:19.570705 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c61c6-8aad-4f14-a167-d088085ade1b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:19.570978 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c61c6-8aad-4f14-a167-d088085ade1b None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:19.571803 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c61c6-8aad-4f14-a167-d088085ade1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:19.572175 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c61c6-8aad-4f14-a167-d088085ade1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:19.573641 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c61c6-8aad-4f14-a167-d088085ade1b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:19.597750 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 347/685] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:52:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:19.602978 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c61c6-8aad-4f14-a167-d088085ade1b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:19.616002 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:19.672293 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebed2b7-6c06-4400-91a0-1b4f25d86778 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:19.681398 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:19.713594 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a08bff-274a-4d49-a411-da63f8913772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:19.714250 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a08bff-274a-4d49-a411-da63f8913772 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:19.714651 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a08bff-274a-4d49-a411-da63f8913772 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:19.715048 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a08bff-274a-4d49-a411-da63f8913772 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:19.716902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a08bff-274a-4d49-a411-da63f8913772 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:19.717332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a08bff-274a-4d49-a411-da63f8913772 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:19.719476 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a08bff-274a-4d49-a411-da63f8913772 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:19.738356 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 339/686] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:19.748333 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a08bff-274a-4d49-a411-da63f8913772 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:19.772814 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c61c6-8aad-4f14-a167-d088085ade1b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:19.808781 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8326963-3745-42ee-b973-de9aaac00f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:19.809924 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8326963-3745-42ee-b973-de9aaac00f6a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:19.810565 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8326963-3745-42ee-b973-de9aaac00f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:19.811075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8326963-3745-42ee-b973-de9aaac00f6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:19.823379 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8326963-3745-42ee-b973-de9aaac00f6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:19.825136 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8326963-3745-42ee-b973-de9aaac00f6a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:19.844658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-c8326963-3745-42ee-b973-de9aaac00f6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:19.844658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:19.844658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:19.844658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:19.844658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:19.844658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:19.844658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:19.844658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:19.844658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:19.844658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:19.844658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:19.844658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:19.844658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:19.844658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:19.844658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:19.845586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:19.845586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:19.845586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:19.845586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:19.845586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:19.845586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:19.845586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:19.845586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:19.845586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:19.845586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:19.845586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:19.845586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:19.845586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:19.845586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:19.845586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:19.845586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:19.845586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:19.846453 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:19.846453 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:19.846453 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:19.846453 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:19.849613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 348/687] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:19.854012 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8326963-3745-42ee-b973-de9aaac00f6a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:19.876542 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a08bff-274a-4d49-a411-da63f8913772 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:19.896850 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:19.917985 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfcfe9-68c2-4543-9f98-667726515215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:19.918784 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfcfe9-68c2-4543-9f98-667726515215 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:19.919071 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfcfe9-68c2-4543-9f98-667726515215 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:19.919406 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfcfe9-68c2-4543-9f98-667726515215 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:19.927760 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfcfe9-68c2-4543-9f98-667726515215 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:19.929471 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcfcfe9-68c2-4543-9f98-667726515215 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:19.945103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-9fcfcfe9-68c2-4543-9f98-667726515215 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 14:52:19.945103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:19.945103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:19.945103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:19.945103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:19.945103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:19.945103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:19.945103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:19.945103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:19.945103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:19.945103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:19.945103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:19.945103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:19.945103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:19.945103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:19.945103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:19.946085 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:19.946085 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:19.946085 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:19.946085 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:19.946085 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:19.946085 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:19.946085 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:19.946085 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:19.946085 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:19.946085 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:19.946085 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:19.946085 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:19.946085 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:19.946085 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:19.946085 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:19.946085 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:19.946085 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:19.946085 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:19.947379 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:19.947379 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:19.947379 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:19.947379 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:19.947379 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:19.947379 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:19.947379 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:19.947379 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:19.947379 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 14:52:19.947379 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:19.947379 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 340/688] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:52:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:19.951784 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfcfe9-68c2-4543-9f98-667726515215 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:19.970866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:19.993589 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8326963-3745-42ee-b973-de9aaac00f6a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:20.041263 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37b0b6-f8a9-45b9-9958-5f862090738c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:20.042229 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37b0b6-f8a9-45b9-9958-5f862090738c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:20.042690 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37b0b6-f8a9-45b9-9958-5f862090738c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:20.043143 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37b0b6-f8a9-45b9-9958-5f862090738c None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:20.044115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37b0b6-f8a9-45b9-9958-5f862090738c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:20.045478 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37b0b6-f8a9-45b9-9958-5f862090738c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:20.047461 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37b0b6-f8a9-45b9-9958-5f862090738c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:20.062219 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 349/689] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:20.067559 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37b0b6-f8a9-45b9-9958-5f862090738c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:20.085930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfcfe9-68c2-4543-9f98-667726515215 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:20.130734 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447a531-4476-40a2-bb3a-fedbe4971a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:20.131793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447a531-4476-40a2-bb3a-fedbe4971a83 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:20.132304 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447a531-4476-40a2-bb3a-fedbe4971a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:20.132788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447a531-4476-40a2-bb3a-fedbe4971a83 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:20.133847 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447a531-4476-40a2-bb3a-fedbe4971a83 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:20.134361 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447a531-4476-40a2-bb3a-fedbe4971a83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:20.136192 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447a531-4476-40a2-bb3a-fedbe4971a83 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:20.169768 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 341/690] 10.222.0.24 () {56 vars in 1135 bytes} [Thu May 19 14:52:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:20.172323 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447a531-4476-40a2-bb3a-fedbe4971a83 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:20.230349 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37b0b6-f8a9-45b9-9958-5f862090738c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:20.245097 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:20.268232 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb13e63-47c4-4b06-8569-7d6c890f877f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:20.269432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb13e63-47c4-4b06-8569-7d6c890f877f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:20.269937 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb13e63-47c4-4b06-8569-7d6c890f877f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:20.270429 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb13e63-47c4-4b06-8569-7d6c890f877f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:20.286758 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb13e63-47c4-4b06-8569-7d6c890f877f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:20.288617 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb13e63-47c4-4b06-8569-7d6c890f877f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:20.327173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-7fb13e63-47c4-4b06-8569-7d6c890f877f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:52:20.327173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:20.327173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:20.327173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:20.327173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:20.327173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:20.327173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:20.327173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:20.327173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:20.327173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:20.327173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:20.327173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:20.327173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:20.327173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:20.327173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:20.327173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:20.328236 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:20.328236 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:20.328236 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:20.328236 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:20.328236 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:20.328236 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:20.328236 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:20.328236 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:20.328236 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:20.328236 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:20.328236 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:20.328236 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:20.328236 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:20.328236 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:20.328236 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:20.328236 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:20.328236 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:20.328236 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:20.329260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:20.329260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:20.329260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:20.329260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:20.329260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:20.329260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:20.329260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:20.329260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:20.329260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:52:20.329260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:20.329260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 350/691] 10.222.0.24 () {56 vars in 1093 bytes} [Thu May 19 14:52:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:20.335828 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb13e63-47c4-4b06-8569-7d6c890f877f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:20.347776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:20.465884 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb13e63-47c4-4b06-8569-7d6c890f877f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:20.502401 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612eda64-9127-459d-88f7-c6af47f5590d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:20.503136 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612eda64-9127-459d-88f7-c6af47f5590d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:20.503462 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612eda64-9127-459d-88f7-c6af47f5590d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:20.503744 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612eda64-9127-459d-88f7-c6af47f5590d None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:20.504592 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612eda64-9127-459d-88f7-c6af47f5590d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:20.504905 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612eda64-9127-459d-88f7-c6af47f5590d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:20.506527 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612eda64-9127-459d-88f7-c6af47f5590d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:20.529651 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 351/692] 10.222.0.24 () {56 vars in 1133 bytes} [Thu May 19 14:52:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:20.531586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612eda64-9127-459d-88f7-c6af47f5590d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:20.586328 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447a531-4476-40a2-bb3a-fedbe4971a83 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:20.603270 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:20.655965 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612eda64-9127-459d-88f7-c6af47f5590d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:20.661288 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb5c48-d746-4b09-9058-e94e6dc93716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:20.661976 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb5c48-d746-4b09-9058-e94e6dc93716 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:20.662261 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb5c48-d746-4b09-9058-e94e6dc93716 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:20.662531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb5c48-d746-4b09-9058-e94e6dc93716 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:20.725211 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80bf0a5-076b-4163-bf30-f449d5dbbb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:20.725862 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bf0a5-076b-4163-bf30-f449d5dbbb51 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:20.726143 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bf0a5-076b-4163-bf30-f449d5dbbb51 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:20.726415 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bf0a5-076b-4163-bf30-f449d5dbbb51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:20.799476 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb5c48-d746-4b09-9058-e94e6dc93716 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:20.800987 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb5c48-d746-4b09-9058-e94e6dc93716 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:20.812357 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80bf0a5-076b-4163-bf30-f449d5dbbb51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:20.813822 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80bf0a5-076b-4163-bf30-f449d5dbbb51 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:20.853111 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:20.879808 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:20.923313 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 352/693] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:52:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 19 14:52:20.924833 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec337bb-6273-4f1a-9086-c5578674ce6b None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:20.925048 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec337bb-6273-4f1a-9086-c5578674ce6b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:20.925329 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec337bb-6273-4f1a-9086-c5578674ce6b None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:20.927095 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 353/694] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:20.928095 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec337bb-6273-4f1a-9086-c5578674ce6b None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:20.948481 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 342/695] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:52:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 776 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 19 14:52:20.950857 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afec976-d0d8-4f41-80e5-6e92600c31a6 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:20.951383 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afec976-d0d8-4f41-80e5-6e92600c31a6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:20.952616 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afec976-d0d8-4f41-80e5-6e92600c31a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:20.975710 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2afec976-d0d8-4f41-80e5-6e92600c31a6 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:20.977913 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2afec976-d0d8-4f41-80e5-6e92600c31a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:21.050065 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec337bb-6273-4f1a-9086-c5578674ce6b None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:21.062067 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 343/696] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:52:21.063149 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afec976-d0d8-4f41-80e5-6e92600c31a6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:21.097064 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e4c76-d6cd-44de-9375-32f062b421c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:21.098003 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e4c76-d6cd-44de-9375-32f062b421c1 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:21.098384 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e4c76-d6cd-44de-9375-32f062b421c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:21.098758 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e4c76-d6cd-44de-9375-32f062b421c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:21.110865 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e4c76-d6cd-44de-9375-32f062b421c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:21.112505 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e4c76-d6cd-44de-9375-32f062b421c1 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:21.131358 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-e14e4c76-d6cd-44de-9375-32f062b421c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:21.131358 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:21.131358 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:21.131358 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:21.131358 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:21.131358 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:21.131358 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:21.131358 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:21.131358 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:21.131358 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:21.131358 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:21.131358 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:21.131358 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:21.131358 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:21.131358 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:21.132456 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:21.132456 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:21.132456 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:21.132456 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:21.132456 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:21.132456 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:21.132456 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:21.132456 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:21.132456 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:21.132456 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:21.132456 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:21.132456 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:21.132456 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:21.132456 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:21.132456 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:21.132456 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:21.132456 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:21.133593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:21.133593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:21.133593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:21.133593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:21.140221 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 354/697] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:21.141382 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e4c76-d6cd-44de-9375-32f062b421c1 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:21.141969 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:21.163279 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:21.195278 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afec976-d0d8-4f41-80e5-6e92600c31a6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:21.236299 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551fd6e-2728-44dd-9439-980301d9d4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:21.237104 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551fd6e-2728-44dd-9439-980301d9d4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:21.237391 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551fd6e-2728-44dd-9439-980301d9d4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:21.237666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551fd6e-2728-44dd-9439-980301d9d4e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:21.248699 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551fd6e-2728-44dd-9439-980301d9d4e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:21.250659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551fd6e-2728-44dd-9439-980301d9d4e2 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:21.262304 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e4c76-d6cd-44de-9375-32f062b421c1 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:21.268929 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-f551fd6e-2728-44dd-9439-980301d9d4e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:21.268929 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:21.268929 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:21.268929 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:21.268929 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:21.268929 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:21.268929 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:21.268929 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:21.268929 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:21.268929 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:21.268929 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:21.268929 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:21.268929 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:21.268929 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:21.268929 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:21.269825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:21.269825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:21.269825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:21.269825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:21.269825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:21.269825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:21.269825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:21.269825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:21.269825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:21.269825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:21.269825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:21.269825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:21.269825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:21.269825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:21.269825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:21.269825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:21.269825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:21.270715 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:21.270715 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:21.270715 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:21.270715 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:21.270715 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 344/698] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:21.271469 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551fd6e-2728-44dd-9439-980301d9d4e2 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:21.300743 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447095f-4dfc-4960-bcd2-034a72351c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:21.301539 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447095f-4dfc-4960-bcd2-034a72351c7c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:21.301822 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447095f-4dfc-4960-bcd2-034a72351c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:21.302100 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447095f-4dfc-4960-bcd2-034a72351c7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:21.313999 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447095f-4dfc-4960-bcd2-034a72351c7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:21.314578 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447095f-4dfc-4960-bcd2-034a72351c7c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:21.339221 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-0447095f-4dfc-4960-bcd2-034a72351c7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:21.339221 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:21.339221 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:21.339221 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:21.339221 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:21.339221 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:21.339221 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:21.339221 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:21.339221 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:21.339221 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:21.339221 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:21.339221 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:21.339221 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:21.339221 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:21.339221 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:21.340141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:21.340141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:21.340141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:21.340141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:21.340141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:21.340141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:21.340141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:21.340141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:21.340141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:21.340141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:21.340141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:21.340141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:21.340141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:21.340141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:21.340141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:21.340141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:21.340141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:21.341009 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:21.341009 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:21.341009 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:21.341009 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:21.341009 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 355/699] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:21.341009 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447095f-4dfc-4960-bcd2-034a72351c7c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:21.383802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551fd6e-2728-44dd-9439-980301d9d4e2 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:21.402325 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:21.405701 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:21.425984 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5768d2-b90a-4be3-a42b-58179bb5ccf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:21.426898 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5768d2-b90a-4be3-a42b-58179bb5ccf3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:21.427477 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5768d2-b90a-4be3-a42b-58179bb5ccf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:21.427899 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5768d2-b90a-4be3-a42b-58179bb5ccf3 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:21.428774 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5768d2-b90a-4be3-a42b-58179bb5ccf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:21.429231 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5768d2-b90a-4be3-a42b-58179bb5ccf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:21.431010 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5768d2-b90a-4be3-a42b-58179bb5ccf3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:21.440519 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447095f-4dfc-4960-bcd2-034a72351c7c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:21.450137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 345/700] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:21.451390 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5768d2-b90a-4be3-a42b-58179bb5ccf3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:21.476311 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3bcf3-2ca1-4845-ac89-9bc2b7a89c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:21.476955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3bcf3-2ca1-4845-ac89-9bc2b7a89c59 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:21.477244 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3bcf3-2ca1-4845-ac89-9bc2b7a89c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:21.477517 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3bcf3-2ca1-4845-ac89-9bc2b7a89c59 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:21.478294 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3bcf3-2ca1-4845-ac89-9bc2b7a89c59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:21.478608 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3bcf3-2ca1-4845-ac89-9bc2b7a89c59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:21.480035 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3bcf3-2ca1-4845-ac89-9bc2b7a89c59 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:21.492246 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 356/701] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:21.493143 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3bcf3-2ca1-4845-ac89-9bc2b7a89c59 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:21.562276 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5768d2-b90a-4be3-a42b-58179bb5ccf3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:21.600332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74579e66-2496-486f-a4d2-004c98bf1bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:21.601250 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74579e66-2496-486f-a4d2-004c98bf1bda None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:21.601707 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74579e66-2496-486f-a4d2-004c98bf1bda None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:21.602115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3bcf3-2ca1-4845-ac89-9bc2b7a89c59 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:21.602271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74579e66-2496-486f-a4d2-004c98bf1bda None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:21.603126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74579e66-2496-486f-a4d2-004c98bf1bda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:21.603702 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74579e66-2496-486f-a4d2-004c98bf1bda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:21.605362 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74579e66-2496-486f-a4d2-004c98bf1bda None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:21.619188 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 346/702] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:21.620713 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74579e66-2496-486f-a4d2-004c98bf1bda None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:21.633066 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:21.640249 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205dbba-8acc-44a9-a3ac-da3d264b9a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:21.641049 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205dbba-8acc-44a9-a3ac-da3d264b9a50 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:21.641682 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205dbba-8acc-44a9-a3ac-da3d264b9a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:21.642074 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205dbba-8acc-44a9-a3ac-da3d264b9a50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:21.649781 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205dbba-8acc-44a9-a3ac-da3d264b9a50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:21.651493 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205dbba-8acc-44a9-a3ac-da3d264b9a50 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:21.666355 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:21.666663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-5205dbba-8acc-44a9-a3ac-da3d264b9a50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:21.666663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:21.666663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:21.666663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:21.666663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:21.666663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:21.666663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:21.666663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:21.666663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:21.666663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:21.666663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:21.666663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:21.666663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:21.666663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:21.666663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:21.667715 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:21.667715 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:21.667715 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:21.667715 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:21.667715 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:21.667715 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:21.667715 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:21.667715 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:21.667715 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:21.667715 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:21.667715 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:21.667715 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:21.667715 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:21.667715 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:21.667715 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:21.667715 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:21.667715 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:21.668809 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:21.668809 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:21.668809 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:21.668809 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:21.668809 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:21.668809 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:21.668809 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:21.668809 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:21.674413 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 357/703] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:21.675366 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205dbba-8acc-44a9-a3ac-da3d264b9a50 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:21.751827 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74579e66-2496-486f-a4d2-004c98bf1bda None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:21.794272 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae19d8-93aa-4566-a537-3635fef1cb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:21.795393 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae19d8-93aa-4566-a537-3635fef1cb19 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:21.796217 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae19d8-93aa-4566-a537-3635fef1cb19 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:21.796518 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae19d8-93aa-4566-a537-3635fef1cb19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:21.805238 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205dbba-8acc-44a9-a3ac-da3d264b9a50 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:21.805380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae19d8-93aa-4566-a537-3635fef1cb19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:21.806787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae19d8-93aa-4566-a537-3635fef1cb19 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:21.825389 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-aaae19d8-93aa-4566-a537-3635fef1cb19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:21.825389 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:21.825389 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:21.825389 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:21.825389 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:21.825389 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:21.825389 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:21.825389 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:21.825389 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:21.825389 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:21.825389 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:21.825389 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:21.825389 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:21.825389 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:21.825389 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:21.826521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:21.826521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:21.826521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:21.826521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:21.826521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:21.826521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:21.826521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:21.826521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:21.826521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:21.826521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:21.826521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:21.826521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:21.826521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:21.826521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:21.826521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:21.826521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:21.826521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:21.827855 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:21.827855 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:21.827855 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:21.827855 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:21.827855 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:21.827855 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:21.827855 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:21.827855 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:21.827855 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 347/704] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:21.827855 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae19d8-93aa-4566-a537-3635fef1cb19 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:21.849849 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a167d0-9624-425b-8d84-989bbd21913b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:21.851095 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a167d0-9624-425b-8d84-989bbd21913b None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:21.851596 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a167d0-9624-425b-8d84-989bbd21913b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:21.852014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a167d0-9624-425b-8d84-989bbd21913b None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:21.852866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a167d0-9624-425b-8d84-989bbd21913b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:21.855297 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a167d0-9624-425b-8d84-989bbd21913b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:21.887297 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 358/705] 10.222.0.24 () {60 vars in 1132 bytes} [Thu May 19 14:52:21 2022] POST /identity/v3/users => generated 254 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:52:21.890355 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a167d0-9624-425b-8d84-989bbd21913b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:21.956234 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:21.978274 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:21.988398 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae19d8-93aa-4566-a537-3635fef1cb19 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:22.085195 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5800b8a-86a9-469c-9101-3709b7d593d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:22.085895 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5800b8a-86a9-469c-9101-3709b7d593d1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:22.086185 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5800b8a-86a9-469c-9101-3709b7d593d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:22.086466 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5800b8a-86a9-469c-9101-3709b7d593d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:22.087299 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5800b8a-86a9-469c-9101-3709b7d593d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:22.087676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5800b8a-86a9-469c-9101-3709b7d593d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:22.089169 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5800b8a-86a9-469c-9101-3709b7d593d1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:22.120436 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 348/706] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:52:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:22.126673 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5800b8a-86a9-469c-9101-3709b7d593d1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:22.174566 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a167d0-9624-425b-8d84-989bbd21913b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:22.216063 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77b0f4-6607-485d-b799-26c87d92ef84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:22.217093 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77b0f4-6607-485d-b799-26c87d92ef84 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:22.218139 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77b0f4-6607-485d-b799-26c87d92ef84 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:22.218613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77b0f4-6607-485d-b799-26c87d92ef84 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:22.219655 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77b0f4-6607-485d-b799-26c87d92ef84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:22.220164 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77b0f4-6607-485d-b799-26c87d92ef84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:22.221812 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77b0f4-6607-485d-b799-26c87d92ef84 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:22.235147 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 359/707] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:52:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:22.236893 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2761c8c-26d8-4529-92d8-6788b954dc00 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:22.237405 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2761c8c-26d8-4529-92d8-6788b954dc00 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:22.237883 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2761c8c-26d8-4529-92d8-6788b954dc00 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:22.239602 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 360/708] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:22.241156 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2761c8c-26d8-4529-92d8-6788b954dc00 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:22.270194 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5800b8a-86a9-469c-9101-3709b7d593d1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:22.315042 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1df959-190b-4a66-9ac4-578b11314821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:22.315825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1df959-190b-4a66-9ac4-578b11314821 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:22.316113 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1df959-190b-4a66-9ac4-578b11314821 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:22.316762 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1df959-190b-4a66-9ac4-578b11314821 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:22.317894 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1df959-190b-4a66-9ac4-578b11314821 None admin] RBAC: Adding query filter params (role.id=ec4b73b709ca4cdc983e35e955aed57a, scope.project.id=2633b53c336145bba3d4744dbdfe99b7, user.id=06fb8bb5aeb143ad95f33c3b43dbd346) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:22.318212 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1df959-190b-4a66-9ac4-578b11314821 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:22.320026 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1df959-190b-4a66-9ac4-578b11314821 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:22.328713 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 349/709] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:52:22 2022] GET /identity/v3/role_assignments?user.id=06fb8bb5aeb143ad95f33c3b43dbd346&scope.project.id=2633b53c336145bba3d4744dbdfe99b7&role.id=ec4b73b709ca4cdc983e35e955aed57a => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:22.330654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc3037-5ac8-4f80-86a4-bb6bb5edfb8a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:22.330958 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc3037-5ac8-4f80-86a4-bb6bb5edfb8a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:22.331276 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc3037-5ac8-4f80-86a4-bb6bb5edfb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:22.355828 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f2fc3037-5ac8-4f80-86a4-bb6bb5edfb8a None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:22.357393 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f2fc3037-5ac8-4f80-86a4-bb6bb5edfb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:22.379164 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:22.388804 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2761c8c-26d8-4529-92d8-6788b954dc00 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:22.398113 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:22.436461 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f5e17-b12b-47ab-abfb-645e2a0cf0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:22.437161 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f5e17-b12b-47ab-abfb-645e2a0cf0fb None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:22.437493 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f5e17-b12b-47ab-abfb-645e2a0cf0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:22.437778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f5e17-b12b-47ab-abfb-645e2a0cf0fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:22.438637 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f5e17-b12b-47ab-abfb-645e2a0cf0fb None admin] RBAC: Adding query filter params (role.id=4d4ff927beb7409996558ecf7143d419, scope.project.id=2633b53c336145bba3d4744dbdfe99b7, user.id=8ecbeee0c1cf4c58be6c22aa11d7ff5a) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:22.438948 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f5e17-b12b-47ab-abfb-645e2a0cf0fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:22.440718 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f5e17-b12b-47ab-abfb-645e2a0cf0fb None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:22.448634 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 361/710] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:52:22 2022] GET /identity/v3/role_assignments?user.id=8ecbeee0c1cf4c58be6c22aa11d7ff5a&scope.project.id=2633b53c336145bba3d4744dbdfe99b7&role.id=4d4ff927beb7409996558ecf7143d419 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:22.450151 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb946c-5f52-42d2-b918-e096392a403a None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:22.450443 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb946c-5f52-42d2-b918-e096392a403a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:22.450817 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb946c-5f52-42d2-b918-e096392a403a None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:22.453305 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 362/711] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:22.460901 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ec2b2-8839-4929-ad8b-3c063e26e97c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:22.461242 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ec2b2-8839-4929-ad8b-3c063e26e97c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:22.461520 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ec2b2-8839-4929-ad8b-3c063e26e97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:22.465319 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 350/712] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:52:22.484246 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-8e3ec2b2-8839-4929-ad8b-3c063e26e97c None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:22.485472 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8e3ec2b2-8839-4929-ad8b-3c063e26e97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:22.500929 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc3037-5ac8-4f80-86a4-bb6bb5edfb8a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:22.628943 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 363/713] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:52:22.630703 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc3037-5ac8-4f80-86a4-bb6bb5edfb8a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:22.681255 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ec2b2-8839-4929-ad8b-3c063e26e97c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:22.687935 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fdb80-c58b-4fa3-b776-d44b3b3d8d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:22.688701 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fdb80-c58b-4fa3-b776-d44b3b3d8d7b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:22.688990 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fdb80-c58b-4fa3-b776-d44b3b3d8d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:22.689269 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fdb80-c58b-4fa3-b776-d44b3b3d8d7b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:22.689931 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4fdb80-c58b-4fa3-b776-d44b3b3d8d7b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:22.691454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4fdb80-c58b-4fa3-b776-d44b3b3d8d7b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:22.712062 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-2d4fdb80-c58b-4fa3-b776-d44b3b3d8d7b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:52:22.712062 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:22.712062 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:22.712062 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:22.712062 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:22.712062 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:22.712062 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:22.712062 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:22.712062 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:52:22.712062 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:22.712062 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:22.712062 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:22.712062 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:22.712062 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:22.712062 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:22.712062 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:22.713381 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:22.713381 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:22.713381 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:22.713381 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:22.713381 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:22.713381 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:22.713381 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:22.713381 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:22.713381 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:22.713381 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:22.713381 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:22.713381 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:22.713381 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:22.713381 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:22.713381 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:22.713381 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:22.714455 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:22.714455 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:22.714455 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:22.714455 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:22.714455 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:22.714455 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:22.714455 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:22.714455 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:22.714455 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:22.714455 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:22.714455 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:22.714455 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:22.714455 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:22.714455 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:52:22.714455 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:22.714455 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 351/714] 10.222.0.24 () {56 vars in 1129 bytes} [Thu May 19 14:52:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:22.722275 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fdb80-c58b-4fa3-b776-d44b3b3d8d7b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:22.746391 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:22.806942 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:22.812047 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ec2b2-8839-4929-ad8b-3c063e26e97c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:22.855974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb7843-856b-4e7a-a881-11e46f3f8eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:22.857702 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb7843-856b-4e7a-a881-11e46f3f8eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:22.858217 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb7843-856b-4e7a-a881-11e46f3f8eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:22.858672 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb7843-856b-4e7a-a881-11e46f3f8eb2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:22.859532 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fdb80-c58b-4fa3-b776-d44b3b3d8d7b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:22.859773 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb7843-856b-4e7a-a881-11e46f3f8eb2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:22.861574 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb7843-856b-4e7a-a881-11e46f3f8eb2 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:22.882949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-94fb7843-856b-4e7a-a881-11e46f3f8eb2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:52:22.882949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:22.882949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:22.882949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:22.882949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:22.882949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:22.882949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:22.882949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:22.882949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:52:22.882949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:22.882949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:22.882949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:22.882949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:22.882949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:22.882949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:22.882949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:22.882949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:22.884069 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:22.884069 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:22.884069 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:22.884069 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:22.884069 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:22.884069 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:22.884069 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:22.884069 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:22.884069 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:22.884069 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:22.884069 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:22.884069 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:22.884069 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:22.884069 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:22.884069 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:22.884069 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:22.884949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:22.884949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:22.884949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:22.884949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:22.884949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:22.884949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:22.884949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:22.884949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:22.884949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:22.884949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:22.884949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:22.884949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:22.884949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:52:22.884949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:22.888261 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 364/715] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:22 2022] GET /identity/v3/services/network => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:22.894200 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb7843-856b-4e7a-a881-11e46f3f8eb2 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:22.910783 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb9c2d-bc5a-464d-aec3-e8857652f995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:22.913156 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb9c2d-bc5a-464d-aec3-e8857652f995 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:22.913156 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb9c2d-bc5a-464d-aec3-e8857652f995 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:22.913156 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb9c2d-bc5a-464d-aec3-e8857652f995 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:22.913156 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb9c2d-bc5a-464d-aec3-e8857652f995 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:22.913156 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb9c2d-bc5a-464d-aec3-e8857652f995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:22.914597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb9c2d-bc5a-464d-aec3-e8857652f995 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:22.920431 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 352/716] 10.222.0.24 () {56 vars in 1124 bytes} [Thu May 19 14:52:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:22.926326 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb9c2d-bc5a-464d-aec3-e8857652f995 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:23.041228 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb7843-856b-4e7a-a881-11e46f3f8eb2 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:23.066561 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb9c2d-bc5a-464d-aec3-e8857652f995 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:23.079595 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:23.110609 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53434c15-d932-4626-94e2-44b5f108d995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:23.111309 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53434c15-d932-4626-94e2-44b5f108d995 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:23.111590 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53434c15-d932-4626-94e2-44b5f108d995 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:23.111870 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53434c15-d932-4626-94e2-44b5f108d995 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:23.112583 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53434c15-d932-4626-94e2-44b5f108d995 None admin] RBAC: Adding query filter params (name=network) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:23.112892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53434c15-d932-4626-94e2-44b5f108d995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:23.114262 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53434c15-d932-4626-94e2-44b5f108d995 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:23.120068 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 365/717] 10.222.0.24 () {56 vars in 1112 bytes} [Thu May 19 14:52:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:23.126464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53434c15-d932-4626-94e2-44b5f108d995 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:23.135742 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6251b-7183-43ac-b4de-78c04684e01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:23.136427 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6251b-7183-43ac-b4de-78c04684e01b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:23.136709 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6251b-7183-43ac-b4de-78c04684e01b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:23.137005 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6251b-7183-43ac-b4de-78c04684e01b None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:23.137786 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6251b-7183-43ac-b4de-78c04684e01b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:23.138098 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6251b-7183-43ac-b4de-78c04684e01b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:23.139674 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6251b-7183-43ac-b4de-78c04684e01b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:23.151832 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 353/718] 10.222.0.24 () {56 vars in 1124 bytes} [Thu May 19 14:52:22 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:23.156756 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:23.282730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53434c15-d932-4626-94e2-44b5f108d995 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:23.334633 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beac506-fb0a-478a-9c1f-800fc922b610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:23.335337 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beac506-fb0a-478a-9c1f-800fc922b610 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:23.335617 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beac506-fb0a-478a-9c1f-800fc922b610 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:23.335884 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beac506-fb0a-478a-9c1f-800fc922b610 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:23.336592 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beac506-fb0a-478a-9c1f-800fc922b610 None admin] RBAC: Adding query filter params (type=network) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:23.336896 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beac506-fb0a-478a-9c1f-800fc922b610 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:23.338318 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beac506-fb0a-478a-9c1f-800fc922b610 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:23.348997 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 366/719] 10.222.0.24 () {56 vars in 1112 bytes} [Thu May 19 14:52:23 2022] GET /identity/v3/services?type=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:24.834070 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ae916-f638-43d7-9f91-3bc325eda30b None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:24.834639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ae916-f638-43d7-9f91-3bc325eda30b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:24.834639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ae916-f638-43d7-9f91-3bc325eda30b None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:24.836345 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 354/720] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:24.841928 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349e629-15a2-448d-b2e9-2789a0fb4eb4 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:24.842626 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349e629-15a2-448d-b2e9-2789a0fb4eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:24.842626 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349e629-15a2-448d-b2e9-2789a0fb4eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:24.864915 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d349e629-15a2-448d-b2e9-2789a0fb4eb4 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:24.866098 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d349e629-15a2-448d-b2e9-2789a0fb4eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:24.953302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 367/721] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:52:24.988542 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ae916-f638-43d7-9f91-3bc325eda30b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:25.021872 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d8b32-4c6a-4bb6-bd34-f2db39ca16fa None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:25.022174 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d8b32-4c6a-4bb6-bd34-f2db39ca16fa None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:25.022424 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d8b32-4c6a-4bb6-bd34-f2db39ca16fa None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:25.024062 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 368/722] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:25.029035 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7c391-9457-4448-9832-272f225800a9 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:25.029321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7c391-9457-4448-9832-272f225800a9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:25.029593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7c391-9457-4448-9832-272f225800a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:25.051971 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-64a7c391-9457-4448-9832-272f225800a9 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:25.053144 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-64a7c391-9457-4448-9832-272f225800a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:25.088275 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:25.165653 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ae916-f638-43d7-9f91-3bc325eda30b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:25.175055 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 369/723] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:52:25.213458 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d1112-1689-47ae-8123-13da435fd25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:25.215254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7c391-9457-4448-9832-272f225800a9 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:25.228165 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d1112-1689-47ae-8123-13da435fd25a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:25.229649 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d1112-1689-47ae-8123-13da435fd25a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:25.229935 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d1112-1689-47ae-8123-13da435fd25a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:25.253591 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d1112-1689-47ae-8123-13da435fd25a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:25.261323 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-852d1112-1689-47ae-8123-13da435fd25a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:25.261323 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:25.261323 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:25.261323 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:25.261323 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:25.261323 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:25.261323 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:25.261323 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:25.261323 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:25.261323 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:25.261323 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:25.261323 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:25.261323 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:25.261323 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:25.261323 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:25.261323 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:25.263499 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:25.263499 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:25.263499 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:25.263499 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:25.263499 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:25.263499 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:25.263499 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:25.263499 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:25.263499 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:25.263499 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:25.263499 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:25.263499 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:25.263499 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:25.263499 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:25.263499 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:25.263499 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:25.265640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:25.265640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:25.265640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:25.265640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:25.265640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:25.265640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:25.265640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:25.265640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:25.265640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:25.265640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:25.265640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:25.265640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:25.265640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 355/724] 10.222.0.24 () {56 vars in 1102 bytes} [Thu May 19 14:52:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:25.284913 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d1112-1689-47ae-8123-13da435fd25a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:25.291539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:25.408745 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7c391-9457-4448-9832-272f225800a9 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:25.436066 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d1112-1689-47ae-8123-13da435fd25a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:25.450360 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6cc40-5043-4b00-8613-6339885be9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:25.450911 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6cc40-5043-4b00-8613-6339885be9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:25.451214 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6cc40-5043-4b00-8613-6339885be9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:25.451504 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6cc40-5043-4b00-8613-6339885be9b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:25.462653 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df6cc40-5043-4b00-8613-6339885be9b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:25.470991 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-4df6cc40-5043-4b00-8613-6339885be9b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:52:25.470991 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:25.470991 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:25.470991 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:25.470991 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:25.470991 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:25.470991 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:25.470991 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:25.470991 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:25.470991 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:25.470991 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:25.470991 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:25.470991 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:25.470991 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:25.470991 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:25.470991 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:25.472209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:25.472209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:25.472209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:25.472209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:25.472209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:25.472209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:25.472209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:25.472209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:25.472209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:25.472209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:25.472209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:25.472209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:25.472209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:25.472209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:25.472209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:25.472209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:25.473229 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:25.473229 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:25.473229 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:25.473229 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:25.473229 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:25.473229 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:25.473229 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:25.473229 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:25.473229 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:25.473229 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:25.473229 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:52:25.473229 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:25.473229 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 370/725] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:52:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:25.474011 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff284933-e948-4701-afa7-61383f9596a0 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:25.474011 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff284933-e948-4701-afa7-61383f9596a0 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:25.474256 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff284933-e948-4701-afa7-61383f9596a0 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:25.479444 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 371/726] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:25.479444 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff284933-e948-4701-afa7-61383f9596a0 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:25.486986 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6211fff0-5ab1-4126-ae98-1ab5e3264910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:25.487911 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211fff0-5ab1-4126-ae98-1ab5e3264910 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:25.488383 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211fff0-5ab1-4126-ae98-1ab5e3264910 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:25.488813 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211fff0-5ab1-4126-ae98-1ab5e3264910 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:25.490260 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211fff0-5ab1-4126-ae98-1ab5e3264910 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:25.490722 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211fff0-5ab1-4126-ae98-1ab5e3264910 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:25.493138 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6211fff0-5ab1-4126-ae98-1ab5e3264910 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:25.495797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:25.509319 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 356/727] 10.222.0.24 () {56 vars in 1103 bytes} [Thu May 19 14:52:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:25.509319 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af46ad-cf13-42bb-88b5-0f582051afe3 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:25.509319 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af46ad-cf13-42bb-88b5-0f582051afe3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:25.509319 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af46ad-cf13-42bb-88b5-0f582051afe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:25.527928 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-51af46ad-cf13-42bb-88b5-0f582051afe3 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:25.529306 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-51af46ad-cf13-42bb-88b5-0f582051afe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:25.601327 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:25.618501 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 357/728] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:52:25.618501 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af46ad-cf13-42bb-88b5-0f582051afe3 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:25.628986 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff284933-e948-4701-afa7-61383f9596a0 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:25.669648 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64644d-b59a-428a-98dc-aa37f3f37372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:25.670234 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64644d-b59a-428a-98dc-aa37f3f37372 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:25.670534 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64644d-b59a-428a-98dc-aa37f3f37372 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:25.670813 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64644d-b59a-428a-98dc-aa37f3f37372 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:25.671752 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64644d-b59a-428a-98dc-aa37f3f37372 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:25.672111 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64644d-b59a-428a-98dc-aa37f3f37372 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:25.674424 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64644d-b59a-428a-98dc-aa37f3f37372 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:25.685600 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 372/729] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:52:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:25.686513 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64644d-b59a-428a-98dc-aa37f3f37372 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:25.757395 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af46ad-cf13-42bb-88b5-0f582051afe3 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:25.789104 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:25.799851 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f749f93-d80f-4c0b-af08-79184195cfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:25.800646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f749f93-d80f-4c0b-af08-79184195cfde None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:25.800926 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f749f93-d80f-4c0b-af08-79184195cfde None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:25.801200 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f749f93-d80f-4c0b-af08-79184195cfde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:25.815033 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f749f93-d80f-4c0b-af08-79184195cfde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:25.817007 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f749f93-d80f-4c0b-af08-79184195cfde None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:25.819389 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64644d-b59a-428a-98dc-aa37f3f37372 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:25.839380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-7f749f93-d80f-4c0b-af08-79184195cfde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:25.839380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:25.839380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:25.839380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:25.839380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:25.839380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:25.839380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:25.839380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:25.839380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:25.839380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:25.839380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:25.839380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:25.839380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:25.839380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:25.839380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:25.840646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:25.840646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:25.840646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:25.840646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:25.840646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:25.840646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:25.840646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:25.840646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:25.840646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:25.840646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:25.840646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:25.840646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:25.840646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:25.840646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:25.840646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:25.840646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:25.840646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:25.841520 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:25.841520 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:25.841520 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:25.841520 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:25.843308 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 358/730] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:25.844580 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f749f93-d80f-4c0b-af08-79184195cfde None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:25.861349 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c87f2c-7c36-44a2-aecf-0832a821d8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:25.862914 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c87f2c-7c36-44a2-aecf-0832a821d8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:25.863580 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c87f2c-7c36-44a2-aecf-0832a821d8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:25.864066 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c87f2c-7c36-44a2-aecf-0832a821d8b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:25.876385 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c87f2c-7c36-44a2-aecf-0832a821d8b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:25.884816 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-f1c87f2c-7c36-44a2-aecf-0832a821d8b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:52:25.884816 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:25.884816 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:25.884816 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:25.884816 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:25.884816 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:25.884816 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:25.884816 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:25.884816 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:25.884816 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:25.884816 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:25.884816 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:25.884816 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:25.884816 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:25.884816 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:25.884816 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:25.885745 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:25.885745 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:25.885745 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:25.885745 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:25.885745 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:25.885745 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:25.885745 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:25.885745 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:25.885745 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:25.885745 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:25.885745 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:25.885745 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:25.885745 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:25.885745 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:25.885745 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:25.885745 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:25.886583 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:25.886583 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:25.886583 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:25.886583 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:25.886583 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:25.886583 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:25.886583 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:25.886583 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:25.886583 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:25.886583 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:25.886583 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:52:25.886583 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:25.894309 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 373/731] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:52:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:25.895552 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c87f2c-7c36-44a2-aecf-0832a821d8b9 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:25.901556 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:25.970500 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f749f93-d80f-4c0b-af08-79184195cfde None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:26.008094 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935781b8-9fdf-43a9-b56f-b60c2648c46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:26.009226 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c87f2c-7c36-44a2-aecf-0832a821d8b9 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:26.009481 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935781b8-9fdf-43a9-b56f-b60c2648c46e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:26.009972 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935781b8-9fdf-43a9-b56f-b60c2648c46e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:26.010454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935781b8-9fdf-43a9-b56f-b60c2648c46e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:26.021757 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935781b8-9fdf-43a9-b56f-b60c2648c46e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:26.023367 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935781b8-9fdf-43a9-b56f-b60c2648c46e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:26.041221 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-935781b8-9fdf-43a9-b56f-b60c2648c46e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:26.041221 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:26.041221 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:26.041221 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:26.041221 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:26.041221 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:26.041221 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:26.041221 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:26.041221 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:26.041221 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:26.041221 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:26.041221 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:26.041221 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:26.041221 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:26.041221 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:26.042121 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:26.042121 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:26.042121 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:26.042121 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:26.042121 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:26.042121 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:26.042121 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:26.042121 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:26.042121 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:26.042121 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:26.042121 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:26.042121 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:26.042121 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:26.042121 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:26.042121 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:26.042121 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:26.042121 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:26.043018 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:26.043018 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:26.043018 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:26.043018 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:26.043018 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 359/732] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:26.043858 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935781b8-9fdf-43a9-b56f-b60c2648c46e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:26.050047 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86630caa-e062-49d2-98f6-4c225e24462a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:26.050706 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86630caa-e062-49d2-98f6-4c225e24462a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:26.050989 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86630caa-e062-49d2-98f6-4c225e24462a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:26.051295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86630caa-e062-49d2-98f6-4c225e24462a None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:26.052017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86630caa-e062-49d2-98f6-4c225e24462a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:26.052319 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86630caa-e062-49d2-98f6-4c225e24462a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:26.053666 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86630caa-e062-49d2-98f6-4c225e24462a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:26.056095 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:26.067527 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 374/733] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:26.069041 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e745d-aa04-404f-ba10-21f7108b8583 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:26.069329 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e745d-aa04-404f-ba10-21f7108b8583 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:26.069609 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e745d-aa04-404f-ba10-21f7108b8583 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:26.071016 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 375/734] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:26.075562 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e745d-aa04-404f-ba10-21f7108b8583 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:26.155249 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:26.159576 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935781b8-9fdf-43a9-b56f-b60c2648c46e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:26.183479 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e745d-aa04-404f-ba10-21f7108b8583 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:26.199875 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670de4dd-1407-46a5-9f10-7baf60df0a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:26.200549 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670de4dd-1407-46a5-9f10-7baf60df0a6b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:26.200835 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670de4dd-1407-46a5-9f10-7baf60df0a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:26.201115 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670de4dd-1407-46a5-9f10-7baf60df0a6b None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:26.201883 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670de4dd-1407-46a5-9f10-7baf60df0a6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:26.202193 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670de4dd-1407-46a5-9f10-7baf60df0a6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:26.203599 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670de4dd-1407-46a5-9f10-7baf60df0a6b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:26.211396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 360/735] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:52:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:26.212171 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670de4dd-1407-46a5-9f10-7baf60df0a6b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:26.221373 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76b622-a299-4092-a4e9-9432b5b2afe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:26.221973 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76b622-a299-4092-a4e9-9432b5b2afe8 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:26.222252 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76b622-a299-4092-a4e9-9432b5b2afe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:26.222532 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76b622-a299-4092-a4e9-9432b5b2afe8 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:26.223270 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76b622-a299-4092-a4e9-9432b5b2afe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:26.223577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76b622-a299-4092-a4e9-9432b5b2afe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:26.224917 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76b622-a299-4092-a4e9-9432b5b2afe8 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:26.236594 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 376/736] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:26.238014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12125967-8c99-4bf4-bffd-fd19335821f8 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:26.238322 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12125967-8c99-4bf4-bffd-fd19335821f8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:26.238582 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12125967-8c99-4bf4-bffd-fd19335821f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:26.255187 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-12125967-8c99-4bf4-bffd-fd19335821f8 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:26.256389 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-12125967-8c99-4bf4-bffd-fd19335821f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:26.304094 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:26.309281 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670de4dd-1407-46a5-9f10-7baf60df0a6b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:26.343254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 377/737] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:52:26.343254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5586d66-02ea-413d-a977-6b69ee01a9af None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:26.343254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5586d66-02ea-413d-a977-6b69ee01a9af None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:26.343254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5586d66-02ea-413d-a977-6b69ee01a9af None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:26.343254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 378/738] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:26.343254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5586d66-02ea-413d-a977-6b69ee01a9af None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:26.348665 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2727b38-45ec-44cd-9dbc-b7854c33b793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:26.349478 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2727b38-45ec-44cd-9dbc-b7854c33b793 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:26.349766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2727b38-45ec-44cd-9dbc-b7854c33b793 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:26.350045 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2727b38-45ec-44cd-9dbc-b7854c33b793 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:26.357668 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2727b38-45ec-44cd-9dbc-b7854c33b793 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:26.359677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2727b38-45ec-44cd-9dbc-b7854c33b793 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:26.374607 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-c2727b38-45ec-44cd-9dbc-b7854c33b793 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:52:26.374607 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:26.374607 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:26.374607 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:26.374607 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:26.374607 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:26.374607 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:26.374607 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:26.374607 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:26.374607 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:26.374607 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:26.374607 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:26.374607 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:26.374607 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:26.374607 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:26.374607 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:26.375694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:26.375694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:26.375694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:26.375694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:26.375694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:26.375694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:26.375694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:26.375694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:26.375694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:26.375694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:26.375694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:26.375694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:26.375694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:26.375694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:26.375694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:26.375694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:26.375694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:26.375694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:26.376657 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:26.376657 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:26.376657 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:26.376657 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:26.376657 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:26.376657 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:26.376657 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:26.376657 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:26.376657 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:52:26.376657 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:26.376657 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 361/739] 10.222.0.24 () {56 vars in 1117 bytes} [Thu May 19 14:52:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:26.376657 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2727b38-45ec-44cd-9dbc-b7854c33b793 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:26.399402 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:26.433140 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5586d66-02ea-413d-a977-6b69ee01a9af None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:26.468439 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9412f-8346-460d-afac-98df0c892519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:26.469321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9412f-8346-460d-afac-98df0c892519 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:26.469614 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9412f-8346-460d-afac-98df0c892519 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:26.469887 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9412f-8346-460d-afac-98df0c892519 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:26.473286 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2727b38-45ec-44cd-9dbc-b7854c33b793 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:26.479626 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9412f-8346-460d-afac-98df0c892519 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:26.481059 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d9412f-8346-460d-afac-98df0c892519 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:26.499781 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-e9d9412f-8346-460d-afac-98df0c892519 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:26.499781 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:26.499781 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:26.499781 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:26.499781 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:26.499781 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:26.499781 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:26.499781 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:26.499781 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:26.499781 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:26.499781 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:26.499781 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:26.499781 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:26.499781 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:26.499781 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:26.500826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:26.500826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:26.500826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:26.500826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:26.500826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:26.500826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:26.500826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:26.500826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:26.500826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:26.500826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:26.500826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:26.500826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:26.500826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:26.500826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:26.500826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:26.500826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:26.500826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:26.501940 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:26.501940 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:26.501940 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:26.501940 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:26.501940 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 379/740] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:26.502282 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a221e9-6d85-4715-8000-1c7cc3f115ef None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:26.502399 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a221e9-6d85-4715-8000-1c7cc3f115ef None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:26.502679 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a221e9-6d85-4715-8000-1c7cc3f115ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:26.512015 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8393277-30a6-4a90-9e09-6d1c942ad80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:26.512802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8393277-30a6-4a90-9e09-6d1c942ad80f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:26.513088 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8393277-30a6-4a90-9e09-6d1c942ad80f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:26.513369 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8393277-30a6-4a90-9e09-6d1c942ad80f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:26.518527 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-59a221e9-6d85-4715-8000-1c7cc3f115ef None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:26.519767 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-59a221e9-6d85-4715-8000-1c7cc3f115ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:26.520871 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8393277-30a6-4a90-9e09-6d1c942ad80f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:26.522297 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8393277-30a6-4a90-9e09-6d1c942ad80f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:26.536365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-e8393277-30a6-4a90-9e09-6d1c942ad80f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:52:26.536365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:26.536365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:26.536365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:26.536365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:26.536365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:26.536365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:26.536365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:26.536365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:26.536365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:26.536365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:26.536365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:26.536365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:26.536365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:26.536365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:26.536365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:26.537378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:26.537378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:26.537378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:26.537378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:26.537378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:26.537378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:26.537378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:26.537378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:26.537378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:26.537378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:26.537378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:26.537378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:26.537378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:26.537378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:26.537378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:26.537378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:26.537378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:26.537378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:26.538321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:26.538321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:26.538321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:26.538321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:26.538321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:26.538321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:26.538321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:26.538321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:26.538321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:52:26.538321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:26.538321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 362/741] 10.222.0.24 () {56 vars in 1093 bytes} [Thu May 19 14:52:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:26.538321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8393277-30a6-4a90-9e09-6d1c942ad80f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:26.549785 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:26.587731 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 380/742] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 19 14:52:26.588561 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a221e9-6d85-4715-8000-1c7cc3f115ef None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:26.621220 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:26.639708 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8393277-30a6-4a90-9e09-6d1c942ad80f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:26.672828 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455da971-ec7c-43d8-a511-6ab0ce68fdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:26.673490 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455da971-ec7c-43d8-a511-6ab0ce68fdaf None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:26.673774 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455da971-ec7c-43d8-a511-6ab0ce68fdaf None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:26.674053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455da971-ec7c-43d8-a511-6ab0ce68fdaf None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:26.674774 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455da971-ec7c-43d8-a511-6ab0ce68fdaf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:26.676162 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455da971-ec7c-43d8-a511-6ab0ce68fdaf None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:26.687783 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a221e9-6d85-4715-8000-1c7cc3f115ef None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:26.703228 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 363/743] 10.222.0.24 () {60 vars in 1141 bytes} [Thu May 19 14:52:26 2022] POST /identity/v3/services => generated 251 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:52:26.703228 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455da971-ec7c-43d8-a511-6ab0ce68fdaf None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:26.743740 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b36f53-9db7-415e-9e4f-fa269fe50fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:26.744349 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b36f53-9db7-415e-9e4f-fa269fe50fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:26.744633 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b36f53-9db7-415e-9e4f-fa269fe50fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:26.744912 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b36f53-9db7-415e-9e4f-fa269fe50fc5 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:26.746033 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b36f53-9db7-415e-9e4f-fa269fe50fc5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:26.746347 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b36f53-9db7-415e-9e4f-fa269fe50fc5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:26.747862 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b36f53-9db7-415e-9e4f-fa269fe50fc5 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:26.773178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 381/744] 10.222.0.24 () {56 vars in 1149 bytes} [Thu May 19 14:52:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:26.773178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b36f53-9db7-415e-9e4f-fa269fe50fc5 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:26.794288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:26.822313 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455da971-ec7c-43d8-a511-6ab0ce68fdaf None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:26.861347 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52970a-ab2e-491a-a5a5-9896dafb66d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:26.862081 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52970a-ab2e-491a-a5a5-9896dafb66d6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:26.862343 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52970a-ab2e-491a-a5a5-9896dafb66d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:26.862580 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52970a-ab2e-491a-a5a5-9896dafb66d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:26.863529 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52970a-ab2e-491a-a5a5-9896dafb66d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:26.863689 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52970a-ab2e-491a-a5a5-9896dafb66d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:26.865050 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52970a-ab2e-491a-a5a5-9896dafb66d6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:26.878995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 364/745] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:26.879757 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52970a-ab2e-491a-a5a5-9896dafb66d6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:26.882448 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:26.889228 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b36f53-9db7-415e-9e4f-fa269fe50fc5 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:26.925109 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0d18a-f797-4dd3-b0d7-cbe0b5e3c1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:26.925783 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0d18a-f797-4dd3-b0d7-cbe0b5e3c1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:26.926070 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0d18a-f797-4dd3-b0d7-cbe0b5e3c1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:26.926350 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0d18a-f797-4dd3-b0d7-cbe0b5e3c1c0 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:26.927193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0d18a-f797-4dd3-b0d7-cbe0b5e3c1c0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:26.927531 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0d18a-f797-4dd3-b0d7-cbe0b5e3c1c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:26.929004 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0d18a-f797-4dd3-b0d7-cbe0b5e3c1c0 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:26.947341 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 382/746] 10.222.0.24 () {56 vars in 1133 bytes} [Thu May 19 14:52:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:26.948288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0d18a-f797-4dd3-b0d7-cbe0b5e3c1c0 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:26.991915 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52970a-ab2e-491a-a5a5-9896dafb66d6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:27.031899 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d47d5-38bb-480b-aab9-1452501510d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:27.033045 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d47d5-38bb-480b-aab9-1452501510d1 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:27.033341 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d47d5-38bb-480b-aab9-1452501510d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:27.033669 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d47d5-38bb-480b-aab9-1452501510d1 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:27.034426 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d47d5-38bb-480b-aab9-1452501510d1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:27.036529 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:27.037421 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d47d5-38bb-480b-aab9-1452501510d1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:27.063398 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 365/747] 10.222.0.24 () {60 vars in 1141 bytes} [Thu May 19 14:52:26 2022] POST /identity/v3/services => generated 240 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:52:27.063398 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d47d5-38bb-480b-aab9-1452501510d1 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:27.063655 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0d18a-f797-4dd3-b0d7-cbe0b5e3c1c0 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:27.112095 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4758c4d-255a-4eac-8b48-9bbb70cbbcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:27.112809 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4758c4d-255a-4eac-8b48-9bbb70cbbcd5 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:27.113108 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4758c4d-255a-4eac-8b48-9bbb70cbbcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:27.113446 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4758c4d-255a-4eac-8b48-9bbb70cbbcd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:27.152427 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:27.200920 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4758c4d-255a-4eac-8b48-9bbb70cbbcd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:27.202687 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4758c4d-255a-4eac-8b48-9bbb70cbbcd5 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:27.210524 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d47d5-38bb-480b-aab9-1452501510d1 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:27.267952 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d64811-56d9-494a-baf7-0ca2826e5d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:27.268914 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d64811-56d9-494a-baf7-0ca2826e5d72 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:27.269199 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d64811-56d9-494a-baf7-0ca2826e5d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:27.270028 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d64811-56d9-494a-baf7-0ca2826e5d72 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:27.278491 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d64811-56d9-494a-baf7-0ca2826e5d72 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:27.281200 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d64811-56d9-494a-baf7-0ca2826e5d72 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:27.297752 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-41d64811-56d9-494a-baf7-0ca2826e5d72 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 14:52:27.297752 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:27.297752 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:27.297752 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:27.297752 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:27.297752 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:27.297752 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:27.297752 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:27.297752 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:27.297752 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:27.297752 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:27.297752 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:27.297752 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:27.297752 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:27.297752 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:27.297752 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:27.298724 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:27.298724 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:27.298724 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:27.298724 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:27.298724 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:27.298724 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:27.298724 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:27.298724 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:27.298724 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:27.298724 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:27.298724 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:27.298724 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:27.298724 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:27.298724 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:27.298724 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:27.298724 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:27.298724 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:27.298724 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:27.299696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:27.299696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:27.299696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:27.299696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:27.299696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:27.299696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:27.299696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:27.299696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:27.299696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 14:52:27.299696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:27.299696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 366/748] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:52:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:27.302570 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:27.302706 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d64811-56d9-494a-baf7-0ca2826e5d72 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:27.337286 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 383/749] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:52:26 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:52:27.338661 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4758c4d-255a-4eac-8b48-9bbb70cbbcd5 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:27.418071 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d64811-56d9-494a-baf7-0ca2826e5d72 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:27.443512 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:27.456897 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3365e67-be0b-49e5-9945-caec23824e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:27.457889 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3365e67-be0b-49e5-9945-caec23824e8e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:27.458246 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3365e67-be0b-49e5-9945-caec23824e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:27.458575 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3365e67-be0b-49e5-9945-caec23824e8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:27.471084 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3365e67-be0b-49e5-9945-caec23824e8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:27.472056 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4758c4d-255a-4eac-8b48-9bbb70cbbcd5 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:27.472808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3365e67-be0b-49e5-9945-caec23824e8e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:27.495570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-d3365e67-be0b-49e5-9945-caec23824e8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:27.495570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:27.495570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:27.495570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:27.495570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:27.495570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:27.495570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:27.495570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:27.495570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:27.495570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:27.495570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:27.495570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:27.495570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:27.495570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:27.495570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:27.496679 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:27.496679 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:27.496679 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:27.496679 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:27.496679 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:27.496679 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:27.496679 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:27.496679 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:27.496679 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:27.496679 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:27.496679 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:27.496679 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:27.496679 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:27.496679 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:27.496679 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:27.496679 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:27.496679 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:27.497778 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:27.497778 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:27.497778 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:27.497778 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:27.500156 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 367/750] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:27.501089 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3365e67-be0b-49e5-9945-caec23824e8e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:27.514690 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b042e6e-5b6f-4b33-a8dd-eb0551c109fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:27.515581 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b042e6e-5b6f-4b33-a8dd-eb0551c109fe None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:27.515995 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b042e6e-5b6f-4b33-a8dd-eb0551c109fe None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:27.516354 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b042e6e-5b6f-4b33-a8dd-eb0551c109fe None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:27.517513 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b042e6e-5b6f-4b33-a8dd-eb0551c109fe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:27.517793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b042e6e-5b6f-4b33-a8dd-eb0551c109fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:27.519551 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b042e6e-5b6f-4b33-a8dd-eb0551c109fe None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:27.542222 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 384/751] 10.222.0.24 () {56 vars in 1135 bytes} [Thu May 19 14:52:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:27.543432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b042e6e-5b6f-4b33-a8dd-eb0551c109fe None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:27.582354 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:27.617178 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3365e67-be0b-49e5-9945-caec23824e8e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:27.664510 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8264efc-51eb-4664-b2dc-bb9bb7e47c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:27.665027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b042e6e-5b6f-4b33-a8dd-eb0551c109fe None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:27.665312 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8264efc-51eb-4664-b2dc-bb9bb7e47c81 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:27.665599 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8264efc-51eb-4664-b2dc-bb9bb7e47c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:27.665877 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8264efc-51eb-4664-b2dc-bb9bb7e47c81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:27.680114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8264efc-51eb-4664-b2dc-bb9bb7e47c81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:27.681564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8264efc-51eb-4664-b2dc-bb9bb7e47c81 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:27.701247 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-f8264efc-51eb-4664-b2dc-bb9bb7e47c81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:27.701247 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:27.701247 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:27.701247 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:27.701247 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:27.701247 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:27.701247 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:27.701247 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:27.701247 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:27.701247 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:27.701247 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:27.701247 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:27.701247 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:27.701247 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:27.701247 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:27.702685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:27.702685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:27.702685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:27.702685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:27.702685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:27.702685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:27.702685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:27.702685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:27.702685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:27.702685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:27.702685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:27.702685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:27.702685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:27.702685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:27.702685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:27.702685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:27.702685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:27.703612 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:27.703612 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:27.703612 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:27.703612 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:27.703612 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 368/752] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:27.704495 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8264efc-51eb-4664-b2dc-bb9bb7e47c81 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:27.722914 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3afa0-932c-4093-a866-17673b6d57bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:27.724134 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3afa0-932c-4093-a866-17673b6d57bb None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:27.724667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3afa0-932c-4093-a866-17673b6d57bb None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:27.724952 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3afa0-932c-4093-a866-17673b6d57bb None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:27.725689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3afa0-932c-4093-a866-17673b6d57bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:27.726244 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3afa0-932c-4093-a866-17673b6d57bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:27.728034 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3afa0-932c-4093-a866-17673b6d57bb None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:27.736489 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:27.746778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 385/753] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:27.747693 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3afa0-932c-4093-a866-17673b6d57bb None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:27.832586 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8264efc-51eb-4664-b2dc-bb9bb7e47c81 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:27.863683 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:27.873850 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3afa0-932c-4093-a866-17673b6d57bb None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:27.874313 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3930b89-b247-4358-acfe-f71a723ef696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:27.874976 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3930b89-b247-4358-acfe-f71a723ef696 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:27.875286 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3930b89-b247-4358-acfe-f71a723ef696 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:27.876302 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3930b89-b247-4358-acfe-f71a723ef696 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:27.911512 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cf95c-8fb3-440f-b297-b985830711a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:27.912160 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cf95c-8fb3-440f-b297-b985830711a1 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:27.912549 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cf95c-8fb3-440f-b297-b985830711a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:27.915219 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cf95c-8fb3-440f-b297-b985830711a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:27.915219 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cf95c-8fb3-440f-b297-b985830711a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:27.915219 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cf95c-8fb3-440f-b297-b985830711a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:27.915706 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cf95c-8fb3-440f-b297-b985830711a1 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:27.928902 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 386/754] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:27.929831 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cf95c-8fb3-440f-b297-b985830711a1 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:27.949200 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3930b89-b247-4358-acfe-f71a723ef696 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:27.950793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3930b89-b247-4358-acfe-f71a723ef696 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:27.980140 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:28.039078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cf95c-8fb3-440f-b297-b985830711a1 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:28.060524 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 369/755] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:52:27 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:52:28.061511 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3930b89-b247-4358-acfe-f71a723ef696 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:28.075231 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08c1df-3b58-46c0-a7ea-b8471583b5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:28.076121 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08c1df-3b58-46c0-a7ea-b8471583b5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:28.076564 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08c1df-3b58-46c0-a7ea-b8471583b5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:28.076873 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08c1df-3b58-46c0-a7ea-b8471583b5c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:28.084182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f08c1df-3b58-46c0-a7ea-b8471583b5c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:28.085550 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f08c1df-3b58-46c0-a7ea-b8471583b5c4 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:28.100486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-0f08c1df-3b58-46c0-a7ea-b8471583b5c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:28.100486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:28.100486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:28.100486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:28.100486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:28.100486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:28.100486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:28.100486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:28.100486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:28.100486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:28.100486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:28.100486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:28.100486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:28.100486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:28.100486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:28.102480 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:28.102480 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:28.102480 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:28.102480 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:28.102480 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:28.102480 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:28.102480 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:28.102480 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:28.102480 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:28.102480 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:28.102480 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:28.102480 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:28.102480 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:28.102480 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:28.102480 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:28.102480 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:28.102480 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:28.104769 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:28.104769 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:28.104769 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:28.104769 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:28.104769 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:28.104769 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:28.104769 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:28.104769 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:28.110331 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 387/756] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:28.110331 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08c1df-3b58-46c0-a7ea-b8471583b5c4 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:28.126064 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:28.166891 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3930b89-b247-4358-acfe-f71a723ef696 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:28.195270 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:28.205433 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb56c0e-88f6-4c53-a48c-88d3aeee4302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:28.206597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb56c0e-88f6-4c53-a48c-88d3aeee4302 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:28.207111 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb56c0e-88f6-4c53-a48c-88d3aeee4302 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:28.207556 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb56c0e-88f6-4c53-a48c-88d3aeee4302 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:28.214912 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb56c0e-88f6-4c53-a48c-88d3aeee4302 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:28.215704 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08c1df-3b58-46c0-a7ea-b8471583b5c4 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:28.216706 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb56c0e-88f6-4c53-a48c-88d3aeee4302 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:28.231935 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-7fb56c0e-88f6-4c53-a48c-88d3aeee4302 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:28.231935 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:28.231935 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:28.231935 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:28.231935 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:28.231935 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:28.231935 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:28.231935 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:28.231935 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:28.231935 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:28.231935 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:28.231935 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:28.231935 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:28.231935 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:28.231935 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:28.232841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:28.232841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:28.232841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:28.232841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:28.232841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:28.232841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:28.232841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:28.232841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:28.232841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:28.232841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:28.232841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:28.232841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:28.232841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:28.232841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:28.232841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:28.232841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:28.232841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:28.234295 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:28.234295 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:28.234295 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:28.234295 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:28.234295 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:28.234295 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:28.234295 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:28.234295 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:28.236884 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 370/757] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:28.237842 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb56c0e-88f6-4c53-a48c-88d3aeee4302 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:28.251830 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae22762-11bf-4a2a-9d47-f4f605a6e7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:28.252416 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae22762-11bf-4a2a-9d47-f4f605a6e7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:28.252701 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae22762-11bf-4a2a-9d47-f4f605a6e7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:28.252979 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae22762-11bf-4a2a-9d47-f4f605a6e7c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:28.265163 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae22762-11bf-4a2a-9d47-f4f605a6e7c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:28.266993 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae22762-11bf-4a2a-9d47-f4f605a6e7c0 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:28.286533 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-bae22762-11bf-4a2a-9d47-f4f605a6e7c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:28.286533 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:28.286533 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:28.286533 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:28.286533 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:28.286533 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:28.286533 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:28.286533 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:28.286533 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:28.286533 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:28.286533 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:28.286533 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:28.286533 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:28.286533 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:28.286533 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:28.287537 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:28.287537 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:28.287537 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:28.287537 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:28.287537 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:28.287537 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:28.287537 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:28.287537 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:28.287537 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:28.287537 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:28.287537 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:28.287537 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:28.287537 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:28.287537 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:28.287537 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:28.287537 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:28.287537 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:28.288439 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:28.288439 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:28.288439 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:28.288439 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:28.288439 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 388/758] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:28.288870 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae22762-11bf-4a2a-9d47-f4f605a6e7c0 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:28.352715 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb56c0e-88f6-4c53-a48c-88d3aeee4302 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:28.355153 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:28.392631 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2489c86-a804-4b3b-86d5-15266b908b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:28.393749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2489c86-a804-4b3b-86d5-15266b908b41 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:28.394246 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2489c86-a804-4b3b-86d5-15266b908b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:28.394666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2489c86-a804-4b3b-86d5-15266b908b41 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:28.395664 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2489c86-a804-4b3b-86d5-15266b908b41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:28.396156 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2489c86-a804-4b3b-86d5-15266b908b41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:28.396806 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae22762-11bf-4a2a-9d47-f4f605a6e7c0 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:28.397992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2489c86-a804-4b3b-86d5-15266b908b41 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:28.412420 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 371/759] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:52:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:28.413546 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2489c86-a804-4b3b-86d5-15266b908b41 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:28.437508 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a61c5b-db35-4c55-b8c6-b721e8bb2511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:28.438174 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a61c5b-db35-4c55-b8c6-b721e8bb2511 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:28.438453 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a61c5b-db35-4c55-b8c6-b721e8bb2511 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:28.438723 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a61c5b-db35-4c55-b8c6-b721e8bb2511 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:28.439569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a61c5b-db35-4c55-b8c6-b721e8bb2511 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:28.439857 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a61c5b-db35-4c55-b8c6-b721e8bb2511 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:28.441428 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a61c5b-db35-4c55-b8c6-b721e8bb2511 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:28.455384 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 389/760] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:52:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:28.456192 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a61c5b-db35-4c55-b8c6-b721e8bb2511 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:28.466507 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:28.524783 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2489c86-a804-4b3b-86d5-15266b908b41 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:28.561875 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80374d57-4253-4557-8c12-674d08340bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:28.562240 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a61c5b-db35-4c55-b8c6-b721e8bb2511 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:28.563155 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80374d57-4253-4557-8c12-674d08340bcf None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:28.563862 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80374d57-4253-4557-8c12-674d08340bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:28.564442 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80374d57-4253-4557-8c12-674d08340bcf None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:28.565365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80374d57-4253-4557-8c12-674d08340bcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:28.565907 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80374d57-4253-4557-8c12-674d08340bcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:28.567502 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80374d57-4253-4557-8c12-674d08340bcf None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:28.580755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 372/761] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:28.581951 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80374d57-4253-4557-8c12-674d08340bcf None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:28.587611 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:28.599479 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a67b1e-c2a9-446a-855c-b9691180066f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:28.600367 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a67b1e-c2a9-446a-855c-b9691180066f None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:28.600644 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a67b1e-c2a9-446a-855c-b9691180066f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:28.600917 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a67b1e-c2a9-446a-855c-b9691180066f None admin] PATH_INFO: `/v3/projects/2633b53c336145bba3d4744dbdfe99b7/users/06fb8bb5aeb143ad95f33c3b43dbd346/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:28.603111 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a67b1e-c2a9-446a-855c-b9691180066f None admin] RBAC: Authorizing `identity:create_grant(project_id=2633b53c336145bba3d4744dbdfe99b7, user_id=06fb8bb5aeb143ad95f33c3b43dbd346, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:28.604491 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a67b1e-c2a9-446a-855c-b9691180066f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:28.627552 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 390/762] 10.222.0.24 () {58 vars in 1439 bytes} [Thu May 19 14:52:28 2022] PUT /identity/v3/projects/2633b53c336145bba3d4744dbdfe99b7/users/06fb8bb5aeb143ad95f33c3b43dbd346/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:52:28.628671 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a67b1e-c2a9-446a-855c-b9691180066f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:28.697673 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80374d57-4253-4557-8c12-674d08340bcf None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:28.708983 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:28.744455 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e9eab-1dbe-485f-971a-23f23fb108a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:28.745837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e9eab-1dbe-485f-971a-23f23fb108a9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:28.746474 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e9eab-1dbe-485f-971a-23f23fb108a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:28.746952 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e9eab-1dbe-485f-971a-23f23fb108a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:28.748111 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e9eab-1dbe-485f-971a-23f23fb108a9 None admin] RBAC: Adding query filter params (role.id=4d4ff927beb7409996558ecf7143d419, scope.project.id=2633b53c336145bba3d4744dbdfe99b7, user.id=fcd1725924134616b903b3e374d45817) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:28.749206 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e9eab-1dbe-485f-971a-23f23fb108a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:28.751062 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e9eab-1dbe-485f-971a-23f23fb108a9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:28.757656 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 373/763] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:52:28 2022] GET /identity/v3/role_assignments?user.id=fcd1725924134616b903b3e374d45817&scope.project.id=2633b53c336145bba3d4744dbdfe99b7&role.id=4d4ff927beb7409996558ecf7143d419 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:28.810151 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a67b1e-c2a9-446a-855c-b9691180066f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:28.854823 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb6eec-d59a-4534-8358-3fd2bf66d105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:28.856749 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb6eec-d59a-4534-8358-3fd2bf66d105 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:28.857532 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb6eec-d59a-4534-8358-3fd2bf66d105 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:28.858852 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb6eec-d59a-4534-8358-3fd2bf66d105 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:28.868077 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb6eec-d59a-4534-8358-3fd2bf66d105 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:28.869976 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb6eec-d59a-4534-8358-3fd2bf66d105 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:28.886704 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-e5bb6eec-d59a-4534-8358-3fd2bf66d105 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:28.886704 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:28.886704 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:28.886704 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:28.886704 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:28.886704 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:28.886704 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:28.886704 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:28.886704 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:28.886704 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:28.886704 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:28.886704 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:28.886704 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:28.886704 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:28.886704 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:28.887739 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:28.887739 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:28.887739 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:28.887739 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:28.887739 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:28.887739 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:28.887739 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:28.887739 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:28.887739 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:28.887739 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:28.887739 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:28.887739 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:28.887739 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:28.887739 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:28.887739 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:28.887739 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:28.887739 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:28.888647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:28.888647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:28.888647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:28.888647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:28.888647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:28.888647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:28.888647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:28.888647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:28.891974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 391/764] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:28.897552 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e9eab-1dbe-485f-971a-23f23fb108a9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:29.017614 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e9eab-1dbe-485f-971a-23f23fb108a9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:29.053310 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d643d3-85cd-4f54-9f91-cb61dbd66467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:29.054347 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d643d3-85cd-4f54-9f91-cb61dbd66467 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:29.054867 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d643d3-85cd-4f54-9f91-cb61dbd66467 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:29.055452 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d643d3-85cd-4f54-9f91-cb61dbd66467 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:29.056504 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d643d3-85cd-4f54-9f91-cb61dbd66467 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:29.057018 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d643d3-85cd-4f54-9f91-cb61dbd66467 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:29.059364 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d643d3-85cd-4f54-9f91-cb61dbd66467 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:29.073300 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 374/765] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:52:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:29.075918 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86230b-9f2a-45ea-9f6d-f033bc5422a3 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:29.077343 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86230b-9f2a-45ea-9f6d-f033bc5422a3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:29.077835 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86230b-9f2a-45ea-9f6d-f033bc5422a3 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:29.079382 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d643d3-85cd-4f54-9f91-cb61dbd66467 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:29.080001 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 392/766] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:29.090027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c680ab-4b95-455d-b79a-8f038f426a7a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:29.090027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c680ab-4b95-455d-b79a-8f038f426a7a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:29.090027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c680ab-4b95-455d-b79a-8f038f426a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:29.115349 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f7c680ab-4b95-455d-b79a-8f038f426a7a None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:29.116474 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f7c680ab-4b95-455d-b79a-8f038f426a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:29.135913 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:29.215879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:29.224989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d643d3-85cd-4f54-9f91-cb61dbd66467 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:29.271069 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 393/767] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:52:29.288221 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d58d0-27bb-4a19-bbef-25c25c821969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:29.288885 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d58d0-27bb-4a19-bbef-25c25c821969 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:29.289168 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d58d0-27bb-4a19-bbef-25c25c821969 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:29.289446 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d58d0-27bb-4a19-bbef-25c25c821969 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:29.290338 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d58d0-27bb-4a19-bbef-25c25c821969 None admin] RBAC: Adding query filter params (role.id=ec4b73b709ca4cdc983e35e955aed57a, scope.project.id=2633b53c336145bba3d4744dbdfe99b7, user.id=8ecbeee0c1cf4c58be6c22aa11d7ff5a) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:29.290655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d58d0-27bb-4a19-bbef-25c25c821969 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:29.292238 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d58d0-27bb-4a19-bbef-25c25c821969 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:29.306114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 375/768] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:52:29 2022] GET /identity/v3/role_assignments?user.id=8ecbeee0c1cf4c58be6c22aa11d7ff5a&scope.project.id=2633b53c336145bba3d4744dbdfe99b7&role.id=ec4b73b709ca4cdc983e35e955aed57a => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:29.308752 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c680ab-4b95-455d-b79a-8f038f426a7a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:29.427986 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c680ab-4b95-455d-b79a-8f038f426a7a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:29.466623 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb86249-a792-4939-8920-a5ed33c4f5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:29.468188 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb86249-a792-4939-8920-a5ed33c4f5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:29.468568 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb86249-a792-4939-8920-a5ed33c4f5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:29.468943 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb86249-a792-4939-8920-a5ed33c4f5a7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:29.469716 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb86249-a792-4939-8920-a5ed33c4f5a7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:29.471242 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb86249-a792-4939-8920-a5ed33c4f5a7 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:29.484639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-6eb86249-a792-4939-8920-a5ed33c4f5a7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:52:29.484639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:29.484639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:29.484639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:29.484639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:29.484639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:29.484639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:29.484639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:29.484639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:52:29.484639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:29.484639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:29.484639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:29.484639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:29.484639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:29.484639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:29.484639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:29.485643 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:29.485643 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:29.485643 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:29.485643 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:29.485643 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:29.485643 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:29.485643 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:29.485643 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:29.485643 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:29.485643 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:29.485643 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:29.485643 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:29.485643 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:29.485643 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:29.485643 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:29.485643 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:29.486471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:29.486471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:29.486471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:29.486471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:29.486471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:29.486471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:29.486471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:29.486471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:29.486471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:29.486471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:29.486471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:29.486471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:29.486471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:29.486471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:52:29.486471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:29.486471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 394/769] 10.222.0.24 () {56 vars in 1129 bytes} [Thu May 19 14:52:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:29.493409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d58d0-27bb-4a19-bbef-25c25c821969 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:29.607240 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:29.614672 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d58d0-27bb-4a19-bbef-25c25c821969 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:29.635766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32617045-857a-44bf-bbbf-fba218a91255 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:29.636168 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32617045-857a-44bf-bbbf-fba218a91255 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:29.636469 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32617045-857a-44bf-bbbf-fba218a91255 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:29.638308 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 395/770] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:29.644220 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec4304-964d-4ad3-a5cf-95d1898395a3 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:29.644741 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec4304-964d-4ad3-a5cf-95d1898395a3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:29.644900 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec4304-964d-4ad3-a5cf-95d1898395a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:29.663418 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-43ec4304-964d-4ad3-a5cf-95d1898395a3 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:29.664777 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-43ec4304-964d-4ad3-a5cf-95d1898395a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:29.670239 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac15712-1c2e-43d2-bf2a-09b9a0785f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:29.670956 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac15712-1c2e-43d2-bf2a-09b9a0785f56 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:29.671266 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac15712-1c2e-43d2-bf2a-09b9a0785f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:29.671551 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac15712-1c2e-43d2-bf2a-09b9a0785f56 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:29.672267 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac15712-1c2e-43d2-bf2a-09b9a0785f56 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:29.672578 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac15712-1c2e-43d2-bf2a-09b9a0785f56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:29.673965 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac15712-1c2e-43d2-bf2a-09b9a0785f56 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:29.683531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 376/771] 10.222.0.24 () {56 vars in 1124 bytes} [Thu May 19 14:52:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:29.689455 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac15712-1c2e-43d2-bf2a-09b9a0785f56 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:29.703599 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:29.761906 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 396/772] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:52:29.803902 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec4304-964d-4ad3-a5cf-95d1898395a3 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:29.856640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac15712-1c2e-43d2-bf2a-09b9a0785f56 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:29.909676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec4304-964d-4ad3-a5cf-95d1898395a3 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:29.945720 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099ebc4-4295-4d71-b392-9a68cf5c230b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:29.946436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099ebc4-4295-4d71-b392-9a68cf5c230b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:29.946717 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099ebc4-4295-4d71-b392-9a68cf5c230b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:29.946992 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099ebc4-4295-4d71-b392-9a68cf5c230b None admin] PATH_INFO: `/v3/services/network` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:29.947685 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1099ebc4-4295-4d71-b392-9a68cf5c230b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:29.949049 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1099ebc4-4295-4d71-b392-9a68cf5c230b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:29.960791 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-1099ebc4-4295-4d71-b392-9a68cf5c230b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:52:29.960791 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:29.960791 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:29.960791 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:29.960791 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:29.960791 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:29.960791 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:29.960791 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:29.960791 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:52:29.960791 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:29.960791 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:29.960791 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:29.960791 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:29.960791 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:29.960791 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:29.960791 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:29.960791 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:29.961750 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:29.961750 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:29.961750 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:29.961750 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:29.961750 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:29.961750 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:29.961750 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:29.961750 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:29.961750 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:29.961750 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:29.961750 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:29.961750 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:29.961750 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:29.961750 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:29.961750 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:29.961750 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:29.962569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:29.962569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:29.962569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:29.962569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:29.962569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:29.962569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:29.962569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:29.962569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:29.962569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:29.962569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:29.962569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:29.962569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:29.962569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:52:29.962569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:29.964458 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f618a2-0d6f-4e12-9efc-5fb5f847fcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:29.965139 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f618a2-0d6f-4e12-9efc-5fb5f847fcb7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:29.965424 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f618a2-0d6f-4e12-9efc-5fb5f847fcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:29.965766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f618a2-0d6f-4e12-9efc-5fb5f847fcb7 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:29.966485 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f618a2-0d6f-4e12-9efc-5fb5f847fcb7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:29.966796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f618a2-0d6f-4e12-9efc-5fb5f847fcb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:29.966962 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 397/773] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:29 2022] GET /identity/v3/services/network => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:29.968040 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099ebc4-4295-4d71-b392-9a68cf5c230b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:29.968220 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f618a2-0d6f-4e12-9efc-5fb5f847fcb7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:29.985619 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 377/774] 10.222.0.24 () {56 vars in 1124 bytes} [Thu May 19 14:52:29 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:29.992120 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f618a2-0d6f-4e12-9efc-5fb5f847fcb7 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:30.015065 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:30.040114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:30.078064 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099ebc4-4295-4d71-b392-9a68cf5c230b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:30.113853 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be92eb-976c-412b-8052-222f19b329bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:30.114523 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be92eb-976c-412b-8052-222f19b329bb None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:30.114860 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be92eb-976c-412b-8052-222f19b329bb None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:30.115145 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be92eb-976c-412b-8052-222f19b329bb None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:30.116006 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be92eb-976c-412b-8052-222f19b329bb None admin] RBAC: Adding query filter params (name=network) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:30.116419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be92eb-976c-412b-8052-222f19b329bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:30.117913 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be92eb-976c-412b-8052-222f19b329bb None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:30.127314 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f618a2-0d6f-4e12-9efc-5fb5f847fcb7 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:30.127586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 398/775] 10.222.0.24 () {56 vars in 1112 bytes} [Thu May 19 14:52:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:30.129862 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be92eb-976c-412b-8052-222f19b329bb None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:30.165137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fceb30-ac8d-488b-ad00-7613ca76fd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:30.165817 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fceb30-ac8d-488b-ad00-7613ca76fd38 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:30.166807 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fceb30-ac8d-488b-ad00-7613ca76fd38 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:30.167085 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fceb30-ac8d-488b-ad00-7613ca76fd38 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:30.167931 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fceb30-ac8d-488b-ad00-7613ca76fd38 None admin] RBAC: Adding query filter params (interface=public, service_id=70adbc05f5a94671bf955fb1fdae1790, region_id=RegionOne) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:30.168251 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fceb30-ac8d-488b-ad00-7613ca76fd38 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:30.169702 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fceb30-ac8d-488b-ad00-7613ca76fd38 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:30.192648 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 378/776] 10.222.0.24 () {56 vars in 1251 bytes} [Thu May 19 14:52:29 2022] GET /identity/v3/endpoints?service_id=70adbc05f5a94671bf955fb1fdae1790&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:30.199703 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fceb30-ac8d-488b-ad00-7613ca76fd38 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:30.296923 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be92eb-976c-412b-8052-222f19b329bb None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:30.331587 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:30.363000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e628bd1-1a0b-4dd5-87fb-9e3a33682101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:30.364082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e628bd1-1a0b-4dd5-87fb-9e3a33682101 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:30.364363 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e628bd1-1a0b-4dd5-87fb-9e3a33682101 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:30.364630 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e628bd1-1a0b-4dd5-87fb-9e3a33682101 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:30.365335 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e628bd1-1a0b-4dd5-87fb-9e3a33682101 None admin] RBAC: Adding query filter params (type=network) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:30.365635 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e628bd1-1a0b-4dd5-87fb-9e3a33682101 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:30.367553 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:30.372626 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e628bd1-1a0b-4dd5-87fb-9e3a33682101 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:30.383183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 399/777] 10.222.0.24 () {56 vars in 1112 bytes} [Thu May 19 14:52:30 2022] GET /identity/v3/services?type=network => generated 350 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:30.388271 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e628bd1-1a0b-4dd5-87fb-9e3a33682101 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:30.394388 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fceb30-ac8d-488b-ad00-7613ca76fd38 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:30.455239 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4641d7-7d66-40f6-b3e4-c48fa7c6b161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:30.455960 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4641d7-7d66-40f6-b3e4-c48fa7c6b161 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:30.456254 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4641d7-7d66-40f6-b3e4-c48fa7c6b161 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:30.456536 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4641d7-7d66-40f6-b3e4-c48fa7c6b161 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:30.457235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4641d7-7d66-40f6-b3e4-c48fa7c6b161 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:30.458750 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4641d7-7d66-40f6-b3e4-c48fa7c6b161 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:30.468704 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 379/778] 10.222.0.24 () {56 vars in 1087 bytes} [Thu May 19 14:52:30 2022] GET /identity/v3/services => generated 772 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:30.529167 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e628bd1-1a0b-4dd5-87fb-9e3a33682101 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:30.578122 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bb84a-ce20-45a2-8a71-31bec1294d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:30.578829 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bb84a-ce20-45a2-8a71-31bec1294d56 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:30.579114 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bb84a-ce20-45a2-8a71-31bec1294d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:30.579411 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bb84a-ce20-45a2-8a71-31bec1294d56 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:30.580213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654bb84a-ce20-45a2-8a71-31bec1294d56 None admin] RBAC: Adding query filter params (interface=public, service_id=d735f985327c4c4f9f1ce3b05d86fca8, region_id=RegionOne) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:30.580521 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654bb84a-ce20-45a2-8a71-31bec1294d56 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:30.581888 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654bb84a-ce20-45a2-8a71-31bec1294d56 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:30.592779 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 400/779] 10.222.0.24 () {56 vars in 1251 bytes} [Thu May 19 14:52:30 2022] GET /identity/v3/endpoints?service_id=d735f985327c4c4f9f1ce3b05d86fca8&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:30.598102 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4641d7-7d66-40f6-b3e4-c48fa7c6b161 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:30.722030 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4641d7-7d66-40f6-b3e4-c48fa7c6b161 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:30.767638 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd779b-269d-43a9-a681-c4da9a85fa03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:30.768333 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd779b-269d-43a9-a681-c4da9a85fa03 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:30.768620 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd779b-269d-43a9-a681-c4da9a85fa03 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:30.768954 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd779b-269d-43a9-a681-c4da9a85fa03 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:30.769655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd779b-269d-43a9-a681-c4da9a85fa03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:30.771040 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd779b-269d-43a9-a681-c4da9a85fa03 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:30.777203 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 380/780] 10.222.0.24 () {56 vars in 1087 bytes} [Thu May 19 14:52:30 2022] GET /identity/v3/services => generated 772 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:31.289414 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd20043-5723-4579-b993-e2a1d00edb95 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:31.289966 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd20043-5723-4579-b993-e2a1d00edb95 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:31.289966 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd20043-5723-4579-b993-e2a1d00edb95 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:31.291663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 401/781] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:31.296799 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a47ca-1aa1-4f6e-843b-3c2ba085e59d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:31.297237 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a47ca-1aa1-4f6e-843b-3c2ba085e59d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:31.297413 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a47ca-1aa1-4f6e-843b-3c2ba085e59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:31.318421 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9a8a47ca-1aa1-4f6e-843b-3c2ba085e59d None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:31.319717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9a8a47ca-1aa1-4f6e-843b-3c2ba085e59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:31.331189 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:31.412948 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 381/782] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:31.439696 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd20043-5723-4579-b993-e2a1d00edb95 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:31.458797 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff7f2c-65af-4d8c-89de-aaa510bc4a6d None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:31.459121 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff7f2c-65af-4d8c-89de-aaa510bc4a6d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:31.459394 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff7f2c-65af-4d8c-89de-aaa510bc4a6d None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:31.460889 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 382/783] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:52:31.465930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b5034-568e-4b17-87dd-3eee9ea29e56 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:31.466452 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b5034-568e-4b17-87dd-3eee9ea29e56 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:31.466923 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b5034-568e-4b17-87dd-3eee9ea29e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:31.484107 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:31.487804 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8a5b5034-568e-4b17-87dd-3eee9ea29e56 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:31.489069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8a5b5034-568e-4b17-87dd-3eee9ea29e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:31.611517 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 383/784] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:52:31.635738 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b5034-568e-4b17-87dd-3eee9ea29e56 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:31.644823 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd20043-5723-4579-b993-e2a1d00edb95 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:31.722370 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:31.736879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1472b3-ae12-4319-b8ec-104967b88a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:31.737974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1472b3-ae12-4319-b8ec-104967b88a55 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:31.737974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1472b3-ae12-4319-b8ec-104967b88a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:31.738215 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1472b3-ae12-4319-b8ec-104967b88a55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:31.753191 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b5034-568e-4b17-87dd-3eee9ea29e56 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:31.770314 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1472b3-ae12-4319-b8ec-104967b88a55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:31.778038 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-5e1472b3-ae12-4319-b8ec-104967b88a55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:52:31.778038 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:31.778038 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:31.778038 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:31.778038 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:31.778038 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:31.778038 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:31.778038 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:31.778038 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:31.778038 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:31.778038 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:31.778038 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:31.778038 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:31.778038 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:31.778038 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:31.778038 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:31.778957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:31.778957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:31.778957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:31.778957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:31.778957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:31.778957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:31.778957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:31.778957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:31.778957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:31.778957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:31.778957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:31.778957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:31.778957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:31.778957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:31.778957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:31.778957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:31.779904 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:31.779904 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:31.779904 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:31.779904 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:31.779904 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:31.779904 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:31.779904 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:31.779904 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:31.779904 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:31.779904 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:31.779904 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:52:31.779904 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:31.787678 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 402/785] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:52:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:31.797120 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1472b3-ae12-4319-b8ec-104967b88a55 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:31.799500 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ead975-c8b7-42ab-9d8a-4818614d8994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:31.800159 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ead975-c8b7-42ab-9d8a-4818614d8994 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:31.800443 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ead975-c8b7-42ab-9d8a-4818614d8994 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:31.800720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ead975-c8b7-42ab-9d8a-4818614d8994 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:31.827586 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ead975-c8b7-42ab-9d8a-4818614d8994 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:31.836878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-d8ead975-c8b7-42ab-9d8a-4818614d8994 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:31.836878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:31.836878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:31.836878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:31.836878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:31.836878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:31.836878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:31.836878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:31.836878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:31.836878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:31.836878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:31.836878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:31.836878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:31.836878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:31.836878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:31.836878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:31.837808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:31.837808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:31.837808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:31.837808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:31.837808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:31.837808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:31.837808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:31.837808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:31.837808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:31.837808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:31.837808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:31.837808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:31.837808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:31.837808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:31.837808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:31.837808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:31.838646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:31.838646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:31.838646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:31.838646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:31.838646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:31.838646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:31.838646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:31.838646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:31.838646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:31.838646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:31.838646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:31.838646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:31.838646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 384/786] 10.222.0.24 () {56 vars in 1102 bytes} [Thu May 19 14:52:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:31.846362 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ead975-c8b7-42ab-9d8a-4818614d8994 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:31.934030 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1472b3-ae12-4319-b8ec-104967b88a55 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:31.945062 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:31.976824 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1994c78-3251-4297-9c80-0c57454f1ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:31.978269 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1994c78-3251-4297-9c80-0c57454f1ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:31.978759 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1994c78-3251-4297-9c80-0c57454f1ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:31.979362 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1994c78-3251-4297-9c80-0c57454f1ae6 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:31.980316 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1994c78-3251-4297-9c80-0c57454f1ae6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:31.980847 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1994c78-3251-4297-9c80-0c57454f1ae6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:31.982431 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1994c78-3251-4297-9c80-0c57454f1ae6 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:31.992370 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 403/787] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:52:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:32.000258 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1994c78-3251-4297-9c80-0c57454f1ae6 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:32.138461 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ead975-c8b7-42ab-9d8a-4818614d8994 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:32.145791 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1994c78-3251-4297-9c80-0c57454f1ae6 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:32.180571 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2752395-5fa8-4506-acd8-a6030c04c71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:32.181386 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28707269-63ba-4a79-8d9d-0b2da3e96f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:32.181939 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2752395-5fa8-4506-acd8-a6030c04c71c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:32.182062 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28707269-63ba-4a79-8d9d-0b2da3e96f04 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:32.182328 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28707269-63ba-4a79-8d9d-0b2da3e96f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:32.182609 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28707269-63ba-4a79-8d9d-0b2da3e96f04 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:32.182927 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2752395-5fa8-4506-acd8-a6030c04c71c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:32.183442 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28707269-63ba-4a79-8d9d-0b2da3e96f04 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:32.183560 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2752395-5fa8-4506-acd8-a6030c04c71c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:32.183750 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28707269-63ba-4a79-8d9d-0b2da3e96f04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:32.185238 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28707269-63ba-4a79-8d9d-0b2da3e96f04 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:32.187357 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:32.196729 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2752395-5fa8-4506-acd8-a6030c04c71c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:32.198597 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2752395-5fa8-4506-acd8-a6030c04c71c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:32.203309 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 385/788] 10.222.0.24 () {56 vars in 1103 bytes} [Thu May 19 14:52:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:32.203309 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfd020-c551-4e5b-864b-afdcdf76dfcd None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:32.203309 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfd020-c551-4e5b-864b-afdcdf76dfcd None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:32.203309 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfd020-c551-4e5b-864b-afdcdf76dfcd None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:32.203309 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 386/789] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:32.205372 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfd020-c551-4e5b-864b-afdcdf76dfcd None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:32.215742 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:32.230692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-c2752395-5fa8-4506-acd8-a6030c04c71c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:32.230692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:32.230692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:32.230692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:32.230692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:32.230692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:32.230692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:32.230692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:32.230692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:32.230692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:32.230692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:32.230692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:32.230692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:32.230692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:32.230692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:32.231866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:32.231866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:32.231866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:32.231866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:32.231866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:32.231866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:32.231866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:32.231866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:32.231866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:32.231866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:32.231866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:32.231866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:32.231866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:32.231866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:32.231866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:32.231866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:32.231866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:32.233505 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:32.233505 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:32.233505 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:32.233505 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:32.235584 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 404/790] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:32.236969 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccade1-8278-4d6f-a2d6-2a8605071263 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:32.237397 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccade1-8278-4d6f-a2d6-2a8605071263 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:32.237838 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccade1-8278-4d6f-a2d6-2a8605071263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:32.256533 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-4dccade1-8278-4d6f-a2d6-2a8605071263 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:32.257976 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4dccade1-8278-4d6f-a2d6-2a8605071263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:32.325221 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfd020-c551-4e5b-864b-afdcdf76dfcd None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:32.338706 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 405/791] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:32.340021 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccade1-8278-4d6f-a2d6-2a8605071263 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:32.389319 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5ed9e-edbb-456a-8a0d-326bf0bd1a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:32.390310 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5ed9e-edbb-456a-8a0d-326bf0bd1a35 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:32.390694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5ed9e-edbb-456a-8a0d-326bf0bd1a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:32.391069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5ed9e-edbb-456a-8a0d-326bf0bd1a35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:32.401991 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c5ed9e-edbb-456a-8a0d-326bf0bd1a35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:32.403673 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c5ed9e-edbb-456a-8a0d-326bf0bd1a35 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:32.424120 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-d3c5ed9e-edbb-456a-8a0d-326bf0bd1a35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:32.424120 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:32.424120 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:32.424120 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:32.424120 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:32.424120 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:32.424120 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:32.424120 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:32.424120 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:32.424120 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:32.424120 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:32.424120 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:32.424120 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:32.424120 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:32.424120 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:32.425218 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:32.425218 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:32.425218 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:32.425218 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:32.425218 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:32.425218 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:32.425218 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:32.425218 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:32.425218 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:32.425218 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:32.425218 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:32.425218 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:32.425218 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:32.425218 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:32.425218 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:32.425218 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:32.425218 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:32.426351 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:32.426351 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:32.426351 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:32.426351 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:32.432307 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 387/792] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:32.433378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5ed9e-edbb-456a-8a0d-326bf0bd1a35 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:32.455135 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccade1-8278-4d6f-a2d6-2a8605071263 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:32.488258 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:32.492788 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:32.504730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c544af7-bc0a-4dbb-9330-4042d632d237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:32.505413 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c544af7-bc0a-4dbb-9330-4042d632d237 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:32.505697 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c544af7-bc0a-4dbb-9330-4042d632d237 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:32.505978 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c544af7-bc0a-4dbb-9330-4042d632d237 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:32.507264 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c544af7-bc0a-4dbb-9330-4042d632d237 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:32.507712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c544af7-bc0a-4dbb-9330-4042d632d237 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:32.509135 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c544af7-bc0a-4dbb-9330-4042d632d237 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:32.528268 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 406/793] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:32.528268 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c544af7-bc0a-4dbb-9330-4042d632d237 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:32.554266 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5ed9e-edbb-456a-8a0d-326bf0bd1a35 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:32.590699 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715b9f0-5ce1-4752-a1b8-72c5917302a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:32.591834 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715b9f0-5ce1-4752-a1b8-72c5917302a6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:32.593180 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715b9f0-5ce1-4752-a1b8-72c5917302a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:32.593692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715b9f0-5ce1-4752-a1b8-72c5917302a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:32.604903 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715b9f0-5ce1-4752-a1b8-72c5917302a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:32.614639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-7715b9f0-5ce1-4752-a1b8-72c5917302a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:52:32.614639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:32.614639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:32.614639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:32.614639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:32.614639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:32.614639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:32.614639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:32.614639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:32.614639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:32.614639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:32.614639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:32.614639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:32.614639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:32.614639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:32.614639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:32.615597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:32.615597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:32.615597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:32.615597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:32.615597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:32.615597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:32.615597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:32.615597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:32.615597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:32.615597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:32.615597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:32.615597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:32.615597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:32.615597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:32.615597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:32.615597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:32.616424 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:32.616424 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:32.616424 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:32.616424 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:32.616424 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:32.616424 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:32.616424 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:32.616424 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:32.616424 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:32.616424 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:32.616424 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:52:32.616424 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:32.623743 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 388/794] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:52:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:32.624925 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715b9f0-5ce1-4752-a1b8-72c5917302a6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:32.643979 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c544af7-bc0a-4dbb-9330-4042d632d237 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:32.688648 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b02e3e-aa21-48b6-88c0-2a60778e6e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:32.689318 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b02e3e-aa21-48b6-88c0-2a60778e6e9b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:32.689601 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b02e3e-aa21-48b6-88c0-2a60778e6e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:32.689878 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b02e3e-aa21-48b6-88c0-2a60778e6e9b None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:32.690603 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b02e3e-aa21-48b6-88c0-2a60778e6e9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:32.690909 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b02e3e-aa21-48b6-88c0-2a60778e6e9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:32.693007 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b02e3e-aa21-48b6-88c0-2a60778e6e9b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:32.714109 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 407/795] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:32.714109 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b02e3e-aa21-48b6-88c0-2a60778e6e9b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:32.749814 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715b9f0-5ce1-4752-a1b8-72c5917302a6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:32.760348 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:32.778608 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:32.790959 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8cd51b-b141-4810-943a-6620ed4237f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:32.792167 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cd51b-b141-4810-943a-6620ed4237f8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:32.792677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cd51b-b141-4810-943a-6620ed4237f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:32.793259 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cd51b-b141-4810-943a-6620ed4237f8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:32.802521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8cd51b-b141-4810-943a-6620ed4237f8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:32.804464 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8cd51b-b141-4810-943a-6620ed4237f8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:32.820012 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-be8cd51b-b141-4810-943a-6620ed4237f8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:52:32.820012 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:32.820012 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:32.820012 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:32.820012 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:32.820012 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:32.820012 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:32.820012 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:32.820012 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:32.820012 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:32.820012 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:32.820012 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:32.820012 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:32.820012 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:32.820012 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:32.820012 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:32.821019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:32.821019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:32.821019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:32.821019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:32.821019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:32.821019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:32.821019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:32.821019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:32.821019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:32.821019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:32.821019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:32.821019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:32.821019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:32.821019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:32.821019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:32.821019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:32.821019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:32.821019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:32.821954 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:32.821954 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:32.821954 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:32.821954 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:32.821954 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:32.821954 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:32.821954 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:32.821954 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:32.821954 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:52:32.821954 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:32.829358 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 389/796] 10.222.0.24 () {56 vars in 1093 bytes} [Thu May 19 14:52:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:32.830594 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8cd51b-b141-4810-943a-6620ed4237f8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:32.836732 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b02e3e-aa21-48b6-88c0-2a60778e6e9b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:32.882791 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a44577-91d6-4b0c-a557-41ae3208f7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:32.883832 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a44577-91d6-4b0c-a557-41ae3208f7de None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:32.884311 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a44577-91d6-4b0c-a557-41ae3208f7de None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:32.884796 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a44577-91d6-4b0c-a557-41ae3208f7de None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:32.885750 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a44577-91d6-4b0c-a557-41ae3208f7de None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:32.886264 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a44577-91d6-4b0c-a557-41ae3208f7de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:32.887961 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a44577-91d6-4b0c-a557-41ae3208f7de None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:32.902249 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 408/797] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:52:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:32.903453 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a44577-91d6-4b0c-a557-41ae3208f7de None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:32.949247 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8cd51b-b141-4810-943a-6620ed4237f8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:32.993787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4de24-f3a2-4cb2-afb0-47da67aea7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:32.994555 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4de24-f3a2-4cb2-afb0-47da67aea7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:32.994842 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4de24-f3a2-4cb2-afb0-47da67aea7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:32.995561 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4de24-f3a2-4cb2-afb0-47da67aea7b6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:33.004761 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4de24-f3a2-4cb2-afb0-47da67aea7b6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:33.006244 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4de24-f3a2-4cb2-afb0-47da67aea7b6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:33.025975 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-bcd4de24-f3a2-4cb2-afb0-47da67aea7b6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:52:33.025975 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:33.025975 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:33.025975 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:33.025975 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:33.025975 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:33.025975 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:33.025975 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:33.025975 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:33.025975 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:33.025975 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:33.025975 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:33.025975 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:33.025975 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:33.025975 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:33.025975 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:33.026989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:33.026989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:33.026989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:33.026989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:33.026989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:33.026989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:33.026989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:33.026989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:33.026989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:33.026989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:33.026989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:33.026989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:33.026989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:33.026989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:33.026989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:33.026989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:33.026989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:33.026989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:33.027971 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:33.027971 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:33.027971 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:33.027971 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:33.027971 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:33.027971 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:33.027971 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:33.027971 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:33.027971 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:52:33.027971 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:33.031264 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 390/798] 10.222.0.24 () {56 vars in 1117 bytes} [Thu May 19 14:52:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:33.032305 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4de24-f3a2-4cb2-afb0-47da67aea7b6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:33.042980 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a44577-91d6-4b0c-a557-41ae3208f7de None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:33.060969 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:33.068181 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:33.100509 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396304f-aa36-46ad-8bf7-770aec3769dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:33.101565 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396304f-aa36-46ad-8bf7-770aec3769dd None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:33.102054 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396304f-aa36-46ad-8bf7-770aec3769dd None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:33.103044 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396304f-aa36-46ad-8bf7-770aec3769dd None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:33.104417 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3396304f-aa36-46ad-8bf7-770aec3769dd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:33.105095 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3396304f-aa36-46ad-8bf7-770aec3769dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:33.107382 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3396304f-aa36-46ad-8bf7-770aec3769dd None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:33.134497 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 409/799] 10.222.0.24 () {56 vars in 1133 bytes} [Thu May 19 14:52:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:33.134497 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396304f-aa36-46ad-8bf7-770aec3769dd None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:33.162592 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4de24-f3a2-4cb2-afb0-47da67aea7b6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:33.215518 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e59caf-1caa-441e-905e-ec73a13b0f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:33.216340 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e59caf-1caa-441e-905e-ec73a13b0f49 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:33.216628 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e59caf-1caa-441e-905e-ec73a13b0f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:33.216906 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e59caf-1caa-441e-905e-ec73a13b0f49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:33.236565 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e59caf-1caa-441e-905e-ec73a13b0f49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:33.238443 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e59caf-1caa-441e-905e-ec73a13b0f49 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:33.266129 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-f6e59caf-1caa-441e-905e-ec73a13b0f49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:33.266129 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:33.266129 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:33.266129 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:33.266129 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:33.266129 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:33.266129 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:33.266129 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:33.266129 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:33.266129 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:33.266129 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:33.266129 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:33.266129 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:33.266129 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:33.266129 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:33.267054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:33.267054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:33.267054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:33.267054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:33.267054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:33.267054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:33.267054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:33.267054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:33.267054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:33.267054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:33.267054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:33.267054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:33.267054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:33.267054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:33.267054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:33.267054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:33.267054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:33.267976 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:33.267976 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:33.267976 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:33.267976 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:33.268206 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396304f-aa36-46ad-8bf7-770aec3769dd None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:33.276330 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 391/800] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:33.277466 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e59caf-1caa-441e-905e-ec73a13b0f49 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:33.303813 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1700f8e-9507-48b5-8e12-086c0330fd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:33.304486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1700f8e-9507-48b5-8e12-086c0330fd82 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:33.304767 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1700f8e-9507-48b5-8e12-086c0330fd82 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:33.305038 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1700f8e-9507-48b5-8e12-086c0330fd82 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:33.305877 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1700f8e-9507-48b5-8e12-086c0330fd82 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:33.306186 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1700f8e-9507-48b5-8e12-086c0330fd82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:33.307696 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1700f8e-9507-48b5-8e12-086c0330fd82 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:33.337857 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 410/801] 10.222.0.24 () {56 vars in 1149 bytes} [Thu May 19 14:52:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:33.338665 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1700f8e-9507-48b5-8e12-086c0330fd82 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:33.367861 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:33.394885 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:33.417606 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e59caf-1caa-441e-905e-ec73a13b0f49 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:33.449594 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1700f8e-9507-48b5-8e12-086c0330fd82 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:33.452052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec8fd5-a8d7-4e9e-85f9-5e21cfb61ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:33.452713 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec8fd5-a8d7-4e9e-85f9-5e21cfb61ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:33.453003 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec8fd5-a8d7-4e9e-85f9-5e21cfb61ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:33.453283 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec8fd5-a8d7-4e9e-85f9-5e21cfb61ef8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:33.483141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ba900-91f7-4bca-916f-a887782ac9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:33.483816 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ba900-91f7-4bca-916f-a887782ac9ee None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:33.484095 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ba900-91f7-4bca-916f-a887782ac9ee None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:33.484365 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ba900-91f7-4bca-916f-a887782ac9ee None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:33.485072 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ba900-91f7-4bca-916f-a887782ac9ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:33.485373 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ba900-91f7-4bca-916f-a887782ac9ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:33.486724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ba900-91f7-4bca-916f-a887782ac9ee None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:33.497794 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 411/802] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:33.499054 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ba900-91f7-4bca-916f-a887782ac9ee None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:33.519925 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec8fd5-a8d7-4e9e-85f9-5e21cfb61ef8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:33.521319 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec8fd5-a8d7-4e9e-85f9-5e21cfb61ef8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:33.581576 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:33.596700 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ba900-91f7-4bca-916f-a887782ac9ee None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:33.597797 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:33.617501 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 392/803] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:52:33 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:52:33.618875 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693d68a-51ed-4928-9391-8f933df3f649 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:33.619215 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693d68a-51ed-4928-9391-8f933df3f649 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:33.619468 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693d68a-51ed-4928-9391-8f933df3f649 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:33.620986 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 393/804] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:33.622260 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b559b3-6577-4868-b12b-6866ae4f5938 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:33.622481 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b559b3-6577-4868-b12b-6866ae4f5938 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:33.622766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b559b3-6577-4868-b12b-6866ae4f5938 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:33.624633 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 394/805] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:33.627443 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b559b3-6577-4868-b12b-6866ae4f5938 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:33.635959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83330683-0f71-44f7-a166-9930f2ad1fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:33.636747 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83330683-0f71-44f7-a166-9930f2ad1fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:33.637026 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83330683-0f71-44f7-a166-9930f2ad1fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:33.637306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83330683-0f71-44f7-a166-9930f2ad1fc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:33.648447 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83330683-0f71-44f7-a166-9930f2ad1fc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:33.649886 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83330683-0f71-44f7-a166-9930f2ad1fc9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:33.666432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-83330683-0f71-44f7-a166-9930f2ad1fc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:33.666432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:33.666432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:33.666432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:33.666432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:33.666432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:33.666432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:33.666432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:33.666432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:33.666432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:33.666432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:33.666432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:33.666432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:33.666432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:33.666432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:33.667413 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:33.667413 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:33.667413 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:33.667413 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:33.667413 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:33.667413 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:33.667413 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:33.667413 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:33.667413 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:33.667413 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:33.667413 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:33.667413 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:33.667413 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:33.667413 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:33.667413 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:33.667413 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:33.667413 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:33.668302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:33.668302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:33.668302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:33.668302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:33.668302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 412/806] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:33.668836 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83330683-0f71-44f7-a166-9930f2ad1fc9 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:33.729205 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b559b3-6577-4868-b12b-6866ae4f5938 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:33.764524 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44749059-3151-4d20-88a8-e78a33e9626b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:33.765325 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44749059-3151-4d20-88a8-e78a33e9626b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:33.765669 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44749059-3151-4d20-88a8-e78a33e9626b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:33.765950 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44749059-3151-4d20-88a8-e78a33e9626b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:33.773106 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44749059-3151-4d20-88a8-e78a33e9626b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:33.774475 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44749059-3151-4d20-88a8-e78a33e9626b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:33.776934 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83330683-0f71-44f7-a166-9930f2ad1fc9 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:33.788363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-44749059-3151-4d20-88a8-e78a33e9626b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 14:52:33.788363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:33.788363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:33.788363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:33.788363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:33.788363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:33.788363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:33.788363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:33.788363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:33.788363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:33.788363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:33.788363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:33.788363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:33.788363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:33.788363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:33.788363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:33.789372 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:33.789372 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:33.789372 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:33.789372 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:33.789372 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:33.789372 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:33.789372 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:33.789372 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:33.789372 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:33.789372 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:33.789372 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:33.789372 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:33.789372 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:33.789372 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:33.789372 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:33.789372 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:33.789372 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:33.789372 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:33.790296 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:33.790296 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:33.790296 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:33.790296 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:33.790296 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:33.790296 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:33.790296 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:33.790296 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:33.790296 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 14:52:33.790296 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:33.790296 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 395/807] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:52:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:33.790876 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896a573-d025-4f2e-b2d3-56ab91cb18e8 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:33.790942 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896a573-d025-4f2e-b2d3-56ab91cb18e8 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:33.791187 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896a573-d025-4f2e-b2d3-56ab91cb18e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:33.807574 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7896a573-d025-4f2e-b2d3-56ab91cb18e8 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:33.808742 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7896a573-d025-4f2e-b2d3-56ab91cb18e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:33.813307 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84188b-5a92-4ccb-8492-2ea78e24810d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:33.814098 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84188b-5a92-4ccb-8492-2ea78e24810d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:33.814382 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84188b-5a92-4ccb-8492-2ea78e24810d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:33.814660 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84188b-5a92-4ccb-8492-2ea78e24810d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:33.821672 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:33.825672 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d84188b-5a92-4ccb-8492-2ea78e24810d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:33.827684 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d84188b-5a92-4ccb-8492-2ea78e24810d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:33.842744 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:33.846295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-7d84188b-5a92-4ccb-8492-2ea78e24810d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:33.846295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:33.846295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:33.846295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:33.846295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:33.846295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:33.846295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:33.846295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:33.846295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:33.846295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:33.846295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:33.846295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:33.846295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:33.846295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:33.846295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:33.847179 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:33.847179 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:33.847179 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:33.847179 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:33.847179 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:33.847179 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:33.847179 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:33.847179 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:33.847179 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:33.847179 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:33.847179 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:33.847179 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:33.847179 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:33.847179 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:33.847179 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:33.847179 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:33.847179 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:33.848144 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:33.848144 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:33.848144 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:33.848144 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:33.848144 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 413/808] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:33.848787 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e13f4-7a78-48bd-8d70-cf4dda8a4bee None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:33.849067 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e13f4-7a78-48bd-8d70-cf4dda8a4bee None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:33.849592 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e13f4-7a78-48bd-8d70-cf4dda8a4bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:33.867721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-8c8e13f4-7a78-48bd-8d70-cf4dda8a4bee None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:33.868908 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8c8e13f4-7a78-48bd-8d70-cf4dda8a4bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:33.877207 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 396/809] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:33.878031 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896a573-d025-4f2e-b2d3-56ab91cb18e8 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:33.935363 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 414/810] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:33.936747 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e13f4-7a78-48bd-8d70-cf4dda8a4bee None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:33.987327 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896a573-d025-4f2e-b2d3-56ab91cb18e8 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:34.021852 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4c189-3edb-4ec8-b8b8-c62c27b780ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:34.022513 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4c189-3edb-4ec8-b8b8-c62c27b780ce None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:34.022796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4c189-3edb-4ec8-b8b8-c62c27b780ce None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:34.023080 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4c189-3edb-4ec8-b8b8-c62c27b780ce None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:34.023878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4c189-3edb-4ec8-b8b8-c62c27b780ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:34.024133 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4c189-3edb-4ec8-b8b8-c62c27b780ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:34.025529 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4c189-3edb-4ec8-b8b8-c62c27b780ce None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:34.031823 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e13f4-7a78-48bd-8d70-cf4dda8a4bee None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:34.037506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 397/811] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:34.038291 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4c189-3edb-4ec8-b8b8-c62c27b780ce None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:34.054090 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:34.067935 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc12525-dbfe-4226-a839-4f18e6e31d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:34.068591 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc12525-dbfe-4226-a839-4f18e6e31d06 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:34.068877 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc12525-dbfe-4226-a839-4f18e6e31d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:34.069075 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:34.069201 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc12525-dbfe-4226-a839-4f18e6e31d06 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:34.069971 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc12525-dbfe-4226-a839-4f18e6e31d06 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:34.070275 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc12525-dbfe-4226-a839-4f18e6e31d06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:34.071919 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc12525-dbfe-4226-a839-4f18e6e31d06 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:34.088802 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 415/812] 10.222.0.24 () {56 vars in 1135 bytes} [Thu May 19 14:52:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:34.089669 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc12525-dbfe-4226-a839-4f18e6e31d06 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:34.144752 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4c189-3edb-4ec8-b8b8-c62c27b780ce None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:34.178593 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a4930-b0fc-46e6-97d4-27c585ced6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:34.179281 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a4930-b0fc-46e6-97d4-27c585ced6c6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:34.179567 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a4930-b0fc-46e6-97d4-27c585ced6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:34.179848 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a4930-b0fc-46e6-97d4-27c585ced6c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:34.180561 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a4930-b0fc-46e6-97d4-27c585ced6c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:34.180871 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a4930-b0fc-46e6-97d4-27c585ced6c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:34.182239 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a4930-b0fc-46e6-97d4-27c585ced6c6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:34.187647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc12525-dbfe-4226-a839-4f18e6e31d06 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:34.194029 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 398/813] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:34.194823 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a4930-b0fc-46e6-97d4-27c585ced6c6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:34.224643 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac28953-f9fc-4419-9a1e-0cc4777d4e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:34.225452 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac28953-f9fc-4419-9a1e-0cc4777d4e67 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:34.225738 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac28953-f9fc-4419-9a1e-0cc4777d4e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:34.226016 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac28953-f9fc-4419-9a1e-0cc4777d4e67 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:34.226665 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac28953-f9fc-4419-9a1e-0cc4777d4e67 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:34.228067 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac28953-f9fc-4419-9a1e-0cc4777d4e67 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:34.240028 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-eac28953-f9fc-4419-9a1e-0cc4777d4e67 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:52:34.240028 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:34.240028 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:34.240028 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:34.240028 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:34.240028 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:34.240028 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:34.240028 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:34.240028 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:52:34.240028 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:34.240028 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:34.240028 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:34.240028 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:34.240028 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:34.240028 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:34.240028 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:34.241045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:34.241045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:34.241045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:34.241045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:34.241045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:34.241045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:34.241045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:34.241045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:34.241045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:34.241045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:34.241045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:34.241045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:34.241045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:34.241045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:34.241045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:34.241045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:34.241886 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:34.241886 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:34.241886 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:34.241886 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:34.241886 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:34.241886 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:34.241886 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:34.241886 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:34.241886 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:34.241886 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:34.241886 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:34.241886 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:34.241886 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:34.241886 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 19 14:52:34.241886 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:34.241886 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 416/814] 10.222.0.24 () {56 vars in 1129 bytes} [Thu May 19 14:52:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:34.242739 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac28953-f9fc-4419-9a1e-0cc4777d4e67 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:34.285371 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:34.287168 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:34.297089 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a4930-b0fc-46e6-97d4-27c585ced6c6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:34.335189 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8bf39c-bdcf-487b-a525-33ef00023ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:34.336006 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bf39c-bdcf-487b-a525-33ef00023ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:34.336291 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bf39c-bdcf-487b-a525-33ef00023ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:34.336567 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bf39c-bdcf-487b-a525-33ef00023ae2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:34.337217 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8bf39c-bdcf-487b-a525-33ef00023ae2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:34.338575 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8bf39c-bdcf-487b-a525-33ef00023ae2 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:34.345343 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac28953-f9fc-4419-9a1e-0cc4777d4e67 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:34.349988 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-2f8bf39c-bdcf-487b-a525-33ef00023ae2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:52:34.349988 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:34.349988 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:34.349988 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:34.349988 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:34.349988 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:34.349988 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:34.349988 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:34.349988 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:52:34.349988 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:34.349988 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:34.349988 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:34.349988 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:34.349988 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:34.349988 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:34.349988 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:34.349988 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:34.351147 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:34.351147 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:34.351147 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:34.351147 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:34.351147 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:34.351147 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:34.351147 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:34.351147 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:34.351147 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:34.351147 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:34.351147 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:34.351147 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:34.351147 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:34.351147 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:34.351147 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:34.351147 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:34.356881 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:34.356881 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:34.356881 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:34.356881 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:34.356881 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:34.356881 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:34.356881 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:34.356881 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:34.356881 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:34.356881 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:34.356881 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:34.356881 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:34.356881 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 19 14:52:34.356881 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:34.356881 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 399/815] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:34 2022] GET /identity/v3/services/network => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:34.358225 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8bf39c-bdcf-487b-a525-33ef00023ae2 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:34.378851 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d555e-cd34-4832-a1b0-1a409f7dc0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:34.379667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d555e-cd34-4832-a1b0-1a409f7dc0d0 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:34.379948 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d555e-cd34-4832-a1b0-1a409f7dc0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:34.380222 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d555e-cd34-4832-a1b0-1a409f7dc0d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:34.387737 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d555e-cd34-4832-a1b0-1a409f7dc0d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:34.389197 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d555e-cd34-4832-a1b0-1a409f7dc0d0 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:34.403050 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-0f3d555e-cd34-4832-a1b0-1a409f7dc0d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:34.403050 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:34.403050 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:34.403050 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:34.403050 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:34.403050 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:34.403050 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:34.403050 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:34.403050 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:34.403050 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:34.403050 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:34.403050 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:34.403050 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:34.403050 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:34.403050 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:34.404047 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:34.404047 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:34.404047 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:34.404047 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:34.404047 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:34.404047 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:34.404047 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:34.404047 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:34.404047 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:34.404047 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:34.404047 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:34.404047 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:34.404047 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:34.404047 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:34.404047 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:34.404047 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:34.404047 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:34.404955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:34.404955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:34.404955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:34.404955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:34.404955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:34.404955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:34.404955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:34.404955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:34.404955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 417/816] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:34.405440 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d555e-cd34-4832-a1b0-1a409f7dc0d0 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:34.457702 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8bf39c-bdcf-487b-a525-33ef00023ae2 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:34.489822 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f2408-798f-45fa-b4e8-6358f7b7d1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:34.490600 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f2408-798f-45fa-b4e8-6358f7b7d1a7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:34.490882 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f2408-798f-45fa-b4e8-6358f7b7d1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:34.491152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f2408-798f-45fa-b4e8-6358f7b7d1a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:34.502260 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f2408-798f-45fa-b4e8-6358f7b7d1a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:34.503399 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d555e-cd34-4832-a1b0-1a409f7dc0d0 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:34.503731 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f2408-798f-45fa-b4e8-6358f7b7d1a7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:34.505035 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:34.520666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-4c1f2408-798f-45fa-b4e8-6358f7b7d1a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:34.520666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:34.520666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:34.520666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:34.520666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:34.520666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:34.520666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:34.520666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:34.520666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:34.520666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:34.520666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:34.520666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:34.520666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:34.520666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:34.520666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:34.521587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:34.521587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:34.521587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:34.521587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:34.521587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:34.521587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:34.521587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:34.521587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:34.521587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:34.521587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:34.521587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:34.521587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:34.521587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:34.521587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:34.521587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:34.521587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:34.521587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:34.522539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:34.522539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:34.522539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:34.522539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:34.523516 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 400/817] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:34.524755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f2408-798f-45fa-b4e8-6358f7b7d1a7 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:34.533772 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:34.537798 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2c4c9-3f90-4243-bbf8-bfacfb679725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:34.538534 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2c4c9-3f90-4243-bbf8-bfacfb679725 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:34.538817 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2c4c9-3f90-4243-bbf8-bfacfb679725 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:34.539088 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2c4c9-3f90-4243-bbf8-bfacfb679725 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:34.546163 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2c4c9-3f90-4243-bbf8-bfacfb679725 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:34.547640 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2c4c9-3f90-4243-bbf8-bfacfb679725 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:34.561667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-9bf2c4c9-3f90-4243-bbf8-bfacfb679725 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:34.561667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:34.561667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:34.561667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:34.561667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:34.561667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:34.561667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:34.561667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:34.561667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:34.561667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:34.561667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:34.561667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:34.561667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:34.561667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:34.561667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:34.562534 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:34.562534 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:34.562534 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:34.562534 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:34.562534 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:34.562534 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:34.562534 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:34.562534 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:34.562534 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:34.562534 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:34.562534 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:34.562534 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:34.562534 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:34.562534 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:34.562534 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:34.562534 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:34.562534 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:34.563675 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:34.563675 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:34.563675 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:34.563675 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:34.563675 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:34.563675 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:34.563675 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:34.563675 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:34.563675 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 418/818] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:34.563675 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2c4c9-3f90-4243-bbf8-bfacfb679725 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:34.622622 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f2408-798f-45fa-b4e8-6358f7b7d1a7 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:34.656253 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0804c-e8f7-44e8-b6f6-0ce261fb084c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:34.656923 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0804c-e8f7-44e8-b6f6-0ce261fb084c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:34.657211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0804c-e8f7-44e8-b6f6-0ce261fb084c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:34.657495 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0804c-e8f7-44e8-b6f6-0ce261fb084c None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:34.658201 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0804c-e8f7-44e8-b6f6-0ce261fb084c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:34.658514 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0804c-e8f7-44e8-b6f6-0ce261fb084c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:34.659280 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2c4c9-3f90-4243-bbf8-bfacfb679725 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:34.659923 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0804c-e8f7-44e8-b6f6-0ce261fb084c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:34.664508 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 401/819] 10.222.0.24 () {56 vars in 1124 bytes} [Thu May 19 14:52:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:34.665096 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0804c-e8f7-44e8-b6f6-0ce261fb084c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:34.695625 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c07f56-bc0f-48b7-b054-38184918bdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:34.696280 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c07f56-bc0f-48b7-b054-38184918bdc0 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:34.696564 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c07f56-bc0f-48b7-b054-38184918bdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:34.696837 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c07f56-bc0f-48b7-b054-38184918bdc0 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:34.697533 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c07f56-bc0f-48b7-b054-38184918bdc0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:34.697848 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c07f56-bc0f-48b7-b054-38184918bdc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:34.699182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c07f56-bc0f-48b7-b054-38184918bdc0 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:34.703705 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 419/820] 10.222.0.24 () {56 vars in 1112 bytes} [Thu May 19 14:52:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:34.704408 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c07f56-bc0f-48b7-b054-38184918bdc0 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:34.730332 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:34.737584 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:34.768543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0804c-e8f7-44e8-b6f6-0ce261fb084c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:34.803840 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c07f56-bc0f-48b7-b054-38184918bdc0 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:34.804449 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48e9a2-c1c8-4d38-a001-3af34da81198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:34.805126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48e9a2-c1c8-4d38-a001-3af34da81198 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:34.805414 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48e9a2-c1c8-4d38-a001-3af34da81198 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:34.805697 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48e9a2-c1c8-4d38-a001-3af34da81198 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:34.806493 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48e9a2-c1c8-4d38-a001-3af34da81198 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:34.806808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48e9a2-c1c8-4d38-a001-3af34da81198 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:34.808294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48e9a2-c1c8-4d38-a001-3af34da81198 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:34.820357 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 402/821] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:52:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:34.821155 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48e9a2-c1c8-4d38-a001-3af34da81198 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:34.839017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14c555-1378-49b5-863c-92e35ceabcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:34.839703 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14c555-1378-49b5-863c-92e35ceabcee None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:34.839982 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14c555-1378-49b5-863c-92e35ceabcee None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:34.840251 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14c555-1378-49b5-863c-92e35ceabcee None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:34.840959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14c555-1378-49b5-863c-92e35ceabcee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:34.841261 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14c555-1378-49b5-863c-92e35ceabcee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:34.843326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14c555-1378-49b5-863c-92e35ceabcee None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:34.855963 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 420/822] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:34.856769 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14c555-1378-49b5-863c-92e35ceabcee None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:34.924264 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48e9a2-c1c8-4d38-a001-3af34da81198 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:34.939045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:34.952459 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:34.953524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14c555-1378-49b5-863c-92e35ceabcee None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:34.958744 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056e299-61ac-4e18-b98d-3a3133549e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:34.959507 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056e299-61ac-4e18-b98d-3a3133549e3a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:34.959790 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056e299-61ac-4e18-b98d-3a3133549e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:34.960064 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056e299-61ac-4e18-b98d-3a3133549e3a None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:34.960842 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056e299-61ac-4e18-b98d-3a3133549e3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:34.961153 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056e299-61ac-4e18-b98d-3a3133549e3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:34.962579 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056e299-61ac-4e18-b98d-3a3133549e3a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:34.974136 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 403/823] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:52:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:34.974912 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056e299-61ac-4e18-b98d-3a3133549e3a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:34.988178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d04d3-31bb-403c-8a96-29f24da5b764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:34.988838 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d04d3-31bb-403c-8a96-29f24da5b764 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:34.989126 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d04d3-31bb-403c-8a96-29f24da5b764 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:34.989401 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d04d3-31bb-403c-8a96-29f24da5b764 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:34.990107 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d04d3-31bb-403c-8a96-29f24da5b764 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:34.990412 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d04d3-31bb-403c-8a96-29f24da5b764 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:34.991872 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d04d3-31bb-403c-8a96-29f24da5b764 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:34.996818 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 421/824] 10.222.0.24 () {56 vars in 1124 bytes} [Thu May 19 14:52:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:34.997596 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d04d3-31bb-403c-8a96-29f24da5b764 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:35.077381 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056e299-61ac-4e18-b98d-3a3133549e3a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:35.095462 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d04d3-31bb-403c-8a96-29f24da5b764 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:35.112437 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d243c8-944e-4ea8-824a-5f6f3c5bdc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:35.113147 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d243c8-944e-4ea8-824a-5f6f3c5bdc74 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:35.113447 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d243c8-944e-4ea8-824a-5f6f3c5bdc74 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:35.113730 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d243c8-944e-4ea8-824a-5f6f3c5bdc74 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:35.114444 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d243c8-944e-4ea8-824a-5f6f3c5bdc74 None admin] RBAC: Adding query filter params (type=network) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:35.114767 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d243c8-944e-4ea8-824a-5f6f3c5bdc74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:35.116201 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d243c8-944e-4ea8-824a-5f6f3c5bdc74 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:35.127624 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 404/825] 10.222.0.24 () {56 vars in 1112 bytes} [Thu May 19 14:52:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:35.127624 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d243c8-944e-4ea8-824a-5f6f3c5bdc74 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:35.135766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb942f27-3dbd-4faf-ad44-9b42883ca044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:35.136652 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb942f27-3dbd-4faf-ad44-9b42883ca044 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:35.136931 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb942f27-3dbd-4faf-ad44-9b42883ca044 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:35.137201 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb942f27-3dbd-4faf-ad44-9b42883ca044 None admin] PATH_INFO: `/v3/projects/2633b53c336145bba3d4744dbdfe99b7/users/fcd1725924134616b903b3e374d45817/roles/4d4ff927beb7409996558ecf7143d419` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:35.153846 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb942f27-3dbd-4faf-ad44-9b42883ca044 None admin] RBAC: Authorizing `identity:create_grant(project_id=2633b53c336145bba3d4744dbdfe99b7, user_id=fcd1725924134616b903b3e374d45817, role_id=4d4ff927beb7409996558ecf7143d419)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:35.155344 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb942f27-3dbd-4faf-ad44-9b42883ca044 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:35.165451 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:35.170631 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 422/826] 10.222.0.24 () {58 vars in 1439 bytes} [Thu May 19 14:52:34 2022] PUT /identity/v3/projects/2633b53c336145bba3d4744dbdfe99b7/users/fcd1725924134616b903b3e374d45817/roles/4d4ff927beb7409996558ecf7143d419 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:52:35.171955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb942f27-3dbd-4faf-ad44-9b42883ca044 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:35.180347 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:35.231421 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d243c8-944e-4ea8-824a-5f6f3c5bdc74 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:35.269750 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4560ab8-81c2-4d45-913e-66a7cceab0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:35.270681 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4560ab8-81c2-4d45-913e-66a7cceab0c7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:35.270967 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4560ab8-81c2-4d45-913e-66a7cceab0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:35.271386 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4560ab8-81c2-4d45-913e-66a7cceab0c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:35.279245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4560ab8-81c2-4d45-913e-66a7cceab0c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:35.280878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4560ab8-81c2-4d45-913e-66a7cceab0c7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:35.297271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-a4560ab8-81c2-4d45-913e-66a7cceab0c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:35.297271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:35.297271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:35.297271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:35.297271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:35.297271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:35.297271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:35.297271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:35.297271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:35.297271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:35.297271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:35.297271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:35.297271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:35.297271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:35.297271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:35.298225 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:35.298225 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:35.298225 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:35.298225 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:35.298225 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:35.298225 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:35.298225 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:35.298225 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:35.298225 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:35.298225 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:35.298225 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:35.298225 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:35.298225 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:35.298225 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:35.298225 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:35.298225 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:35.298225 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:35.299128 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:35.299128 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:35.299128 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:35.299128 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:35.299128 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:35.299128 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:35.299128 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:35.299128 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:35.299128 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 405/827] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:35.299645 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4560ab8-81c2-4d45-913e-66a7cceab0c7 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:35.309055 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb942f27-3dbd-4faf-ad44-9b42883ca044 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:35.362148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a68b91-9dfa-46bf-8953-59877104d3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:35.362735 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a68b91-9dfa-46bf-8953-59877104d3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:35.363013 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a68b91-9dfa-46bf-8953-59877104d3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:35.363318 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a68b91-9dfa-46bf-8953-59877104d3a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:35.364156 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a68b91-9dfa-46bf-8953-59877104d3a5 None admin] RBAC: Adding query filter params (role.id=ec4b73b709ca4cdc983e35e955aed57a, scope.project.id=2633b53c336145bba3d4744dbdfe99b7, user.id=06fb8bb5aeb143ad95f33c3b43dbd346) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:35.364463 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a68b91-9dfa-46bf-8953-59877104d3a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:35.365888 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a68b91-9dfa-46bf-8953-59877104d3a5 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:35.372569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 423/828] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:52:35 2022] GET /identity/v3/role_assignments?user.id=06fb8bb5aeb143ad95f33c3b43dbd346&scope.project.id=2633b53c336145bba3d4744dbdfe99b7&role.id=ec4b73b709ca4cdc983e35e955aed57a => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:35.373193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a68b91-9dfa-46bf-8953-59877104d3a5 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:35.434778 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4560ab8-81c2-4d45-913e-66a7cceab0c7 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:35.451936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:35.464406 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:35.477473 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2884748-6101-4bdf-b7df-03b4ab88e57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:35.478229 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2884748-6101-4bdf-b7df-03b4ab88e57c None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:35.478517 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2884748-6101-4bdf-b7df-03b4ab88e57c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:35.478793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2884748-6101-4bdf-b7df-03b4ab88e57c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:35.479601 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2884748-6101-4bdf-b7df-03b4ab88e57c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:35.481411 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2884748-6101-4bdf-b7df-03b4ab88e57c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:35.506857 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 406/829] 10.222.0.24 () {60 vars in 1144 bytes} [Thu May 19 14:52:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:52:35.512120 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2884748-6101-4bdf-b7df-03b4ab88e57c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:35.520576 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a68b91-9dfa-46bf-8953-59877104d3a5 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:35.566815 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0bcba7-828a-4776-93f1-f85c45b538d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:35.568004 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0bcba7-828a-4776-93f1-f85c45b538d3 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:35.568489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0bcba7-828a-4776-93f1-f85c45b538d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:35.568962 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0bcba7-828a-4776-93f1-f85c45b538d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:35.569934 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0bcba7-828a-4776-93f1-f85c45b538d3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:35.571665 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0bcba7-828a-4776-93f1-f85c45b538d3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:35.614540 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 424/830] 10.222.0.24 () {60 vars in 1144 bytes} [Thu May 19 14:52:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:52:35.679183 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2884748-6101-4bdf-b7df-03b4ab88e57c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:35.729894 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f5c33-ca36-4da0-8f56-39595a657c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:35.730706 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f5c33-ca36-4da0-8f56-39595a657c42 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:35.731089 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f5c33-ca36-4da0-8f56-39595a657c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:35.731399 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f5c33-ca36-4da0-8f56-39595a657c42 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:35.732276 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f5c33-ca36-4da0-8f56-39595a657c42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:35.732642 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f5c33-ca36-4da0-8f56-39595a657c42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:35.734165 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f5c33-ca36-4da0-8f56-39595a657c42 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:35.749808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 407/831] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:52:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:35.755872 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0bcba7-828a-4776-93f1-f85c45b538d3 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:35.881898 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0bcba7-828a-4776-93f1-f85c45b538d3 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:35.899842 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:35.920967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085a8a4-ddbe-4650-93fb-335ff29b0321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:35.921869 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085a8a4-ddbe-4650-93fb-335ff29b0321 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:35.922151 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085a8a4-ddbe-4650-93fb-335ff29b0321 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:35.922428 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085a8a4-ddbe-4650-93fb-335ff29b0321 None admin] PATH_INFO: `/v3/projects/2633b53c336145bba3d4744dbdfe99b7/users/8ecbeee0c1cf4c58be6c22aa11d7ff5a/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:35.924523 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f085a8a4-ddbe-4650-93fb-335ff29b0321 None admin] RBAC: Authorizing `identity:create_grant(project_id=2633b53c336145bba3d4744dbdfe99b7, user_id=8ecbeee0c1cf4c58be6c22aa11d7ff5a, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:35.925976 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f085a8a4-ddbe-4650-93fb-335ff29b0321 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:35.943927 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 425/832] 10.222.0.24 () {58 vars in 1439 bytes} [Thu May 19 14:52:35 2022] PUT /identity/v3/projects/2633b53c336145bba3d4744dbdfe99b7/users/8ecbeee0c1cf4c58be6c22aa11d7ff5a/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:52:37.499428 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcd6dd-b53b-4b28-974a-55ef6ab58935 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:37.500481 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcd6dd-b53b-4b28-974a-55ef6ab58935 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:37.500979 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcd6dd-b53b-4b28-974a-55ef6ab58935 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:37.502804 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 408/833] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:37.508347 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ce605-36da-4fa9-ac8a-d01f133d0383 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:37.509228 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ce605-36da-4fa9-ac8a-d01f133d0383 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:37.509727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ce605-36da-4fa9-ac8a-d01f133d0383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:37.527625 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-765ce605-36da-4fa9-ac8a-d01f133d0383 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:37.529147 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-765ce605-36da-4fa9-ac8a-d01f133d0383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:37.604054 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 426/834] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:37 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:37.628559 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fcd6dd-b53b-4b28-974a-55ef6ab58935 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:37.659042 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:37.752842 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fcd6dd-b53b-4b28-974a-55ef6ab58935 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:37.793221 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092b579-b52d-486c-9eaa-6d11b0be083e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:37.794399 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092b579-b52d-486c-9eaa-6d11b0be083e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:37.794893 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092b579-b52d-486c-9eaa-6d11b0be083e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:37.795961 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092b579-b52d-486c-9eaa-6d11b0be083e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:37.806828 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092b579-b52d-486c-9eaa-6d11b0be083e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:37.815110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-4092b579-b52d-486c-9eaa-6d11b0be083e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:37.815110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:37.815110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:37.815110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:37.815110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:37.815110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:37.815110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:37.815110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:37.815110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:37.815110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:37.815110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:37.815110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:37.815110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:37.815110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:37.815110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:37.815110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:37.816063 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:37.816063 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:37.816063 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:37.816063 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:37.816063 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:37.816063 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:37.816063 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:37.816063 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:37.816063 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:37.816063 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:37.816063 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:37.816063 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:37.816063 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:37.816063 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:37.816063 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:37.816063 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:37.816928 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:37.816928 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:37.816928 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:37.816928 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:37.816928 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:37.816928 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:37.816928 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:37.816928 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:37.816928 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:37.816928 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:37.816928 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:52:37.816928 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:37.819602 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 409/835] 10.222.0.24 () {56 vars in 1102 bytes} [Thu May 19 14:52:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:37.825542 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ce605-36da-4fa9-ac8a-d01f133d0383 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:37.868396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2a759-b5ef-4f16-b37a-1816856f1d98 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:37.868681 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2a759-b5ef-4f16-b37a-1816856f1d98 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:37.868882 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2a759-b5ef-4f16-b37a-1816856f1d98 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:37.870813 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 410/836] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:37.876409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cc919-ab9a-44e5-9c0e-a72f555f4aae None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:37.876699 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cc919-ab9a-44e5-9c0e-a72f555f4aae None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:37.876977 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cc919-ab9a-44e5-9c0e-a72f555f4aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:37.900286 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-568cc919-ab9a-44e5-9c0e-a72f555f4aae None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:37.902699 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-568cc919-ab9a-44e5-9c0e-a72f555f4aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:37.936414 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ce605-36da-4fa9-ac8a-d01f133d0383 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:37.944474 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:37.975881 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f1845-7069-4324-9f73-393bc5019adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:37.976533 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f1845-7069-4324-9f73-393bc5019adf None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:37.976935 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f1845-7069-4324-9f73-393bc5019adf None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:37.977194 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f1845-7069-4324-9f73-393bc5019adf None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:37.978058 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f1845-7069-4324-9f73-393bc5019adf None admin] RBAC: Adding query filter params (name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:37.978369 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f1845-7069-4324-9f73-393bc5019adf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:37.979868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f1845-7069-4324-9f73-393bc5019adf None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:37.982113 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 411/837] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:37 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:37.983831 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90437480-eae2-4d8f-a7f2-93e713408f1a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:37.984121 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90437480-eae2-4d8f-a7f2-93e713408f1a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:37.984395 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90437480-eae2-4d8f-a7f2-93e713408f1a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:37.989793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 412/838] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:37.994534 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3500fe-f180-4960-b505-801ac44fbf20 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:37.994534 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3500fe-f180-4960-b505-801ac44fbf20 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:37.994534 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3500fe-f180-4960-b505-801ac44fbf20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:37.995613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 427/839] 10.222.0.24 () {56 vars in 1103 bytes} [Thu May 19 14:52:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:37.996729 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f1845-7069-4324-9f73-393bc5019adf None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:38.010544 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2c3500fe-f180-4960-b505-801ac44fbf20 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:38.011983 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2c3500fe-f180-4960-b505-801ac44fbf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:38.023665 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:38.084558 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 413/840] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:37 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:38.085696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3500fe-f180-4960-b505-801ac44fbf20 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:38.141206 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f1845-7069-4324-9f73-393bc5019adf None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:38.176630 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cd812-81bd-4135-b65e-1b5ca03415ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:38.177418 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cd812-81bd-4135-b65e-1b5ca03415ce None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:38.177697 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cd812-81bd-4135-b65e-1b5ca03415ce None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:38.177972 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cd812-81bd-4135-b65e-1b5ca03415ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:38.187646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3500fe-f180-4960-b505-801ac44fbf20 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:38.189658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223cd812-81bd-4135-b65e-1b5ca03415ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:38.191087 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223cd812-81bd-4135-b65e-1b5ca03415ce None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:38.208906 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-223cd812-81bd-4135-b65e-1b5ca03415ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:38.208906 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:38.208906 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:38.208906 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:38.208906 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:38.208906 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:38.208906 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:38.208906 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:38.208906 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:38.208906 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:38.208906 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:38.208906 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:38.208906 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:38.208906 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:38.208906 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:38.209841 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:38.209841 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:38.209841 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:38.209841 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:38.209841 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:38.209841 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:38.209841 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:38.209841 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:38.209841 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:38.209841 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:38.209841 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:38.209841 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:38.209841 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:38.209841 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:38.209841 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:38.209841 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:38.209841 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:38.210745 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:38.210745 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:38.210745 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:38.210745 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:38.210745 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 428/841] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:38.211880 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cd812-81bd-4135-b65e-1b5ca03415ce None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:38.229890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f98015-2143-4a53-a101-c9c673cf9174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:38.230696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f98015-2143-4a53-a101-c9c673cf9174 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:38.230976 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f98015-2143-4a53-a101-c9c673cf9174 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:38.231272 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f98015-2143-4a53-a101-c9c673cf9174 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:38.231919 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f98015-2143-4a53-a101-c9c673cf9174 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:38.233315 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f98015-2143-4a53-a101-c9c673cf9174 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:38.236293 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:38.245981 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-05f98015-2143-4a53-a101-c9c673cf9174 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:52:38.245981 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:38.245981 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:38.245981 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:38.245981 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:38.245981 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:38.245981 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:38.245981 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:38.245981 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:52:38.245981 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:38.245981 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:38.245981 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:38.245981 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:38.245981 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:38.245981 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:38.245981 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:38.246896 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:38.246896 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:38.246896 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:38.246896 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:38.246896 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:38.246896 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:38.246896 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:38.246896 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:38.246896 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:38.246896 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:38.246896 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:38.246896 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:38.246896 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:38.246896 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:38.246896 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:38.246896 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:38.248211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:38.248211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:38.248211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:38.248211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:38.248211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:38.248211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:38.248211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:38.248211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:38.248211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:38.248211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:38.248211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:38.248211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:38.248211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:38.248211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:52:38.248211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:38.248211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 414/842] 10.222.0.24 () {56 vars in 1132 bytes} [Thu May 19 14:52:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:38.249872 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f98015-2143-4a53-a101-c9c673cf9174 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:38.261899 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:38.321958 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cd812-81bd-4135-b65e-1b5ca03415ce None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:38.350407 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f98015-2143-4a53-a101-c9c673cf9174 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:38.358319 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775dda79-d6f4-4f44-8ae5-6cddb3d4fd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:38.359115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775dda79-d6f4-4f44-8ae5-6cddb3d4fd51 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:38.359423 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775dda79-d6f4-4f44-8ae5-6cddb3d4fd51 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:38.359697 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775dda79-d6f4-4f44-8ae5-6cddb3d4fd51 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:38.360347 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775dda79-d6f4-4f44-8ae5-6cddb3d4fd51 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:38.361710 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775dda79-d6f4-4f44-8ae5-6cddb3d4fd51 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:38.373464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-775dda79-d6f4-4f44-8ae5-6cddb3d4fd51 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:52:38.373464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:38.373464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:38.373464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:38.373464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:38.373464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:38.373464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:38.373464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:38.373464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:52:38.373464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:38.373464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:38.373464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:38.373464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:38.373464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:38.373464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:38.373464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:38.373464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:38.374491 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:38.374491 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:38.374491 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:38.374491 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:38.374491 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:38.374491 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:38.374491 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:38.374491 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:38.374491 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:38.374491 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:38.374491 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:38.374491 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:38.374491 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:38.374491 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:38.374491 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:38.374491 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:38.375352 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:38.375352 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:38.375352 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:38.375352 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:38.375352 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:38.375352 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:38.375352 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:38.375352 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:38.375352 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:38.375352 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:38.375352 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:38.375352 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:38.375352 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:52:38.375352 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:38.375352 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 429/843] 10.222.0.24 () {56 vars in 1114 bytes} [Thu May 19 14:52:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:38.376268 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875f899-020f-49fe-9482-f12d0c39960e None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:38.376549 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875f899-020f-49fe-9482-f12d0c39960e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:38.376842 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875f899-020f-49fe-9482-f12d0c39960e None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:38.378064 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 430/844] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:38.378747 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875f899-020f-49fe-9482-f12d0c39960e None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:38.387350 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ccbf5-e14f-4bcd-8310-95123d0ac61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:38.388021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ccbf5-e14f-4bcd-8310-95123d0ac61d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:38.388309 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ccbf5-e14f-4bcd-8310-95123d0ac61d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:38.388591 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ccbf5-e14f-4bcd-8310-95123d0ac61d None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:38.389839 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ccbf5-e14f-4bcd-8310-95123d0ac61d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:38.390156 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ccbf5-e14f-4bcd-8310-95123d0ac61d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:38.391599 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ccbf5-e14f-4bcd-8310-95123d0ac61d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:38.403597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 415/845] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:38.404444 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ccbf5-e14f-4bcd-8310-95123d0ac61d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:38.461950 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:38.473003 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:38.479338 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875f899-020f-49fe-9482-f12d0c39960e None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:38.504077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ccbf5-e14f-4bcd-8310-95123d0ac61d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:38.512099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3cbf4-335e-4104-83e8-66c014970716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:38.512762 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3cbf4-335e-4104-83e8-66c014970716 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:38.513048 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3cbf4-335e-4104-83e8-66c014970716 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:38.513330 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3cbf4-335e-4104-83e8-66c014970716 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:38.514563 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3cbf4-335e-4104-83e8-66c014970716 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:38.514875 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3cbf4-335e-4104-83e8-66c014970716 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:38.516281 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3cbf4-335e-4104-83e8-66c014970716 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:38.520689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 431/846] 10.222.0.24 () {56 vars in 1126 bytes} [Thu May 19 14:52:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:38.521851 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafab98-c1f2-44c8-938b-7f87f21e6e7c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:38.522140 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafab98-c1f2-44c8-938b-7f87f21e6e7c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:38.522472 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafab98-c1f2-44c8-938b-7f87f21e6e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:38.537519 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e64299-1bea-48df-9092-725b0b7a461f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:38.538135 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9fafab98-c1f2-44c8-938b-7f87f21e6e7c None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:38.538238 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e64299-1bea-48df-9092-725b0b7a461f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:38.538453 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e64299-1bea-48df-9092-725b0b7a461f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:38.538734 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e64299-1bea-48df-9092-725b0b7a461f None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:38.539342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9fafab98-c1f2-44c8-938b-7f87f21e6e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:38.539492 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e64299-1bea-48df-9092-725b0b7a461f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:38.539809 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e64299-1bea-48df-9092-725b0b7a461f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:38.541213 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e64299-1bea-48df-9092-725b0b7a461f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:38.545633 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 416/847] 10.222.0.24 () {56 vars in 1114 bytes} [Thu May 19 14:52:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:38.546408 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e64299-1bea-48df-9092-725b0b7a461f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:38.608041 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 432/848] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:38.608860 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafab98-c1f2-44c8-938b-7f87f21e6e7c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:38.655803 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e64299-1bea-48df-9092-725b0b7a461f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:38.684279 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:38.690418 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5229e15-5fd4-4526-95e2-bfd5ef59cc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:38.691572 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5229e15-5fd4-4526-95e2-bfd5ef59cc0c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:38.691690 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5229e15-5fd4-4526-95e2-bfd5ef59cc0c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:38.691962 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5229e15-5fd4-4526-95e2-bfd5ef59cc0c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:38.693858 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:38.699401 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5229e15-5fd4-4526-95e2-bfd5ef59cc0c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:38.701061 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5229e15-5fd4-4526-95e2-bfd5ef59cc0c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:38.705760 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafab98-c1f2-44c8-938b-7f87f21e6e7c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:38.715449 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-c5229e15-5fd4-4526-95e2-bfd5ef59cc0c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:52:38.715449 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:38.715449 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:38.715449 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:38.715449 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:38.715449 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:38.715449 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:38.715449 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:38.715449 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:38.715449 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:38.715449 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:38.715449 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:38.715449 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:38.715449 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:38.715449 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:38.715449 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:38.716378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:38.716378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:38.716378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:38.716378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:38.716378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:38.716378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:38.716378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:38.716378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:38.716378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:38.716378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:38.716378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:38.716378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:38.716378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:38.716378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:38.716378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:38.716378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:38.716378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:38.716378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:38.717846 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:38.717846 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:38.717846 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:38.717846 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:38.717846 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:38.717846 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:38.717846 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:38.717846 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:38.717846 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:52:38.717846 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:38.717846 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 417/849] 10.222.0.24 () {56 vars in 1117 bytes} [Thu May 19 14:52:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:38.718441 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5229e15-5fd4-4526-95e2-bfd5ef59cc0c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:38.742074 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59f9eb-e40b-472d-b255-dd47bacf99e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:38.742735 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59f9eb-e40b-472d-b255-dd47bacf99e2 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:38.743019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59f9eb-e40b-472d-b255-dd47bacf99e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:38.743333 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59f9eb-e40b-472d-b255-dd47bacf99e2 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:38.744045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59f9eb-e40b-472d-b255-dd47bacf99e2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:38.744356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59f9eb-e40b-472d-b255-dd47bacf99e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:38.745984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59f9eb-e40b-472d-b255-dd47bacf99e2 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:38.750343 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 433/850] 10.222.0.24 () {56 vars in 1126 bytes} [Thu May 19 14:52:38 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:38.751108 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59f9eb-e40b-472d-b255-dd47bacf99e2 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:38.837927 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5229e15-5fd4-4526-95e2-bfd5ef59cc0c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:38.865000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59f9eb-e40b-472d-b255-dd47bacf99e2 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:38.878206 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99552f-6ff0-4c45-86d3-2d18235f0fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:38.878944 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99552f-6ff0-4c45-86d3-2d18235f0fbe None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:38.879173 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99552f-6ff0-4c45-86d3-2d18235f0fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:38.879479 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99552f-6ff0-4c45-86d3-2d18235f0fbe None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:38.880198 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99552f-6ff0-4c45-86d3-2d18235f0fbe None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:38.880512 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99552f-6ff0-4c45-86d3-2d18235f0fbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:38.881912 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99552f-6ff0-4c45-86d3-2d18235f0fbe None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:38.887052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 418/851] 10.222.0.24 () {56 vars in 1114 bytes} [Thu May 19 14:52:38 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:38.892915 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99552f-6ff0-4c45-86d3-2d18235f0fbe None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:38.905924 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c11b49-7e87-4c7a-9162-af00914cd87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:38.906690 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c11b49-7e87-4c7a-9162-af00914cd87d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:38.906973 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c11b49-7e87-4c7a-9162-af00914cd87d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:38.907280 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c11b49-7e87-4c7a-9162-af00914cd87d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:38.920852 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c11b49-7e87-4c7a-9162-af00914cd87d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:38.929000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-d7c11b49-7e87-4c7a-9162-af00914cd87d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:52:38.929000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:38.929000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:38.929000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:38.929000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:38.929000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:38.929000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:38.929000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:38.929000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:38.929000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:38.929000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:38.929000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:38.929000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:38.929000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:38.929000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:38.929000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:38.930014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:38.930014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:38.930014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:38.930014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:38.930014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:38.930014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:38.930014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:38.930014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:38.930014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:38.930014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:38.930014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:38.930014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:38.930014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:38.930014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:38.930014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:38.930014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:38.930941 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:38.930941 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:38.930941 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:38.930941 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:38.930941 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:38.930941 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:38.930941 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:38.930941 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:38.930941 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:38.930941 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:38.930941 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:52:38.930941 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:38.935826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 434/852] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:52:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:38.936873 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c11b49-7e87-4c7a-9162-af00914cd87d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:38.939785 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:38.989428 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:39.049646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99552f-6ff0-4c45-86d3-2d18235f0fbe None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:39.064707 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c11b49-7e87-4c7a-9162-af00914cd87d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:39.094345 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1d223-f3a1-4f33-b5ff-ad0b3224c660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:39.095531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1d223-f3a1-4f33-b5ff-ad0b3224c660 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:39.095839 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1d223-f3a1-4f33-b5ff-ad0b3224c660 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:39.096378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1d223-f3a1-4f33-b5ff-ad0b3224c660 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:39.097236 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1d223-f3a1-4f33-b5ff-ad0b3224c660 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:39.097764 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1d223-f3a1-4f33-b5ff-ad0b3224c660 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:39.100758 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1d223-f3a1-4f33-b5ff-ad0b3224c660 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:39.111555 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc762b-7bf5-41e0-9ec2-79a261674704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:39.112239 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc762b-7bf5-41e0-9ec2-79a261674704 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:39.112527 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc762b-7bf5-41e0-9ec2-79a261674704 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:39.112804 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc762b-7bf5-41e0-9ec2-79a261674704 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:39.113558 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc762b-7bf5-41e0-9ec2-79a261674704 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:39.113870 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc762b-7bf5-41e0-9ec2-79a261674704 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:39.115256 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc762b-7bf5-41e0-9ec2-79a261674704 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:39.120997 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 419/853] 10.222.0.24 () {56 vars in 1149 bytes} [Thu May 19 14:52:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:39.126758 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 435/854] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:52:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:39.128295 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1d223-f3a1-4f33-b5ff-ad0b3224c660 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:39.131545 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc762b-7bf5-41e0-9ec2-79a261674704 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:39.194594 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:39.236564 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc762b-7bf5-41e0-9ec2-79a261674704 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:39.237074 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1d223-f3a1-4f33-b5ff-ad0b3224c660 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:39.258870 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:39.282019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916e154-e9ba-4151-88f1-ce5f30380da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:39.282677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916e154-e9ba-4151-88f1-ce5f30380da8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:39.282966 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916e154-e9ba-4151-88f1-ce5f30380da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:39.283272 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916e154-e9ba-4151-88f1-ce5f30380da8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:39.283579 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbc4fd-2cbb-4376-b75e-b743fe7e0d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:39.284654 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbc4fd-2cbb-4376-b75e-b743fe7e0d11 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:39.285141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbc4fd-2cbb-4376-b75e-b743fe7e0d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:39.285623 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbc4fd-2cbb-4376-b75e-b743fe7e0d11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:39.299823 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dbc4fd-2cbb-4376-b75e-b743fe7e0d11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:39.301955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dbc4fd-2cbb-4376-b75e-b743fe7e0d11 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:39.330215 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-30dbc4fd-2cbb-4376-b75e-b743fe7e0d11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:39.330215 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:39.330215 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:39.330215 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:39.330215 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:39.330215 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:39.330215 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:39.330215 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:39.330215 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:39.330215 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:39.330215 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:39.330215 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:39.330215 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:39.330215 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:39.330215 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:39.331138 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:39.331138 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:39.331138 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:39.331138 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:39.331138 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:39.331138 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:39.331138 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:39.331138 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:39.331138 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:39.331138 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:39.331138 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:39.331138 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:39.331138 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:39.331138 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:39.331138 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:39.331138 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:39.331138 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:39.332053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:39.332053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:39.332053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:39.332053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:39.334383 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 436/855] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:39.340712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbc4fd-2cbb-4376-b75e-b743fe7e0d11 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:39.368511 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e916e154-e9ba-4151-88f1-ce5f30380da8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:39.369986 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e916e154-e9ba-4151-88f1-ce5f30380da8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:39.448767 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbc4fd-2cbb-4376-b75e-b743fe7e0d11 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:39.472334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:39.480852 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 420/856] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:52:39 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:52:39.486944 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916e154-e9ba-4151-88f1-ce5f30380da8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:39.497396 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4da3a-02a7-47ab-97b5-e7792fddd001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:39.498587 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4da3a-02a7-47ab-97b5-e7792fddd001 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:39.498924 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4da3a-02a7-47ab-97b5-e7792fddd001 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:39.499224 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4da3a-02a7-47ab-97b5-e7792fddd001 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:39.500024 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4da3a-02a7-47ab-97b5-e7792fddd001 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:39.500340 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4da3a-02a7-47ab-97b5-e7792fddd001 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:39.501719 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4da3a-02a7-47ab-97b5-e7792fddd001 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:39.506467 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:39.520360 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 437/857] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:39.521362 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4da3a-02a7-47ab-97b5-e7792fddd001 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:39.593489 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916e154-e9ba-4151-88f1-ce5f30380da8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:39.626567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4da3a-02a7-47ab-97b5-e7792fddd001 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:39.629927 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78050a42-ebac-4339-af3e-eb95783f029a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:39.630734 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78050a42-ebac-4339-af3e-eb95783f029a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:39.631020 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78050a42-ebac-4339-af3e-eb95783f029a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:39.631336 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78050a42-ebac-4339-af3e-eb95783f029a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:39.641998 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78050a42-ebac-4339-af3e-eb95783f029a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:39.643504 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78050a42-ebac-4339-af3e-eb95783f029a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:39.662099 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-78050a42-ebac-4339-af3e-eb95783f029a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:39.662099 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:39.662099 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:39.662099 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:39.662099 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:39.662099 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:39.662099 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:39.662099 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:39.662099 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:39.662099 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:39.662099 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:39.662099 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:39.662099 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:39.662099 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:39.662099 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:39.663048 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:39.663048 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:39.663048 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:39.663048 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:39.663048 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:39.663048 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:39.663048 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:39.663048 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:39.663048 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:39.663048 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:39.663048 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:39.663048 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:39.663048 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:39.663048 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:39.663048 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:39.663048 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:39.663048 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:39.663967 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:39.663967 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:39.663967 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:39.663967 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:39.664197 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74bc2d6-101e-4a48-9da8-cd3e03763a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:39.664197 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74bc2d6-101e-4a48-9da8-cd3e03763a93 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:39.664197 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74bc2d6-101e-4a48-9da8-cd3e03763a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:39.664197 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74bc2d6-101e-4a48-9da8-cd3e03763a93 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:39.667878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 421/858] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:39.669136 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78050a42-ebac-4339-af3e-eb95783f029a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:39.672462 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74bc2d6-101e-4a48-9da8-cd3e03763a93 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:39.673928 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74bc2d6-101e-4a48-9da8-cd3e03763a93 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:39.689569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-a74bc2d6-101e-4a48-9da8-cd3e03763a93 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 19 14:52:39.689569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:39.689569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:39.689569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:39.689569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:39.689569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:39.689569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:39.689569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:39.689569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:39.689569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:39.689569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:39.689569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:39.689569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:39.689569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:39.689569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:39.689569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:39.691736 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:39.691736 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:39.691736 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:39.691736 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:39.691736 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:39.691736 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:39.691736 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:39.691736 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:39.691736 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:39.691736 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:39.691736 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:39.691736 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:39.691736 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:39.691736 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:39.691736 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:39.691736 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:39.691736 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:39.691736 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:39.693939 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:39.693939 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:39.693939 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:39.693939 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:39.693939 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:39.693939 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:39.693939 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:39.693939 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:39.693939 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 19 14:52:39.693939 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:39.703303 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 438/859] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:52:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:39.703303 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74bc2d6-101e-4a48-9da8-cd3e03763a93 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:39.739396 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:39.749796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:39.790436 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78050a42-ebac-4339-af3e-eb95783f029a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:39.830639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74bc2d6-101e-4a48-9da8-cd3e03763a93 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:39.832789 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f8cae-e588-4b21-a5d9-19653a6adb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:39.834214 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f8cae-e588-4b21-a5d9-19653a6adb3b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:39.834507 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f8cae-e588-4b21-a5d9-19653a6adb3b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:39.834782 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f8cae-e588-4b21-a5d9-19653a6adb3b None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:39.835534 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f8cae-e588-4b21-a5d9-19653a6adb3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:39.835844 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f8cae-e588-4b21-a5d9-19653a6adb3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:39.837210 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f8cae-e588-4b21-a5d9-19653a6adb3b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:39.855220 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 422/860] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:39.857025 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f8cae-e588-4b21-a5d9-19653a6adb3b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:39.875606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d7598-6c2d-4e96-8bf5-176c17c6a641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:39.876266 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d7598-6c2d-4e96-8bf5-176c17c6a641 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:39.876544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d7598-6c2d-4e96-8bf5-176c17c6a641 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:39.876820 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d7598-6c2d-4e96-8bf5-176c17c6a641 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:39.877817 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d7598-6c2d-4e96-8bf5-176c17c6a641 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:39.878015 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d7598-6c2d-4e96-8bf5-176c17c6a641 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:39.879498 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d7598-6c2d-4e96-8bf5-176c17c6a641 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:39.901316 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 439/861] 10.222.0.24 () {56 vars in 1135 bytes} [Thu May 19 14:52:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:39.902313 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d7598-6c2d-4e96-8bf5-176c17c6a641 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:39.984609 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f8cae-e588-4b21-a5d9-19653a6adb3b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:40.017362 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:40.026796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e9879-723b-462e-ab29-d06e9d42fc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:40.027763 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e9879-723b-462e-ab29-d06e9d42fc26 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:40.028077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e9879-723b-462e-ab29-d06e9d42fc26 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:40.028665 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e9879-723b-462e-ab29-d06e9d42fc26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:40.031444 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:40.037482 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e9879-723b-462e-ab29-d06e9d42fc26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:40.039561 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e9879-723b-462e-ab29-d06e9d42fc26 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:40.041409 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d7598-6c2d-4e96-8bf5-176c17c6a641 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:40.057176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-c93e9879-723b-462e-ab29-d06e9d42fc26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:40.057176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:40.057176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:40.057176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:40.057176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:40.057176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:40.057176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:40.057176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:40.057176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:40.057176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:40.057176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:40.057176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:40.057176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:40.057176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:40.057176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:40.058110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:40.058110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:40.058110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:40.058110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:40.058110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:40.058110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:40.058110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:40.058110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:40.058110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:40.058110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:40.058110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:40.058110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:40.058110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:40.058110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:40.058110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:40.058110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:40.058110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:40.059029 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:40.059029 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:40.059029 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:40.059029 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:40.059029 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:40.059029 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:40.059029 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:40.059029 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:40.063403 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 423/862] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:40.064541 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e9879-723b-462e-ab29-d06e9d42fc26 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:40.091315 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b84b5-ba31-449b-98de-4c38bec2d367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:40.092516 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b84b5-ba31-449b-98de-4c38bec2d367 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:40.092803 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b84b5-ba31-449b-98de-4c38bec2d367 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:40.093068 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b84b5-ba31-449b-98de-4c38bec2d367 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:40.165046 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b84b5-ba31-449b-98de-4c38bec2d367 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:40.166497 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b84b5-ba31-449b-98de-4c38bec2d367 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:40.181041 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e9879-723b-462e-ab29-d06e9d42fc26 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:40.221068 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa4072-0fad-45da-a233-59eb82862b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:40.222218 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa4072-0fad-45da-a233-59eb82862b1a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:40.222712 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa4072-0fad-45da-a233-59eb82862b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:40.223250 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa4072-0fad-45da-a233-59eb82862b1a None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:40.224332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa4072-0fad-45da-a233-59eb82862b1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:40.224921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa4072-0fad-45da-a233-59eb82862b1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:40.226643 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa4072-0fad-45da-a233-59eb82862b1a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:40.245414 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 424/863] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:52:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:40.246559 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa4072-0fad-45da-a233-59eb82862b1a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:40.264420 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:40.272001 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 440/864] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:52:39 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 14:52:40.277466 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b84b5-ba31-449b-98de-4c38bec2d367 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:40.303141 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:40.371634 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa4072-0fad-45da-a233-59eb82862b1a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:40.397453 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b84b5-ba31-449b-98de-4c38bec2d367 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:40.409282 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b75b2-18cb-4437-b892-a1e6422782c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:40.410225 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b75b2-18cb-4437-b892-a1e6422782c2 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:40.410716 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b75b2-18cb-4437-b892-a1e6422782c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:40.411406 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b75b2-18cb-4437-b892-a1e6422782c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:40.412616 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b75b2-18cb-4437-b892-a1e6422782c2 None admin] RBAC: Adding query filter params (role.id=4d4ff927beb7409996558ecf7143d419, scope.project.id=2633b53c336145bba3d4744dbdfe99b7, user.id=fcd1725924134616b903b3e374d45817) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:40.413137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b75b2-18cb-4437-b892-a1e6422782c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:40.414918 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b75b2-18cb-4437-b892-a1e6422782c2 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:40.427875 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 425/865] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:52:40 2022] GET /identity/v3/role_assignments?user.id=fcd1725924134616b903b3e374d45817&scope.project.id=2633b53c336145bba3d4744dbdfe99b7&role.id=4d4ff927beb7409996558ecf7143d419 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:40.432279 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c9d4b-52ba-4a50-b5d3-31c2a4177f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:40.433087 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c9d4b-52ba-4a50-b5d3-31c2a4177f2e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:40.433367 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c9d4b-52ba-4a50-b5d3-31c2a4177f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:40.433637 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c9d4b-52ba-4a50-b5d3-31c2a4177f2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:40.445703 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c9d4b-52ba-4a50-b5d3-31c2a4177f2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:40.447181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c9d4b-52ba-4a50-b5d3-31c2a4177f2e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:40.467789 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-e66c9d4b-52ba-4a50-b5d3-31c2a4177f2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:40.467789 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:40.467789 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:40.467789 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:40.467789 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:40.467789 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:40.467789 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:40.467789 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:40.467789 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:40.467789 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:40.467789 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:40.467789 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:40.467789 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:40.467789 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:40.467789 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:40.468731 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:40.468731 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:40.468731 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:40.468731 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:40.468731 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:40.468731 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:40.468731 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:40.468731 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:40.468731 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:40.468731 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:40.468731 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:40.468731 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:40.468731 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:40.468731 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:40.468731 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:40.468731 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:40.468731 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:40.469636 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:40.469636 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:40.469636 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:40.469636 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:40.469636 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 441/866] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:40.474954 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b75b2-18cb-4437-b892-a1e6422782c2 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:40.589613 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b75b2-18cb-4437-b892-a1e6422782c2 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:40.607761 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:40.629586 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945eb85-852e-4872-b86b-d82a126ebeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:40.630273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945eb85-852e-4872-b86b-d82a126ebeef None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:40.630564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945eb85-852e-4872-b86b-d82a126ebeef None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:40.630848 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945eb85-852e-4872-b86b-d82a126ebeef None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:40.631609 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8945eb85-852e-4872-b86b-d82a126ebeef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:40.631923 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8945eb85-852e-4872-b86b-d82a126ebeef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:40.633300 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8945eb85-852e-4872-b86b-d82a126ebeef None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:40.646668 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 426/867] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:40.652012 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c9d4b-52ba-4a50-b5d3-31c2a4177f2e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:40.702223 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:40.760878 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c9d4b-52ba-4a50-b5d3-31c2a4177f2e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:40.798479 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f84fc-97dc-4ff9-bcff-18ff362be230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:40.799314 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f84fc-97dc-4ff9-bcff-18ff362be230 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:40.799605 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f84fc-97dc-4ff9-bcff-18ff362be230 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:40.799884 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f84fc-97dc-4ff9-bcff-18ff362be230 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:40.806778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f84fc-97dc-4ff9-bcff-18ff362be230 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:40.808252 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f84fc-97dc-4ff9-bcff-18ff362be230 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:40.822302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-944f84fc-97dc-4ff9-bcff-18ff362be230 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:40.822302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:40.822302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:40.822302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:40.822302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:40.822302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:40.822302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:40.822302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:40.822302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:40.822302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:40.822302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:40.822302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:40.822302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:40.822302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:40.822302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:40.823218 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:40.823218 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:40.823218 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:40.823218 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:40.823218 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:40.823218 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:40.823218 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:40.823218 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:40.823218 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:40.823218 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:40.823218 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:40.823218 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:40.823218 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:40.823218 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:40.823218 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:40.823218 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:40.823218 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:40.824100 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:40.824100 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:40.824100 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:40.824100 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:40.824100 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:40.824100 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:40.824100 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:40.824100 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:40.824100 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 442/868] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:40.831439 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945eb85-852e-4872-b86b-d82a126ebeef None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:40.943559 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945eb85-852e-4872-b86b-d82a126ebeef None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:40.979021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d3b2f-e139-4c6d-999c-9ca3316005f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:40.979718 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d3b2f-e139-4c6d-999c-9ca3316005f7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:40.980008 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d3b2f-e139-4c6d-999c-9ca3316005f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:40.980289 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d3b2f-e139-4c6d-999c-9ca3316005f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:40.981088 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d3b2f-e139-4c6d-999c-9ca3316005f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:40.981405 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d3b2f-e139-4c6d-999c-9ca3316005f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:40.983441 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d3b2f-e139-4c6d-999c-9ca3316005f7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:40.996180 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 427/869] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:52:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:41.002002 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f84fc-97dc-4ff9-bcff-18ff362be230 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:41.054124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d72179-5520-4e8f-8663-2897e86dd6ce None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:41.054465 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d72179-5520-4e8f-8663-2897e86dd6ce None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:41.054698 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d72179-5520-4e8f-8663-2897e86dd6ce None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:41.056353 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 428/870] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:41.061565 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696df5f5-fa9e-46d2-8237-03553a6ee7ab None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:41.062103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696df5f5-fa9e-46d2-8237-03553a6ee7ab None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:41.062604 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696df5f5-fa9e-46d2-8237-03553a6ee7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:41.079935 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-696df5f5-fa9e-46d2-8237-03553a6ee7ab None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:41.081341 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-696df5f5-fa9e-46d2-8237-03553a6ee7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:41.111095 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:41.114527 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f84fc-97dc-4ff9-bcff-18ff362be230 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:41.127419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:41.157693 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4168d-f003-4928-8ce7-ad6b0cd1a67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:41.158529 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4168d-f003-4928-8ce7-ad6b0cd1a67d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:41.158880 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4168d-f003-4928-8ce7-ad6b0cd1a67d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:41.159264 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4168d-f003-4928-8ce7-ad6b0cd1a67d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:41.160165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f4168d-f003-4928-8ce7-ad6b0cd1a67d None admin] RBAC: Adding query filter params (role.id=ec4b73b709ca4cdc983e35e955aed57a, scope.project.id=2633b53c336145bba3d4744dbdfe99b7, user.id=8ecbeee0c1cf4c58be6c22aa11d7ff5a) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:41.160642 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f4168d-f003-4928-8ce7-ad6b0cd1a67d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:41.161047 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 429/871] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:52:41.162076 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f4168d-f003-4928-8ce7-ad6b0cd1a67d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:41.171246 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 443/872] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:52:41 2022] GET /identity/v3/role_assignments?user.id=8ecbeee0c1cf4c58be6c22aa11d7ff5a&scope.project.id=2633b53c336145bba3d4744dbdfe99b7&role.id=ec4b73b709ca4cdc983e35e955aed57a => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:41.183369 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696df5f5-fa9e-46d2-8237-03553a6ee7ab None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:41.200257 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb3cd6-dc1f-4624-8e77-351d31795766 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:41.200439 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb3cd6-dc1f-4624-8e77-351d31795766 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:41.201739 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb3cd6-dc1f-4624-8e77-351d31795766 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:41.203189 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 444/873] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:52:41.208351 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0f381-45a4-4ed0-974a-9f1436b93e66 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:41.209234 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0f381-45a4-4ed0-974a-9f1436b93e66 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:41.209234 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0f381-45a4-4ed0-974a-9f1436b93e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:41.228748 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-4fa0f381-45a4-4ed0-974a-9f1436b93e66 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:41.230256 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4fa0f381-45a4-4ed0-974a-9f1436b93e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:41.300385 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696df5f5-fa9e-46d2-8237-03553a6ee7ab None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:41.309549 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 445/874] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:41.339191 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163cfbc-9022-4e7c-ab61-04cd172bff60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:41.339909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163cfbc-9022-4e7c-ab61-04cd172bff60 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:41.340198 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163cfbc-9022-4e7c-ab61-04cd172bff60 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:41.340487 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163cfbc-9022-4e7c-ab61-04cd172bff60 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:41.341245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163cfbc-9022-4e7c-ab61-04cd172bff60 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:41.343364 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163cfbc-9022-4e7c-ab61-04cd172bff60 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:41.345499 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0f381-45a4-4ed0-974a-9f1436b93e66 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:41.358838 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 430/875] 10.222.0.24 () {60 vars in 1141 bytes} [Thu May 19 14:52:41 2022] POST /identity/v3/services => generated 269 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:52:41.490342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:41.494684 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0f381-45a4-4ed0-974a-9f1436b93e66 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:41.543897 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3f9f5-7c97-4475-959f-3aa28e8b8964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:41.544576 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3f9f5-7c97-4475-959f-3aa28e8b8964 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:41.544920 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3f9f5-7c97-4475-959f-3aa28e8b8964 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:41.545201 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3f9f5-7c97-4475-959f-3aa28e8b8964 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:41.545951 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3f9f5-7c97-4475-959f-3aa28e8b8964 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:41.547379 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3f9f5-7c97-4475-959f-3aa28e8b8964 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:41.567323 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 446/876] 10.222.0.24 () {60 vars in 1141 bytes} [Thu May 19 14:52:41 2022] POST /identity/v3/services => generated 251 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:52:42.887550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff5b7d-9f84-4d9c-bec0-b64cf7f2347e None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:42.889122 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff5b7d-9f84-4d9c-bec0-b64cf7f2347e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:42.889622 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff5b7d-9f84-4d9c-bec0-b64cf7f2347e None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:42.891480 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 431/877] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:42.896909 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8a2d4-adee-40bb-9388-a8aea1aa4338 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:42.897725 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8a2d4-adee-40bb-9388-a8aea1aa4338 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:42.898208 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8a2d4-adee-40bb-9388-a8aea1aa4338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:42.916055 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a1d8a2d4-adee-40bb-9388-a8aea1aa4338 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:42.917524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a1d8a2d4-adee-40bb-9388-a8aea1aa4338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:42.993719 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 447/878] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:42 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:43.018499 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff5b7d-9f84-4d9c-bec0-b64cf7f2347e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:43.043786 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:43.126380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff5b7d-9f84-4d9c-bec0-b64cf7f2347e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:43.161424 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee478971-03ae-44af-aac3-6bbf9b88ea78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:43.162246 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee478971-03ae-44af-aac3-6bbf9b88ea78 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:43.162530 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee478971-03ae-44af-aac3-6bbf9b88ea78 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:43.162803 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee478971-03ae-44af-aac3-6bbf9b88ea78 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:43.173539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee478971-03ae-44af-aac3-6bbf9b88ea78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:43.181834 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-ee478971-03ae-44af-aac3-6bbf9b88ea78 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:52:43.181834 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:43.181834 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:43.181834 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:43.181834 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:43.181834 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:43.181834 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:43.181834 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:43.181834 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:43.181834 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:43.181834 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:43.181834 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:43.181834 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:43.181834 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:43.181834 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:43.181834 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:43.182836 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:43.182836 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:43.182836 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:43.182836 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:43.182836 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:43.182836 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:43.182836 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:43.182836 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:43.182836 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:43.182836 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:43.182836 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:43.182836 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:43.182836 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:43.182836 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:43.182836 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:43.182836 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:43.183776 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:43.183776 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:43.183776 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:43.183776 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:43.183776 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:43.183776 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:43.183776 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:43.183776 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:43.183776 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:43.183776 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:43.183776 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:52:43.183776 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:43.183776 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 432/879] 10.222.0.24 () {56 vars in 1120 bytes} [Thu May 19 14:52:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:43.191589 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8a2d4-adee-40bb-9388-a8aea1aa4338 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:43.281300 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:43.300891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8a2d4-adee-40bb-9388-a8aea1aa4338 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:43.347635 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c73a72-8dd3-4e2a-a220-519c0be38f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:43.348318 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c73a72-8dd3-4e2a-a220-519c0be38f2a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:43.348600 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c73a72-8dd3-4e2a-a220-519c0be38f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:43.348877 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c73a72-8dd3-4e2a-a220-519c0be38f2a None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:43.349627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c73a72-8dd3-4e2a-a220-519c0be38f2a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:43.349932 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c73a72-8dd3-4e2a-a220-519c0be38f2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:43.351327 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c73a72-8dd3-4e2a-a220-519c0be38f2a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:43.360925 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 448/880] 10.222.0.24 () {56 vars in 1115 bytes} [Thu May 19 14:52:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:43.366556 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee478971-03ae-44af-aac3-6bbf9b88ea78 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:43.468095 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:43.492285 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee478971-03ae-44af-aac3-6bbf9b88ea78 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:43.528990 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71210fc4-3d3c-4c18-a56a-6d43d8d198c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:43.530677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71210fc4-3d3c-4c18-a56a-6d43d8d198c7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:43.531189 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71210fc4-3d3c-4c18-a56a-6d43d8d198c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:43.531710 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71210fc4-3d3c-4c18-a56a-6d43d8d198c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:43.542902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71210fc4-3d3c-4c18-a56a-6d43d8d198c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:43.544631 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71210fc4-3d3c-4c18-a56a-6d43d8d198c7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:43.562655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-71210fc4-3d3c-4c18-a56a-6d43d8d198c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:43.562655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:43.562655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:43.562655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:43.562655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:43.562655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:43.562655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:43.562655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:43.562655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:43.562655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:43.562655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:43.562655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:43.562655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:43.562655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:43.562655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:43.563656 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:43.563656 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:43.563656 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:43.563656 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:43.563656 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:43.563656 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:43.563656 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:43.563656 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:43.563656 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:43.563656 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:43.563656 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:43.563656 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:43.563656 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:43.563656 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:43.563656 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:43.563656 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:43.563656 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:43.564545 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:43.564545 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:43.564545 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:43.564545 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:43.566790 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 433/881] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:43.572601 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c73a72-8dd3-4e2a-a220-519c0be38f2a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:43.601337 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403949f-b256-44fd-a13a-dc319b79ec75 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:43.601667 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403949f-b256-44fd-a13a-dc319b79ec75 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:43.601898 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403949f-b256-44fd-a13a-dc319b79ec75 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:43.603680 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 434/882] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:52:43.610912 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30cd17-c9b4-4ede-987b-016cf173c3ae None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:43.611230 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30cd17-c9b4-4ede-987b-016cf173c3ae None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:43.611508 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30cd17-c9b4-4ede-987b-016cf173c3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:43.629951 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9e30cd17-c9b4-4ede-987b-016cf173c3ae None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:43.631156 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9e30cd17-c9b4-4ede-987b-016cf173c3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:43.689672 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c73a72-8dd3-4e2a-a220-519c0be38f2a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:43.707957 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 435/883] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:43 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:52:43.720787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b09eb-cef6-4e1e-aa69-b35c5473a9ff None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:43.721029 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b09eb-cef6-4e1e-aa69-b35c5473a9ff None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:43.721317 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b09eb-cef6-4e1e-aa69-b35c5473a9ff None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:43.723319 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 436/884] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:43 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:43.728520 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78207c38-f1ce-430b-83da-298876f85e85 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:43.728811 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78207c38-f1ce-430b-83da-298876f85e85 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:43.729091 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78207c38-f1ce-430b-83da-298876f85e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:43.733256 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662149bb-3d0f-4679-a8f2-29465c85de34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:43.733913 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662149bb-3d0f-4679-a8f2-29465c85de34 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:43.734196 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662149bb-3d0f-4679-a8f2-29465c85de34 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:43.734470 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662149bb-3d0f-4679-a8f2-29465c85de34 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:43.735192 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662149bb-3d0f-4679-a8f2-29465c85de34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:43.735526 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662149bb-3d0f-4679-a8f2-29465c85de34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:43.736887 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662149bb-3d0f-4679-a8f2-29465c85de34 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:43.748892 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-78207c38-f1ce-430b-83da-298876f85e85 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:43.749633 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 449/885] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:43.750451 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662149bb-3d0f-4679-a8f2-29465c85de34 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:43.750584 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-78207c38-f1ce-430b-83da-298876f85e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:43.754730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:43.820756 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:43.830550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 437/886] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:43 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:52:43.831816 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78207c38-f1ce-430b-83da-298876f85e85 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:43.862832 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662149bb-3d0f-4679-a8f2-29465c85de34 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:43.895926 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcec73-d4b9-429e-b0a1-ac96dcfd6e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:43.896718 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcec73-d4b9-429e-b0a1-ac96dcfd6e3e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:43.897002 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcec73-d4b9-429e-b0a1-ac96dcfd6e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:43.897542 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcec73-d4b9-429e-b0a1-ac96dcfd6e3e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:43.897913 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcec73-d4b9-429e-b0a1-ac96dcfd6e3e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:43.899298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcec73-d4b9-429e-b0a1-ac96dcfd6e3e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:43.911658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-57dcec73-d4b9-429e-b0a1-ac96dcfd6e3e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:52:43.911658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:43.911658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:43.911658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:43.911658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:43.911658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:43.911658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:43.911658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:43.911658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:52:43.911658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:43.911658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:43.911658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:43.911658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:43.911658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:43.911658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:43.911658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:43.911658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:43.912843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:43.912843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:43.912843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:43.912843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:43.912843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:43.912843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:43.912843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:43.912843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:43.912843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:43.912843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:43.912843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:43.912843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:43.912843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:43.912843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:43.912843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:43.912843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:43.913801 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:43.913801 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:43.913801 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:43.913801 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:43.913801 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:43.913801 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:43.913801 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:43.913801 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:43.913801 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:43.913801 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:43.913801 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:43.913801 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:43.913801 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:52:43.913801 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:43.913801 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 450/887] 10.222.0.24 () {56 vars in 1126 bytes} [Thu May 19 14:52:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:43.915134 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ed62e-3ceb-4533-a499-692f6e821a26 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:43.915134 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ed62e-3ceb-4533-a499-692f6e821a26 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:43.915134 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ed62e-3ceb-4533-a499-692f6e821a26 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:43.919552 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 451/888] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:43.919552 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ed62e-3ceb-4533-a499-692f6e821a26 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:43.937576 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78207c38-f1ce-430b-83da-298876f85e85 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:43.971005 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0c870-8d67-4d6a-a99f-46365f38032d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:43.971854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0c870-8d67-4d6a-a99f-46365f38032d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:43.972210 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0c870-8d67-4d6a-a99f-46365f38032d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:43.972552 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0c870-8d67-4d6a-a99f-46365f38032d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:43.979577 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0c870-8d67-4d6a-a99f-46365f38032d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:43.981048 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0c870-8d67-4d6a-a99f-46365f38032d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:43.987111 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:43.996979 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-80f0c870-8d67-4d6a-a99f-46365f38032d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:52:43.996979 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:43.996979 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:43.996979 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:43.996979 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:43.996979 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:43.996979 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:43.996979 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:43.996979 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:43.996979 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:43.996979 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:43.996979 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:43.996979 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:43.996979 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:43.996979 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:43.996979 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:43.998021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:43.998021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:43.998021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:43.998021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:43.998021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:43.998021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:43.998021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:43.998021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:43.998021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:43.998021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:43.998021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:43.998021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:43.998021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:43.998021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:43.998021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:43.998021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:43.998021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:43.998021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:43.998953 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:43.998953 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:43.998953 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:43.998953 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:43.998953 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:43.998953 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:43.998953 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:43.998953 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:43.998953 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:52:43.998953 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:43.998953 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 438/889] 10.222.0.24 () {56 vars in 1117 bytes} [Thu May 19 14:52:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:43.998953 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0c870-8d67-4d6a-a99f-46365f38032d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:44.025707 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ed62e-3ceb-4533-a499-692f6e821a26 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:44.052259 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:44.059361 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b28fa-a130-4d61-81be-e608cde35d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:44.060219 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b28fa-a130-4d61-81be-e608cde35d78 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:44.060605 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b28fa-a130-4d61-81be-e608cde35d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:44.060866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b28fa-a130-4d61-81be-e608cde35d78 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:44.061519 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b28fa-a130-4d61-81be-e608cde35d78 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:44.062883 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b28fa-a130-4d61-81be-e608cde35d78 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:44.074903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-3b1b28fa-a130-4d61-81be-e608cde35d78 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:52:44.074903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:44.074903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:44.074903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:44.074903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:44.074903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:44.074903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:44.074903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:44.074903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:52:44.074903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:44.074903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:44.074903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:44.074903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:44.074903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:44.074903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:44.074903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:44.075946 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:44.075946 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:44.075946 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:44.075946 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:44.075946 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:44.075946 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:44.075946 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:44.075946 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:44.075946 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:44.075946 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:44.075946 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:44.075946 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:44.075946 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:44.075946 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:44.075946 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:44.075946 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:44.081974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:44.081974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:44.081974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:44.081974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:44.081974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:44.081974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:44.081974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:44.081974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:44.081974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:44.081974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:44.081974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:44.081974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:44.081974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:44.081974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:52:44.081974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:44.081974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 452/890] 10.222.0.24 () {56 vars in 1132 bytes} [Thu May 19 14:52:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:44.082834 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30c68d-3137-45cc-82c9-3fd90dee3b74 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:44.082834 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30c68d-3137-45cc-82c9-3fd90dee3b74 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:44.082834 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30c68d-3137-45cc-82c9-3fd90dee3b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:44.095709 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0c870-8d67-4d6a-a99f-46365f38032d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:44.096545 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9a30c68d-3137-45cc-82c9-3fd90dee3b74 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:44.097718 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9a30c68d-3137-45cc-82c9-3fd90dee3b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:44.129423 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbf389-4ced-498b-bb36-10c4badc33b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:44.130092 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbf389-4ced-498b-bb36-10c4badc33b4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:44.130380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbf389-4ced-498b-bb36-10c4badc33b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:44.130661 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbf389-4ced-498b-bb36-10c4badc33b4 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:44.131413 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dbf389-4ced-498b-bb36-10c4badc33b4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:44.131730 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dbf389-4ced-498b-bb36-10c4badc33b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:44.133100 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dbf389-4ced-498b-bb36-10c4badc33b4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:44.137675 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 439/891] 10.222.0.24 () {56 vars in 1122 bytes} [Thu May 19 14:52:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:44.138932 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbf389-4ced-498b-bb36-10c4badc33b4 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:44.163511 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 453/892] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:44 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:44.164329 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30c68d-3137-45cc-82c9-3fd90dee3b74 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:44.233794 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:44.240043 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbf389-4ced-498b-bb36-10c4badc33b4 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:44.258196 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:44.273568 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30c68d-3137-45cc-82c9-3fd90dee3b74 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:44.274621 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40d3dd-b00b-4c41-a4a1-c73adc484e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:44.275323 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40d3dd-b00b-4c41-a4a1-c73adc484e4c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:44.275606 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40d3dd-b00b-4c41-a4a1-c73adc484e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:44.275888 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40d3dd-b00b-4c41-a4a1-c73adc484e4c None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:44.276709 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40d3dd-b00b-4c41-a4a1-c73adc484e4c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:44.277018 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40d3dd-b00b-4c41-a4a1-c73adc484e4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:44.278448 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40d3dd-b00b-4c41-a4a1-c73adc484e4c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:44.299654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 440/893] 10.222.0.24 () {56 vars in 1149 bytes} [Thu May 19 14:52:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:44.299654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40d3dd-b00b-4c41-a4a1-c73adc484e4c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:44.311666 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206f638-5786-41e5-9282-df1ae0adbd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:44.312336 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206f638-5786-41e5-9282-df1ae0adbd47 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:44.312619 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206f638-5786-41e5-9282-df1ae0adbd47 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:44.312893 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206f638-5786-41e5-9282-df1ae0adbd47 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:44.313611 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206f638-5786-41e5-9282-df1ae0adbd47 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:44.313917 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206f638-5786-41e5-9282-df1ae0adbd47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:44.315793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206f638-5786-41e5-9282-df1ae0adbd47 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:44.319966 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 454/894] 10.222.0.24 () {56 vars in 1126 bytes} [Thu May 19 14:52:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:44.320744 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206f638-5786-41e5-9282-df1ae0adbd47 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:44.400568 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40d3dd-b00b-4c41-a4a1-c73adc484e4c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:44.423129 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206f638-5786-41e5-9282-df1ae0adbd47 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:44.433317 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc394e1d-c406-432b-a012-f03aa997e9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:44.433986 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc394e1d-c406-432b-a012-f03aa997e9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:44.434278 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc394e1d-c406-432b-a012-f03aa997e9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:44.434554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc394e1d-c406-432b-a012-f03aa997e9d5 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:44.435307 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc394e1d-c406-432b-a012-f03aa997e9d5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:44.435621 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc394e1d-c406-432b-a012-f03aa997e9d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:44.436994 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc394e1d-c406-432b-a012-f03aa997e9d5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:44.441427 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 441/895] 10.222.0.24 () {56 vars in 1122 bytes} [Thu May 19 14:52:44 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:44.442193 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc394e1d-c406-432b-a012-f03aa997e9d5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:44.449449 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:44.461707 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734b3fd-42d5-40ef-ad50-0aa391a1d2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:44.462533 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734b3fd-42d5-40ef-ad50-0aa391a1d2f6 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:44.462817 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734b3fd-42d5-40ef-ad50-0aa391a1d2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:44.463094 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734b3fd-42d5-40ef-ad50-0aa391a1d2f6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:44.463807 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734b3fd-42d5-40ef-ad50-0aa391a1d2f6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:44.465215 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734b3fd-42d5-40ef-ad50-0aa391a1d2f6 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:44.478607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-d734b3fd-42d5-40ef-ad50-0aa391a1d2f6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:52:44.478607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:44.478607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:44.478607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:44.478607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:44.478607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:44.478607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:44.478607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:44.478607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:52:44.478607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:44.478607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:44.478607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:44.478607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:44.478607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:44.478607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:44.478607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:44.478607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:44.480712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:44.480712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:44.480712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:44.480712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:44.480712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:44.480712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:44.480712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:44.480712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:44.480712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:44.480712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:44.480712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:44.480712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:44.480712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:44.480712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:44.480712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:44.480712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:44.482357 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:44.482357 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:44.482357 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:44.482357 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:44.482357 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:44.482357 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:44.482357 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:44.482357 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:44.482357 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:44.482357 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:44.482357 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:44.482357 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:44.482357 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:52:44.482357 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:44.482357 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 455/896] 10.222.0.24 () {56 vars in 1114 bytes} [Thu May 19 14:52:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:44.485978 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734b3fd-42d5-40ef-ad50-0aa391a1d2f6 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:44.495643 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:44.563976 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc394e1d-c406-432b-a012-f03aa997e9d5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:44.601588 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734b3fd-42d5-40ef-ad50-0aa391a1d2f6 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:44.602638 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e0122-d2dc-49e5-a6bf-b29cb622d5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:44.603343 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e0122-d2dc-49e5-a6bf-b29cb622d5cf None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:44.603636 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e0122-d2dc-49e5-a6bf-b29cb622d5cf None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:44.603915 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e0122-d2dc-49e5-a6bf-b29cb622d5cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:44.653721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23785f3b-53ae-47e5-941c-30937436f69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:44.654425 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23785f3b-53ae-47e5-941c-30937436f69d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:44.654701 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23785f3b-53ae-47e5-941c-30937436f69d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:44.655251 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23785f3b-53ae-47e5-941c-30937436f69d None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:44.655710 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23785f3b-53ae-47e5-941c-30937436f69d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:44.656010 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23785f3b-53ae-47e5-941c-30937436f69d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:44.657364 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23785f3b-53ae-47e5-941c-30937436f69d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:44.666894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 456/897] 10.222.0.24 () {56 vars in 1126 bytes} [Thu May 19 14:52:44 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:44.666894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23785f3b-53ae-47e5-941c-30937436f69d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:44.689743 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e0122-d2dc-49e5-a6bf-b29cb622d5cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:44.691273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e0122-d2dc-49e5-a6bf-b29cb622d5cf None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:44.722758 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:44.734301 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:44.771876 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23785f3b-53ae-47e5-941c-30937436f69d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:44.798629 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 442/898] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:52:44 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:52:44.799606 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e0122-d2dc-49e5-a6bf-b29cb622d5cf None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:44.812772 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706bc70-5ce2-4f19-b6f4-9b30d2c5015c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:44.813434 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706bc70-5ce2-4f19-b6f4-9b30d2c5015c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:44.813710 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706bc70-5ce2-4f19-b6f4-9b30d2c5015c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:44.814015 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706bc70-5ce2-4f19-b6f4-9b30d2c5015c None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:44.814669 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706bc70-5ce2-4f19-b6f4-9b30d2c5015c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:44.815177 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706bc70-5ce2-4f19-b6f4-9b30d2c5015c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:44.816365 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706bc70-5ce2-4f19-b6f4-9b30d2c5015c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:44.826697 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 457/899] 10.222.0.24 () {56 vars in 1114 bytes} [Thu May 19 14:52:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:44.826697 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706bc70-5ce2-4f19-b6f4-9b30d2c5015c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:44.910682 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e0122-d2dc-49e5-a6bf-b29cb622d5cf None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:44.937551 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706bc70-5ce2-4f19-b6f4-9b30d2c5015c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:44.945777 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13811be7-f1b5-403e-9c1e-2d385566e333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:44.946435 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13811be7-f1b5-403e-9c1e-2d385566e333 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:44.946721 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13811be7-f1b5-403e-9c1e-2d385566e333 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:44.946996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13811be7-f1b5-403e-9c1e-2d385566e333 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:44.947815 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13811be7-f1b5-403e-9c1e-2d385566e333 None admin] RBAC: Adding query filter params (interface=public, service_id=adf0caf723074d64a4b09dc4b90f1ca6, region_id=RegionOne) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:44.948126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13811be7-f1b5-403e-9c1e-2d385566e333 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:44.949496 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13811be7-f1b5-403e-9c1e-2d385566e333 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:44.959351 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 443/900] 10.222.0.24 () {56 vars in 1251 bytes} [Thu May 19 14:52:44 2022] GET /identity/v3/endpoints?service_id=adf0caf723074d64a4b09dc4b90f1ca6&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:44.959351 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13811be7-f1b5-403e-9c1e-2d385566e333 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:44.961841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:44.965958 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:44.983854 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ede84-439f-488d-ba54-2656c436ebcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:44.984590 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ede84-439f-488d-ba54-2656c436ebcd None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:44.984873 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ede84-439f-488d-ba54-2656c436ebcd None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:44.985168 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ede84-439f-488d-ba54-2656c436ebcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:44.996563 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ede84-439f-488d-ba54-2656c436ebcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:44.998487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ede84-439f-488d-ba54-2656c436ebcd None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:45.016531 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-905ede84-439f-488d-ba54-2656c436ebcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:45.016531 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:45.016531 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:45.016531 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:45.016531 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:45.016531 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:45.016531 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:45.016531 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:45.016531 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:45.016531 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:45.016531 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:45.016531 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:45.016531 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:45.016531 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:45.016531 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:45.017489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:45.017489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:45.017489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:45.017489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:45.017489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:45.017489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:45.017489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:45.017489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:45.017489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:45.017489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:45.017489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:45.017489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:45.017489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:45.017489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:45.017489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:45.017489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:45.017489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:45.018411 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:45.018411 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:45.018411 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:45.018411 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:45.018411 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 458/901] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:45.019131 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ede84-439f-488d-ba54-2656c436ebcd None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:45.071095 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13811be7-f1b5-403e-9c1e-2d385566e333 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:45.113278 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b654f8-a376-4e33-a82d-dac7df56a3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:45.113985 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b654f8-a376-4e33-a82d-dac7df56a3c6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:45.114485 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b654f8-a376-4e33-a82d-dac7df56a3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:45.114792 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b654f8-a376-4e33-a82d-dac7df56a3c6 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:45.116178 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b654f8-a376-4e33-a82d-dac7df56a3c6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:45.116502 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b654f8-a376-4e33-a82d-dac7df56a3c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:45.118550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b654f8-a376-4e33-a82d-dac7df56a3c6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:45.121076 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ede84-439f-488d-ba54-2656c436ebcd None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:45.126174 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 444/902] 10.222.0.24 () {56 vars in 1114 bytes} [Thu May 19 14:52:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:45.127294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b654f8-a376-4e33-a82d-dac7df56a3c6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:45.162385 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce99328-1f58-4c4b-bb5f-9dfaa6e282be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:45.163235 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce99328-1f58-4c4b-bb5f-9dfaa6e282be None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:45.163519 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce99328-1f58-4c4b-bb5f-9dfaa6e282be None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:45.164117 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce99328-1f58-4c4b-bb5f-9dfaa6e282be None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:45.165095 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce99328-1f58-4c4b-bb5f-9dfaa6e282be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:45.166702 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce99328-1f58-4c4b-bb5f-9dfaa6e282be None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:45.181265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 459/903] 10.222.0.24 () {56 vars in 1087 bytes} [Thu May 19 14:52:45 2022] GET /identity/v3/services => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 14:52:45.181265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce99328-1f58-4c4b-bb5f-9dfaa6e282be None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:45.203566 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:45.225465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:45.252541 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b654f8-a376-4e33-a82d-dac7df56a3c6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:45.304718 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829c22d-c104-4ba7-8a05-56e37f00b540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:45.305749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829c22d-c104-4ba7-8a05-56e37f00b540 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:45.306423 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829c22d-c104-4ba7-8a05-56e37f00b540 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:45.307057 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829c22d-c104-4ba7-8a05-56e37f00b540 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:45.307927 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829c22d-c104-4ba7-8a05-56e37f00b540 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:45.308341 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829c22d-c104-4ba7-8a05-56e37f00b540 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:45.308799 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce99328-1f58-4c4b-bb5f-9dfaa6e282be None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:45.309930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829c22d-c104-4ba7-8a05-56e37f00b540 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:45.326331 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 445/904] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:45.332056 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829c22d-c104-4ba7-8a05-56e37f00b540 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:45.373486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139de4f-a863-4de2-a858-9b6686cbb40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:45.374169 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139de4f-a863-4de2-a858-9b6686cbb40b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:45.374452 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139de4f-a863-4de2-a858-9b6686cbb40b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:45.374727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139de4f-a863-4de2-a858-9b6686cbb40b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:45.375597 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5139de4f-a863-4de2-a858-9b6686cbb40b None admin] RBAC: Adding query filter params (interface=public, service_id=782d41f68a39448ab358262a39161aae, region_id=RegionOne) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:45.375911 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5139de4f-a863-4de2-a858-9b6686cbb40b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:45.377296 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5139de4f-a863-4de2-a858-9b6686cbb40b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:45.383350 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 460/905] 10.222.0.24 () {56 vars in 1251 bytes} [Thu May 19 14:52:45 2022] GET /identity/v3/endpoints?service_id=782d41f68a39448ab358262a39161aae&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:45.388476 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139de4f-a863-4de2-a858-9b6686cbb40b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:45.448749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829c22d-c104-4ba7-8a05-56e37f00b540 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:45.476335 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:45.486408 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce6d29-acba-42cc-963e-f0553f7b6918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:45.487531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce6d29-acba-42cc-963e-f0553f7b6918 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:45.487974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:45.488234 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce6d29-acba-42cc-963e-f0553f7b6918 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:45.488742 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce6d29-acba-42cc-963e-f0553f7b6918 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:45.491839 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139de4f-a863-4de2-a858-9b6686cbb40b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:45.496895 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce6d29-acba-42cc-963e-f0553f7b6918 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:45.498789 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce6d29-acba-42cc-963e-f0553f7b6918 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:45.517506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-18ce6d29-acba-42cc-963e-f0553f7b6918 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:45.517506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:45.517506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:45.517506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:45.517506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:45.517506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:45.517506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:45.517506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:45.517506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:45.517506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:45.517506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:45.517506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:45.517506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:45.517506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:45.517506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:45.518441 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:45.518441 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:45.518441 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:45.518441 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:45.518441 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:45.518441 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:45.518441 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:45.518441 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:45.518441 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:45.518441 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:45.518441 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:45.518441 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:45.518441 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:45.518441 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:45.518441 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:45.518441 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:45.518441 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:45.519363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:45.519363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:45.519363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:45.519363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:45.519363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:45.519363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:45.519363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:45.519363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:45.522752 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 446/906] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:45.528670 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce6d29-acba-42cc-963e-f0553f7b6918 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:45.532043 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721167b-0082-4f2d-9082-0d1d688b5f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:45.532919 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721167b-0082-4f2d-9082-0d1d688b5f1d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:45.533380 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721167b-0082-4f2d-9082-0d1d688b5f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:45.533661 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721167b-0082-4f2d-9082-0d1d688b5f1d None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:45.534355 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721167b-0082-4f2d-9082-0d1d688b5f1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:45.535760 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721167b-0082-4f2d-9082-0d1d688b5f1d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:45.551700 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 461/907] 10.222.0.24 () {56 vars in 1087 bytes} [Thu May 19 14:52:45 2022] GET /identity/v3/services => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 14:52:45.649025 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce6d29-acba-42cc-963e-f0553f7b6918 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:45.686202 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde48165-1f22-4cf6-873c-8d0b460668d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:45.686894 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde48165-1f22-4cf6-873c-8d0b460668d7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:45.687185 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde48165-1f22-4cf6-873c-8d0b460668d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:45.687497 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde48165-1f22-4cf6-873c-8d0b460668d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:45.688309 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde48165-1f22-4cf6-873c-8d0b460668d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:45.688625 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde48165-1f22-4cf6-873c-8d0b460668d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:45.690088 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde48165-1f22-4cf6-873c-8d0b460668d7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:45.703971 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 447/908] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:52:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:45.709673 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721167b-0082-4f2d-9082-0d1d688b5f1d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:45.821065 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721167b-0082-4f2d-9082-0d1d688b5f1d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:45.856467 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c7e2b-4afc-4f39-bcad-1333f04d9c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:45.857162 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c7e2b-4afc-4f39-bcad-1333f04d9c47 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:45.857501 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c7e2b-4afc-4f39-bcad-1333f04d9c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:45.857784 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c7e2b-4afc-4f39-bcad-1333f04d9c47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:45.858669 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c7e2b-4afc-4f39-bcad-1333f04d9c47 None admin] RBAC: Adding query filter params (role.id=24772df324aa4eb7b66c7853b4b01439, scope.project.id=2633b53c336145bba3d4744dbdfe99b7, user.id=fcd1725924134616b903b3e374d45817) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:45.858987 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c7e2b-4afc-4f39-bcad-1333f04d9c47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:45.860449 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c7e2b-4afc-4f39-bcad-1333f04d9c47 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:45.866302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 462/909] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:52:45 2022] GET /identity/v3/role_assignments?user.id=fcd1725924134616b903b3e374d45817&scope.project.id=2633b53c336145bba3d4744dbdfe99b7&role.id=24772df324aa4eb7b66c7853b4b01439 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:46.693236 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330056c6-b681-4e08-a7e4-4536699ec921 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:46.693786 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330056c6-b681-4e08-a7e4-4536699ec921 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:46.693786 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330056c6-b681-4e08-a7e4-4536699ec921 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:46.695428 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 448/910] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:46.700888 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb9c5e-0a9c-4326-86d0-35c6301687f4 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:46.701273 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb9c5e-0a9c-4326-86d0-35c6301687f4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:46.701438 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb9c5e-0a9c-4326-86d0-35c6301687f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:46.718152 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d4cb9c5e-0a9c-4326-86d0-35c6301687f4 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:46.719368 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d4cb9c5e-0a9c-4326-86d0-35c6301687f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:46.740779 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:46.793267 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 463/911] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:46 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:46.815961 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330056c6-b681-4e08-a7e4-4536699ec921 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:46.868637 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:46.922157 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330056c6-b681-4e08-a7e4-4536699ec921 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:46.956359 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c9166-c859-4a0a-a10f-43c8fe26c3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:46.956949 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c9166-c859-4a0a-a10f-43c8fe26c3ca None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:46.957235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c9166-c859-4a0a-a10f-43c8fe26c3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:46.957512 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c9166-c859-4a0a-a10f-43c8fe26c3ca None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:46.958241 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c9166-c859-4a0a-a10f-43c8fe26c3ca None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:46.959649 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c9166-c859-4a0a-a10f-43c8fe26c3ca None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:46.978557 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 449/912] 10.222.0.24 () {60 vars in 1141 bytes} [Thu May 19 14:52:46 2022] POST /identity/v3/services => generated 241 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:52:47.525784 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e3bd5-f021-4e90-bd7f-d916c3f90123 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:47.526182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e3bd5-f021-4e90-bd7f-d916c3f90123 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:47.526369 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e3bd5-f021-4e90-bd7f-d916c3f90123 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:47.528051 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 464/913] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:47.533322 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf935dd-7bcb-4a2c-8e05-ca8ea6ec2a71 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:47.533625 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf935dd-7bcb-4a2c-8e05-ca8ea6ec2a71 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:47.533913 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf935dd-7bcb-4a2c-8e05-ca8ea6ec2a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:47.557417 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-abf935dd-7bcb-4a2c-8e05-ca8ea6ec2a71 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:47.558610 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-abf935dd-7bcb-4a2c-8e05-ca8ea6ec2a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:47.639240 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 450/914] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:47.661396 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e3bd5-f021-4e90-bd7f-d916c3f90123 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:47.778175 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e3bd5-f021-4e90-bd7f-d916c3f90123 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:47.814254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753b04b-2025-488b-bc08-923fb1c87db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:47.815480 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753b04b-2025-488b-bc08-923fb1c87db5 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:47.815961 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753b04b-2025-488b-bc08-923fb1c87db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:47.816431 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753b04b-2025-488b-bc08-923fb1c87db5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:47.817297 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753b04b-2025-488b-bc08-923fb1c87db5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:47.818849 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753b04b-2025-488b-bc08-923fb1c87db5 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:47.832118 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-3753b04b-2025-488b-bc08-923fb1c87db5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:52:47.832118 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:47.832118 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:47.832118 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:47.832118 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:47.832118 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:47.832118 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:47.832118 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:47.832118 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:52:47.832118 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:47.832118 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:47.832118 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:47.832118 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:47.832118 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:47.832118 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:47.832118 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:47.833099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:47.833099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:47.833099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:47.833099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:47.833099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:47.833099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:47.833099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:47.833099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:47.833099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:47.833099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:47.833099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:47.833099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:47.833099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:47.833099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:47.833099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:47.833099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:47.833930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:47.833930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:47.833930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:47.833930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:47.833930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:47.833930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:47.833930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:47.833930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:47.833930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:47.833930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:47.833930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:47.833930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:47.833930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:47.833930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 19 14:52:47.833930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:47.836850 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 465/915] 10.222.0.24 () {56 vars in 1132 bytes} [Thu May 19 14:52:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:47.843235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf935dd-7bcb-4a2c-8e05-ca8ea6ec2a71 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:47.878174 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:47.903161 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6af16-5898-4051-af7c-c70981e03e6d None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:47.903794 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6af16-5898-4051-af7c-c70981e03e6d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:47.904321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6af16-5898-4051-af7c-c70981e03e6d None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:47.906168 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 466/916] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:47.912045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd363b83-8fc0-4391-a0e7-c4573205342c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:47.912598 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd363b83-8fc0-4391-a0e7-c4573205342c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:47.913073 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd363b83-8fc0-4391-a0e7-c4573205342c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:47.930627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-fd363b83-8fc0-4391-a0e7-c4573205342c None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:47.932196 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-fd363b83-8fc0-4391-a0e7-c4573205342c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:47.949266 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:47.957900 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf935dd-7bcb-4a2c-8e05-ca8ea6ec2a71 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:47.993947 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b216c-0636-49de-99bf-d19114fab17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:47.994616 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b216c-0636-49de-99bf-d19114fab17b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:47.995145 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b216c-0636-49de-99bf-d19114fab17b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:47.995473 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b216c-0636-49de-99bf-d19114fab17b None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:47.996268 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b216c-0636-49de-99bf-d19114fab17b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:47.996485 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b216c-0636-49de-99bf-d19114fab17b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:47.998463 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b216c-0636-49de-99bf-d19114fab17b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:48.003809 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 451/917] 10.222.0.24 () {56 vars in 1126 bytes} [Thu May 19 14:52:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:48.008989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b216c-0636-49de-99bf-d19114fab17b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:48.019303 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 467/918] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:48.034589 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd363b83-8fc0-4391-a0e7-c4573205342c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:48.117029 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:48.121886 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b216c-0636-49de-99bf-d19114fab17b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:48.142804 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd363b83-8fc0-4391-a0e7-c4573205342c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:48.158310 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f72ee-f728-46f7-8a40-a8aaa7b2c87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:48.158920 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f72ee-f728-46f7-8a40-a8aaa7b2c87e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:48.159223 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f72ee-f728-46f7-8a40-a8aaa7b2c87e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:48.159512 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f72ee-f728-46f7-8a40-a8aaa7b2c87e None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:48.160339 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f72ee-f728-46f7-8a40-a8aaa7b2c87e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:48.160652 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f72ee-f728-46f7-8a40-a8aaa7b2c87e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:48.162047 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f72ee-f728-46f7-8a40-a8aaa7b2c87e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:48.173571 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 452/919] 10.222.0.24 () {56 vars in 1126 bytes} [Thu May 19 14:52:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:48.173571 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b6461-4223-48c3-bcb2-b77d8f2c8d6a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:48.173571 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b6461-4223-48c3-bcb2-b77d8f2c8d6a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:48.173571 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b6461-4223-48c3-bcb2-b77d8f2c8d6a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:48.173571 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 453/920] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:48.176801 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b6461-4223-48c3-bcb2-b77d8f2c8d6a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:48.188249 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c76c66-1dbe-4e48-b048-c0a4395418b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:48.189228 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c76c66-1dbe-4e48-b048-c0a4395418b7 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:48.189510 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c76c66-1dbe-4e48-b048-c0a4395418b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:48.189782 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c76c66-1dbe-4e48-b048-c0a4395418b7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:48.190567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c76c66-1dbe-4e48-b048-c0a4395418b7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:48.191973 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c76c66-1dbe-4e48-b048-c0a4395418b7 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:48.204876 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-b8c76c66-1dbe-4e48-b048-c0a4395418b7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:52:48.204876 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:48.204876 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:48.204876 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:48.204876 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:48.204876 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:48.204876 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:48.204876 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:48.204876 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:52:48.204876 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:48.204876 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:48.204876 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:48.204876 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:48.204876 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:48.204876 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:48.204876 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:48.204876 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:48.205894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:48.205894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:48.205894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:48.205894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:48.205894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:48.205894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:48.205894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:48.205894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:48.205894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:48.205894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:48.205894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:48.205894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:48.205894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:48.205894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:48.205894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:48.205894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:48.206727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:48.206727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:48.206727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:48.206727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:48.206727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:48.206727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:48.206727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:48.206727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:48.206727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:48.206727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:48.206727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:48.206727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:48.206727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 19 14:52:48.206727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:48.206727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 468/921] 10.222.0.24 () {56 vars in 1114 bytes} [Thu May 19 14:52:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:48.207935 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12670b43-fcc0-4a8b-93ef-63d946ce0ff7 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:48.208293 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12670b43-fcc0-4a8b-93ef-63d946ce0ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:48.208425 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12670b43-fcc0-4a8b-93ef-63d946ce0ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:48.231090 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-12670b43-fcc0-4a8b-93ef-63d946ce0ff7 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:48.232834 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-12670b43-fcc0-4a8b-93ef-63d946ce0ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:48.250754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:48.309563 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b6461-4223-48c3-bcb2-b77d8f2c8d6a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:48.314604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 469/922] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:48.314604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12670b43-fcc0-4a8b-93ef-63d946ce0ff7 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:48.361540 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe817b-69d1-47e9-a80c-40e828a8e34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:48.362215 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe817b-69d1-47e9-a80c-40e828a8e34d None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:48.362500 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe817b-69d1-47e9-a80c-40e828a8e34d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:48.362777 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe817b-69d1-47e9-a80c-40e828a8e34d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:48.363558 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe817b-69d1-47e9-a80c-40e828a8e34d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:48.365390 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe817b-69d1-47e9-a80c-40e828a8e34d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:48.385474 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 454/923] 10.222.0.24 () {60 vars in 1144 bytes} [Thu May 19 14:52:48 2022] POST /identity/v3/endpoints => generated 347 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:52:48.386277 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe817b-69d1-47e9-a80c-40e828a8e34d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:48.420294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:48.451548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12670b43-fcc0-4a8b-93ef-63d946ce0ff7 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:48.507484 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501d6ac-91a0-4c93-bc65-d184b6e043bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:48.508347 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501d6ac-91a0-4c93-bc65-d184b6e043bb None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:48.508752 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501d6ac-91a0-4c93-bc65-d184b6e043bb None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:48.509152 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501d6ac-91a0-4c93-bc65-d184b6e043bb None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:48.509948 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501d6ac-91a0-4c93-bc65-d184b6e043bb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:48.510414 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501d6ac-91a0-4c93-bc65-d184b6e043bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:48.512128 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501d6ac-91a0-4c93-bc65-d184b6e043bb None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:48.522594 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 470/924] 10.222.0.24 () {56 vars in 1114 bytes} [Thu May 19 14:52:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:48.524702 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501d6ac-91a0-4c93-bc65-d184b6e043bb None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:48.531275 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:48.533330 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe817b-69d1-47e9-a80c-40e828a8e34d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:48.597375 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030afd8-b30c-4f3e-b5c6-f11a6f8db374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:48.598453 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030afd8-b30c-4f3e-b5c6-f11a6f8db374 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:48.598806 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030afd8-b30c-4f3e-b5c6-f11a6f8db374 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:48.599154 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030afd8-b30c-4f3e-b5c6-f11a6f8db374 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:48.613406 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030afd8-b30c-4f3e-b5c6-f11a6f8db374 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:48.621902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-7030afd8-b30c-4f3e-b5c6-f11a6f8db374 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:52:48.621902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:48.621902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:48.621902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:48.621902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:48.621902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:48.621902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:48.621902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:48.621902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:48.621902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:48.621902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:48.621902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:48.621902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:48.621902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:48.621902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:48.621902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:48.623019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:48.623019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:48.623019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:48.623019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:48.623019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:48.623019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:48.623019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:48.623019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:48.623019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:48.623019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:48.623019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:48.623019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:48.623019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:48.623019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:48.623019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:48.623019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:48.623894 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:48.623894 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:48.623894 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:48.623894 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:48.623894 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:48.623894 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:48.623894 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:48.623894 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:48.623894 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:48.623894 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:48.623894 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:52:48.623894 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:48.623894 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 455/925] 10.222.0.24 () {56 vars in 1120 bytes} [Thu May 19 14:52:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:48.629642 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030afd8-b30c-4f3e-b5c6-f11a6f8db374 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:48.665903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501d6ac-91a0-4c93-bc65-d184b6e043bb None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:48.701894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9c5be-fda9-449c-aba0-247b97b78fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:48.702512 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9c5be-fda9-449c-aba0-247b97b78fdc None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:48.702826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9c5be-fda9-449c-aba0-247b97b78fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:48.703289 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9c5be-fda9-449c-aba0-247b97b78fdc None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:48.704004 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f9c5be-fda9-449c-aba0-247b97b78fdc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:48.704312 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f9c5be-fda9-449c-aba0-247b97b78fdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:48.705681 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f9c5be-fda9-449c-aba0-247b97b78fdc None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:48.711587 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 471/926] 10.222.0.24 () {56 vars in 1114 bytes} [Thu May 19 14:52:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:48.717533 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9c5be-fda9-449c-aba0-247b97b78fdc None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:48.743620 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:48.755874 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030afd8-b30c-4f3e-b5c6-f11a6f8db374 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:48.792939 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01629e63-118d-416f-9511-87220b682b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:48.793778 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01629e63-118d-416f-9511-87220b682b32 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:48.793908 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01629e63-118d-416f-9511-87220b682b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:48.794150 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01629e63-118d-416f-9511-87220b682b32 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:48.794935 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01629e63-118d-416f-9511-87220b682b32 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:48.795265 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01629e63-118d-416f-9511-87220b682b32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:48.796644 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01629e63-118d-416f-9511-87220b682b32 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:48.805161 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 456/927] 10.222.0.24 () {56 vars in 1115 bytes} [Thu May 19 14:52:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:48.810628 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01629e63-118d-416f-9511-87220b682b32 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:48.813998 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:48.866372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9c5be-fda9-449c-aba0-247b97b78fdc None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:48.919211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01629e63-118d-416f-9511-87220b682b32 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:48.919921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837fd0f-cf8d-4bb0-be28-3454dcf06357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:48.920799 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837fd0f-cf8d-4bb0-be28-3454dcf06357 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:48.921226 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837fd0f-cf8d-4bb0-be28-3454dcf06357 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:48.921969 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837fd0f-cf8d-4bb0-be28-3454dcf06357 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:48.922875 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837fd0f-cf8d-4bb0-be28-3454dcf06357 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:48.925410 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837fd0f-cf8d-4bb0-be28-3454dcf06357 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:48.950128 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 472/928] 10.222.0.24 () {60 vars in 1144 bytes} [Thu May 19 14:52:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:52:48.972526 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e63e05-3199-4b2d-aa5b-3ed10f0e17a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:48.973947 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e63e05-3199-4b2d-aa5b-3ed10f0e17a3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:48.974625 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e63e05-3199-4b2d-aa5b-3ed10f0e17a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:48.975281 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e63e05-3199-4b2d-aa5b-3ed10f0e17a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:48.979424 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:48.991411 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e63e05-3199-4b2d-aa5b-3ed10f0e17a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:48.993249 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e63e05-3199-4b2d-aa5b-3ed10f0e17a3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:49.013245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-c5e63e05-3199-4b2d-aa5b-3ed10f0e17a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:49.013245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:49.013245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:49.013245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:49.013245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:49.013245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:49.013245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:49.013245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:49.013245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:49.013245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:49.013245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:49.013245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:49.013245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:49.013245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:49.013245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:49.014677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:49.014677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:49.014677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:49.014677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:49.014677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:49.014677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:49.014677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:49.014677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:49.014677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:49.014677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:49.014677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:49.014677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:49.014677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:49.014677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:49.014677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:49.014677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:49.014677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:49.016157 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:49.016157 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:49.016157 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:49.016157 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:49.016157 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 457/929] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:49.020962 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837fd0f-cf8d-4bb0-be28-3454dcf06357 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:49.139171 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837fd0f-cf8d-4bb0-be28-3454dcf06357 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:49.165917 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:49.181878 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed3038-9ba8-4f18-838d-e3cca8762cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:49.182578 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed3038-9ba8-4f18-838d-e3cca8762cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:49.182862 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed3038-9ba8-4f18-838d-e3cca8762cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:49.183138 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed3038-9ba8-4f18-838d-e3cca8762cb0 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:49.183918 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed3038-9ba8-4f18-838d-e3cca8762cb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:49.184231 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed3038-9ba8-4f18-838d-e3cca8762cb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:49.186203 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed3038-9ba8-4f18-838d-e3cca8762cb0 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:49.200487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 473/930] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:49.206787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e63e05-3199-4b2d-aa5b-3ed10f0e17a3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:49.323840 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e63e05-3199-4b2d-aa5b-3ed10f0e17a3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:49.359851 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc9085-929e-4132-9933-3b78f6d4fda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:49.360673 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc9085-929e-4132-9933-3b78f6d4fda0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:49.360960 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc9085-929e-4132-9933-3b78f6d4fda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:49.361242 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc9085-929e-4132-9933-3b78f6d4fda0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:49.369148 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc9085-929e-4132-9933-3b78f6d4fda0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:49.370872 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc9085-929e-4132-9933-3b78f6d4fda0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:49.374157 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cf2de-36dd-4884-9e2f-34b5a84a08c7 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:49.374446 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cf2de-36dd-4884-9e2f-34b5a84a08c7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:49.374723 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cf2de-36dd-4884-9e2f-34b5a84a08c7 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:49.376347 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 474/931] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:49.381502 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a39616-59b5-4817-a21a-03bf1c3212d1 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:49.381793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a39616-59b5-4817-a21a-03bf1c3212d1 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:49.382076 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a39616-59b5-4817-a21a-03bf1c3212d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:49.386562 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-b2bc9085-929e-4132-9933-3b78f6d4fda0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:52:49.386562 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:49.386562 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:49.386562 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:49.386562 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:49.386562 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:49.386562 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:49.386562 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:49.386562 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:49.386562 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:49.386562 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:49.386562 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:49.386562 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:49.386562 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:49.386562 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:49.386562 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:49.387507 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:49.387507 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:49.387507 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:49.387507 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:49.387507 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:49.387507 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:49.387507 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:49.387507 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:49.387507 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:49.387507 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:49.387507 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:49.387507 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:49.387507 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:49.387507 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:49.387507 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:49.387507 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:49.387507 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:49.387507 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:49.388709 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:49.388709 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:49.388709 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:49.388709 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:49.388709 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:49.388709 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:49.388709 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:49.388709 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:49.388709 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:52:49.388709 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:49.388709 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 458/932] 10.222.0.24 () {56 vars in 1117 bytes} [Thu May 19 14:52:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:49.393148 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc9085-929e-4132-9933-3b78f6d4fda0 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:49.402074 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-23a39616-59b5-4817-a21a-03bf1c3212d1 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:49.403383 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-23a39616-59b5-4817-a21a-03bf1c3212d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:49.447870 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:49.479445 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 475/933] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:49.495779 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a39616-59b5-4817-a21a-03bf1c3212d1 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:49.501775 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc9085-929e-4132-9933-3b78f6d4fda0 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:49.537000 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1d505-4d3d-4830-8655-ae07a5c59a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:49.537731 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1d505-4d3d-4830-8655-ae07a5c59a2e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:49.538011 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1d505-4d3d-4830-8655-ae07a5c59a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:49.538336 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1d505-4d3d-4830-8655-ae07a5c59a2e None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:49.539308 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1d505-4d3d-4830-8655-ae07a5c59a2e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:49.539622 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1d505-4d3d-4830-8655-ae07a5c59a2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:49.541177 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1d505-4d3d-4830-8655-ae07a5c59a2e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:49.561013 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 459/934] 10.222.0.24 () {56 vars in 1149 bytes} [Thu May 19 14:52:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:49.566588 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1d505-4d3d-4830-8655-ae07a5c59a2e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:49.608143 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a39616-59b5-4817-a21a-03bf1c3212d1 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:49.640839 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:49.653914 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a56878-cfbc-49ff-b510-1bb90d668061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:49.653914 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a56878-cfbc-49ff-b510-1bb90d668061 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:49.653914 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a56878-cfbc-49ff-b510-1bb90d668061 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:49.653914 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a56878-cfbc-49ff-b510-1bb90d668061 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:49.654647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a56878-cfbc-49ff-b510-1bb90d668061 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:49.657310 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a56878-cfbc-49ff-b510-1bb90d668061 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:49.679544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-e5a56878-cfbc-49ff-b510-1bb90d668061 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:52:49.679544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:49.679544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:49.679544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:49.679544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:49.679544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:49.679544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:49.679544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:49.679544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:52:49.679544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:49.679544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:49.679544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:49.679544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:49.679544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:49.679544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:49.679544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:49.679544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:49.680593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:49.680593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:49.680593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:49.680593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:49.680593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:49.680593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:49.680593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:49.680593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:49.680593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:49.680593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:49.680593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:49.680593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:49.680593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:49.680593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:49.680593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:49.680593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:49.681591 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:49.681591 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:49.681591 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:49.681591 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:49.681591 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:49.681591 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:49.681591 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:49.681591 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:49.681591 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:49.681591 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:49.681591 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:49.681591 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:49.681591 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:52:49.681591 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:49.681591 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 476/935] 10.222.0.24 () {56 vars in 1126 bytes} [Thu May 19 14:52:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:49.687809 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a56878-cfbc-49ff-b510-1bb90d668061 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:49.716210 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1d505-4d3d-4830-8655-ae07a5c59a2e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:49.724290 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:49.758823 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbf6d9-9a85-4be6-844b-f062178ce15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:49.760486 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbf6d9-9a85-4be6-844b-f062178ce15f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:49.761121 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbf6d9-9a85-4be6-844b-f062178ce15f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:49.761766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbf6d9-9a85-4be6-844b-f062178ce15f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:49.776622 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebbf6d9-9a85-4be6-844b-f062178ce15f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:49.779608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebbf6d9-9a85-4be6-844b-f062178ce15f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:49.806369 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-eebbf6d9-9a85-4be6-844b-f062178ce15f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:49.806369 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:49.806369 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:49.806369 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:49.806369 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:49.806369 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:49.806369 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:49.806369 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:49.806369 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:49.806369 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:49.806369 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:49.806369 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:49.806369 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:49.806369 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:49.806369 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:49.807787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:49.807787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:49.807787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:49.807787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:49.807787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:49.807787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:49.807787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:49.807787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:49.807787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:49.807787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:49.807787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:49.807787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:49.807787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:49.807787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:49.807787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:49.807787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:49.807787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:49.809150 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:49.809150 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:49.809150 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:49.809150 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:49.810696 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a56878-cfbc-49ff-b510-1bb90d668061 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:49.812533 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 460/936] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:49.817799 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbf6d9-9a85-4be6-844b-f062178ce15f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:49.853949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35990757-3e6f-4dd1-a8e8-0197b6c351dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:49.855422 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35990757-3e6f-4dd1-a8e8-0197b6c351dd None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:49.855907 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35990757-3e6f-4dd1-a8e8-0197b6c351dd None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:49.856374 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35990757-3e6f-4dd1-a8e8-0197b6c351dd None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:49.857842 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35990757-3e6f-4dd1-a8e8-0197b6c351dd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:49.858391 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35990757-3e6f-4dd1-a8e8-0197b6c351dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:49.860286 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35990757-3e6f-4dd1-a8e8-0197b6c351dd None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:49.871534 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 477/937] 10.222.0.24 () {56 vars in 1122 bytes} [Thu May 19 14:52:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:49.873531 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35990757-3e6f-4dd1-a8e8-0197b6c351dd None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:49.930264 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbf6d9-9a85-4be6-844b-f062178ce15f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:49.942696 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:49.967642 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d651b39-a167-4e4c-a113-94d853d91a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:49.968641 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d651b39-a167-4e4c-a113-94d853d91a62 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:49.969067 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d651b39-a167-4e4c-a113-94d853d91a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:49.969487 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d651b39-a167-4e4c-a113-94d853d91a62 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:49.970342 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d651b39-a167-4e4c-a113-94d853d91a62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:49.970791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d651b39-a167-4e4c-a113-94d853d91a62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:49.972423 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d651b39-a167-4e4c-a113-94d853d91a62 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:49.985404 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 461/938] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:49.994678 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d651b39-a167-4e4c-a113-94d853d91a62 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:50.020019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35990757-3e6f-4dd1-a8e8-0197b6c351dd None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:50.020854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:50.067532 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9436d9-c9c2-425c-bc80-ca04ec96194f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:50.068432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9436d9-c9c2-425c-bc80-ca04ec96194f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:50.068871 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9436d9-c9c2-425c-bc80-ca04ec96194f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:50.069146 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9436d9-c9c2-425c-bc80-ca04ec96194f None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:50.070275 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9436d9-c9c2-425c-bc80-ca04ec96194f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:50.070836 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9436d9-c9c2-425c-bc80-ca04ec96194f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:50.072862 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9436d9-c9c2-425c-bc80-ca04ec96194f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:50.081204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 478/939] 10.222.0.24 () {56 vars in 1122 bytes} [Thu May 19 14:52:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:50.086399 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9436d9-c9c2-425c-bc80-ca04ec96194f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:50.124301 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d651b39-a167-4e4c-a113-94d853d91a62 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:50.175978 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f5307-55e5-425c-b78e-fe95b1045f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:50.177254 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f5307-55e5-425c-b78e-fe95b1045f74 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:50.177730 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f5307-55e5-425c-b78e-fe95b1045f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:50.178238 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f5307-55e5-425c-b78e-fe95b1045f74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:50.189291 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f5307-55e5-425c-b78e-fe95b1045f74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:50.191960 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f5307-55e5-425c-b78e-fe95b1045f74 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:50.205183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9436d9-c9c2-425c-bc80-ca04ec96194f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:50.208387 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-707f5307-55e5-425c-b78e-fe95b1045f74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:50.208387 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:50.208387 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:50.208387 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:50.208387 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:50.208387 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:50.208387 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:50.208387 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:50.208387 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:50.208387 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:50.208387 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:50.208387 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:50.208387 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:50.208387 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:50.208387 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:50.209687 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:50.209687 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:50.209687 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:50.209687 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:50.209687 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:50.209687 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:50.209687 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:50.209687 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:50.209687 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:50.209687 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:50.209687 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:50.209687 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:50.209687 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:50.209687 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:50.209687 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:50.209687 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:50.209687 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:50.211646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:50.211646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:50.211646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:50.211646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:50.211646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:50.211646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:50.211646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:50.211646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:50.211646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 462/940] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:50.212512 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:50.218360 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f5307-55e5-425c-b78e-fe95b1045f74 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:50.258059 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714b5e9-6ff2-4bab-972f-88a27ac8053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:50.259122 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714b5e9-6ff2-4bab-972f-88a27ac8053c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:50.259795 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714b5e9-6ff2-4bab-972f-88a27ac8053c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:50.260273 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714b5e9-6ff2-4bab-972f-88a27ac8053c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:50.261269 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714b5e9-6ff2-4bab-972f-88a27ac8053c None admin] RBAC: Adding query filter params (interface=public, service_id=52f0a5523b564297a30c72f38408e0f6, region_id=RegionOne) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:50.261805 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714b5e9-6ff2-4bab-972f-88a27ac8053c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:50.263962 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9714b5e9-6ff2-4bab-972f-88a27ac8053c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:50.272057 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 479/941] 10.222.0.24 () {56 vars in 1251 bytes} [Thu May 19 14:52:50 2022] GET /identity/v3/endpoints?service_id=52f0a5523b564297a30c72f38408e0f6&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:50.280428 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714b5e9-6ff2-4bab-972f-88a27ac8053c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:50.310810 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:50.347967 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f5307-55e5-425c-b78e-fe95b1045f74 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:50.388382 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb35100-2d7f-4b44-9ffb-c78520d3a09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:50.389386 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb35100-2d7f-4b44-9ffb-c78520d3a09c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:50.389821 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb35100-2d7f-4b44-9ffb-c78520d3a09c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:50.390289 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb35100-2d7f-4b44-9ffb-c78520d3a09c None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:50.391262 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb35100-2d7f-4b44-9ffb-c78520d3a09c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:50.391719 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb35100-2d7f-4b44-9ffb-c78520d3a09c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:50.393477 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb35100-2d7f-4b44-9ffb-c78520d3a09c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:50.411689 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 463/942] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:52:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:50.412814 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb35100-2d7f-4b44-9ffb-c78520d3a09c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:50.421608 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714b5e9-6ff2-4bab-972f-88a27ac8053c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:50.469456 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027f0d1-6259-4a55-91a2-b1805d68e6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:50.470117 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027f0d1-6259-4a55-91a2-b1805d68e6cf None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:50.470396 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027f0d1-6259-4a55-91a2-b1805d68e6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:50.470666 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027f0d1-6259-4a55-91a2-b1805d68e6cf None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:50.471389 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027f0d1-6259-4a55-91a2-b1805d68e6cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:50.473293 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027f0d1-6259-4a55-91a2-b1805d68e6cf None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:50.487252 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 480/943] 10.222.0.24 () {56 vars in 1087 bytes} [Thu May 19 14:52:50 2022] GET /identity/v3/services => generated 1497 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 14:52:50.527930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb35100-2d7f-4b44-9ffb-c78520d3a09c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:50.566618 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03efa70-718f-4718-9b0a-d287e7e3f62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:50.567598 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03efa70-718f-4718-9b0a-d287e7e3f62f None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:50.567882 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03efa70-718f-4718-9b0a-d287e7e3f62f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:50.568159 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03efa70-718f-4718-9b0a-d287e7e3f62f None admin] PATH_INFO: `/v3/projects/2633b53c336145bba3d4744dbdfe99b7/users/fcd1725924134616b903b3e374d45817/roles/24772df324aa4eb7b66c7853b4b01439` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:50.570498 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03efa70-718f-4718-9b0a-d287e7e3f62f None admin] RBAC: Authorizing `identity:create_grant(project_id=2633b53c336145bba3d4744dbdfe99b7, user_id=fcd1725924134616b903b3e374d45817, role_id=24772df324aa4eb7b66c7853b4b01439)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:50.571939 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03efa70-718f-4718-9b0a-d287e7e3f62f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:50.583333 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:50.590896 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 464/944] 10.222.0.24 () {58 vars in 1439 bytes} [Thu May 19 14:52:50 2022] PUT /identity/v3/projects/2633b53c336145bba3d4744dbdfe99b7/users/fcd1725924134616b903b3e374d45817/roles/24772df324aa4eb7b66c7853b4b01439 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:52:50.885073 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d959c2-39ad-46af-8eb6-121a73ca5141 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:50.885576 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d959c2-39ad-46af-8eb6-121a73ca5141 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:50.885576 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d959c2-39ad-46af-8eb6-121a73ca5141 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:50.887146 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 481/945] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:50.893138 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15df3d-df0d-4c24-9a6f-09742d62437e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:50.893436 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15df3d-df0d-4c24-9a6f-09742d62437e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:50.893722 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15df3d-df0d-4c24-9a6f-09742d62437e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:50.915376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-3f15df3d-df0d-4c24-9a6f-09742d62437e None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:50.916575 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3f15df3d-df0d-4c24-9a6f-09742d62437e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:50.992264 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 465/946] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:51.015854 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d959c2-39ad-46af-8eb6-121a73ca5141 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:51.052866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:51.122327 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d959c2-39ad-46af-8eb6-121a73ca5141 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:51.158114 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938961c-dce7-4af1-8971-6b47c646fc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:51.158911 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938961c-dce7-4af1-8971-6b47c646fc36 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:51.159189 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938961c-dce7-4af1-8971-6b47c646fc36 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:51.159486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938961c-dce7-4af1-8971-6b47c646fc36 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:51.160139 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938961c-dce7-4af1-8971-6b47c646fc36 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:51.161489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b938961c-dce7-4af1-8971-6b47c646fc36 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:51.173254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-b938961c-dce7-4af1-8971-6b47c646fc36 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:52:51.173254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:51.173254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:51.173254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:51.173254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:51.173254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:51.173254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:51.173254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:51.173254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:52:51.173254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:51.173254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:51.173254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:51.173254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:51.173254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:51.173254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:51.173254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:51.173254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:51.174237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:51.174237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:51.174237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:51.174237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:51.174237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:51.174237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:51.174237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:51.174237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:51.174237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:51.174237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:51.174237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:51.174237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:51.174237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:51.174237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:51.174237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:51.174237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:51.175079 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:51.175079 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:51.175079 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:51.175079 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:51.175079 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:51.175079 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:51.175079 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:51.175079 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:51.175079 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:51.175079 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:51.175079 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:51.175079 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:51.175079 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:52:51.175079 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:51.175079 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 482/947] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:51.180802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15df3d-df0d-4c24-9a6f-09742d62437e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:51.281938 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15df3d-df0d-4c24-9a6f-09742d62437e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:51.315635 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:51.323922 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a893fba-4363-4383-82a8-93b8de292e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:51.324517 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a893fba-4363-4383-82a8-93b8de292e23 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:51.324803 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a893fba-4363-4383-82a8-93b8de292e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:51.325079 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a893fba-4363-4383-82a8-93b8de292e23 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:51.326353 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a893fba-4363-4383-82a8-93b8de292e23 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:51.326667 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a893fba-4363-4383-82a8-93b8de292e23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:51.328095 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a893fba-4363-4383-82a8-93b8de292e23 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:51.333709 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 466/948] 10.222.0.24 () {56 vars in 1112 bytes} [Thu May 19 14:52:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:51.339334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938961c-dce7-4af1-8971-6b47c646fc36 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:51.443891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:51.447816 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938961c-dce7-4af1-8971-6b47c646fc36 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:51.483763 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8de0d-d688-4f24-a0b4-b1e3f168b903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:51.484428 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8de0d-d688-4f24-a0b4-b1e3f168b903 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:51.484707 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8de0d-d688-4f24-a0b4-b1e3f168b903 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:51.484981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8de0d-d688-4f24-a0b4-b1e3f168b903 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:51.485737 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb8de0d-d688-4f24-a0b4-b1e3f168b903 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:51.486043 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb8de0d-d688-4f24-a0b4-b1e3f168b903 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:51.487423 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb8de0d-d688-4f24-a0b4-b1e3f168b903 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:51.492539 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 483/949] 10.222.0.24 () {56 vars in 1112 bytes} [Thu May 19 14:52:51 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:51.609158 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cd33b-7d07-461b-bf41-28f26d884747 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:51.609486 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cd33b-7d07-461b-bf41-28f26d884747 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:51.609721 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cd33b-7d07-461b-bf41-28f26d884747 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:51.611560 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 467/950] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:51.617109 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5001d8-8b17-4566-8dc4-16da5dd36872 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:51.617397 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5001d8-8b17-4566-8dc4-16da5dd36872 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:51.617678 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5001d8-8b17-4566-8dc4-16da5dd36872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:51.642391 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-1c5001d8-8b17-4566-8dc4-16da5dd36872 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:51.644170 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1c5001d8-8b17-4566-8dc4-16da5dd36872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:51.725868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 484/951] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:52:51.749534 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0cd33b-7d07-461b-bf41-28f26d884747 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:51.860484 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0cd33b-7d07-461b-bf41-28f26d884747 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:51.896100 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f1f3e-dbc5-4fed-9aad-ede0a540aa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:51.896762 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f1f3e-dbc5-4fed-9aad-ede0a540aa9c None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:51.897043 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f1f3e-dbc5-4fed-9aad-ede0a540aa9c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:51.897318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f1f3e-dbc5-4fed-9aad-ede0a540aa9c None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:51.898030 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f1f3e-dbc5-4fed-9aad-ede0a540aa9c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:51.899550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f1f3e-dbc5-4fed-9aad-ede0a540aa9c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:51.900913 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: WARNING keystone.server.flask.common [None req-9f8f1f3e-dbc5-4fed-9aad-ede0a540aa9c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 19 14:52:51.920644 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.sql.core [None req-9f8f1f3e-dbc5-4fed-9aad-ede0a540aa9c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 14:52:51.920644 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 14:52:51.920644 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [parameters: {'id': '4ab50fe477e043e594a2638ae7696adc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 14:52:51.920644 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80158) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 14:52:51.928352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-9f8f1f3e-dbc5-4fed-9aad-ede0a540aa9c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4ab50fe477e043e594a2638ae7696adc.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4ab50fe477e043e594a2638ae7696adc. May 19 14:52:51.928352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:51.928352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 14:52:51.928352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 14:52:51.928352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 14:52:51.928352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 14:52:51.928352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 14:52:51.928352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application result = self._query(query) May 19 14:52:51.928352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 14:52:51.928352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application conn.query(q) May 19 14:52:51.928352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 14:52:51.928352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 14:52:51.928352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 14:52:51.929148 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application result.read() May 19 14:52:51.929148 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 14:52:51.929148 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 14:52:51.929148 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 14:52:51.929148 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 14:52:51.929148 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 14:52:51.929148 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 14:52:51.929148 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 14:52:51.929148 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 14:52:51.929148 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 14:52:51.929148 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:51.929148 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 14:52:51.929148 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:51.929148 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:51.929148 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 14:52:51.929148 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 14:52:51.929148 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 19 14:52:51.929148 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return project_ref.to_dict() May 19 14:52:51.930109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 14:52:51.930109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application next(self.gen) May 19 14:52:51.930109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 14:52:51.930109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application yield resource May 19 14:52:51.930109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 14:52:51.930109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application next(self.gen) May 19 14:52:51.930109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 14:52:51.930109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.session.rollback() May 19 14:52:51.930109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 14:52:51.930109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.force_reraise() May 19 14:52:51.930109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 14:52:51.930109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise self.value May 19 14:52:51.930109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 14:52:51.930109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 14:52:51.930109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 14:52:51.930109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application session.commit() May 19 14:52:51.930109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 14:52:51.930992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 14:52:51.930992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 14:52:51.930992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._prepare_impl() May 19 14:52:51.930992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 14:52:51.930992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.session.flush() May 19 14:52:51.930992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 14:52:51.930992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._flush(objects) May 19 14:52:51.930992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 14:52:51.930992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 14:52:51.930992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 14:52:51.930992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application compat.raise_( May 19 14:52:51.930992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 14:52:51.930992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception May 19 14:52:51.930992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 14:52:51.930992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application flush_context.execute() May 19 14:52:51.930992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 14:52:51.930992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rec.execute(self) May 19 14:52:51.931912 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 14:52:51.931912 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 14:52:51.931912 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 14:52:51.931912 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 14:52:51.931912 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 19 14:52:51.931912 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application c = connection._execute_20( May 19 14:52:51.931912 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 14:52:51.931912 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 14:52:51.931912 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 14:52:51.931912 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 14:52:51.931912 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 14:52:51.931912 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 14:52:51.931912 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 14:52:51.931912 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 14:52:51.931912 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 14:52:51.932692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 14:52:51.932692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 14:52:51.932692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception May 19 14:52:51.932692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 14:52:51.932692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 14:52:51.932692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 14:52:51.932692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 14:52:51.932692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 14:52:51.932692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application result = self._query(query) May 19 14:52:51.932692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 14:52:51.932692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application conn.query(q) May 19 14:52:51.932692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 14:52:51.932692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 14:52:51.932692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 14:52:51.932692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application result.read() May 19 14:52:51.932692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 14:52:51.932692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 14:52:51.933554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 14:52:51.933554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 14:52:51.933554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 14:52:51.933554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 14:52:51.933554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 14:52:51.933554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 14:52:51.933554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 19 14:52:51.933554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 19 14:52:51.933554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [parameters: {'id': '4ab50fe477e043e594a2638ae7696adc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 19 14:52:51.933554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 14:52:51.933554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:51.933554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:51.933554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:51.933554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:51.933554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 19 14:52:51.934333 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 19 14:52:51.934333 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 14:52:51.934333 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 14:52:51.934333 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 19 14:52:51.934333 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:51.934333 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:51.934333 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:51.934333 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:51.934333 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:51.934333 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:51.934333 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:51.934333 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:51.934333 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:51.934333 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:51.934333 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:51.934333 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:51.934333 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:51.939727 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:51.939727 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 19 14:52:51.939727 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 19 14:52:51.939727 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:51.939727 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:51.939727 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 19 14:52:51.939727 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.Conflict( May 19 14:52:51.939727 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4ab50fe477e043e594a2638ae7696adc. May 19 14:52:51.939727 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:51.939727 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 468/952] 10.222.0.24 () {60 vars in 1140 bytes} [Thu May 19 14:52:51 2022] POST /identity/v3/projects => generated 262 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:51.942591 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5001d8-8b17-4566-8dc4-16da5dd36872 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:52.077374 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:52.092368 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5001d8-8b17-4566-8dc4-16da5dd36872 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:52.136399 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f2bf4-30e9-4df9-af0f-b4f8e18e42ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:52.137577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f2bf4-30e9-4df9-af0f-b4f8e18e42ed None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:52.138596 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f2bf4-30e9-4df9-af0f-b4f8e18e42ed None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:52.139058 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f2bf4-30e9-4df9-af0f-b4f8e18e42ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:52.146280 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f2bf4-30e9-4df9-af0f-b4f8e18e42ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:52.147968 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f2bf4-30e9-4df9-af0f-b4f8e18e42ed None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:52.166543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-572f2bf4-30e9-4df9-af0f-b4f8e18e42ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:52.166543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:52.166543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:52.166543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:52.166543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:52.166543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:52.166543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:52.166543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:52.166543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:52.166543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:52.166543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:52.166543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:52.166543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:52.166543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:52.166543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:52.167564 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:52.167564 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:52.167564 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:52.167564 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:52.167564 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:52.167564 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:52.167564 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:52.167564 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:52.167564 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:52.167564 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:52.167564 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:52.167564 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:52.167564 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:52.167564 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:52.167564 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:52.167564 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:52.167564 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:52.168514 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:52.168514 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:52.168514 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:52.168514 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:52.168514 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:52.168514 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:52.168514 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:52.168514 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:52.168514 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 485/953] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:52.175634 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f1f3e-dbc5-4fed-9aad-ede0a540aa9c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:52.227396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:52.288764 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f1f3e-dbc5-4fed-9aad-ede0a540aa9c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:52.333468 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea996f2a-4b5c-429c-a829-e201e95c64ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:52.334467 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea996f2a-4b5c-429c-a829-e201e95c64ad None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:52.334959 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea996f2a-4b5c-429c-a829-e201e95c64ad None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:52.335472 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea996f2a-4b5c-429c-a829-e201e95c64ad None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:52.336434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea996f2a-4b5c-429c-a829-e201e95c64ad None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:52.336974 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea996f2a-4b5c-429c-a829-e201e95c64ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:52.339082 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea996f2a-4b5c-429c-a829-e201e95c64ad None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:52.360655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 469/954] 10.222.0.24 () {56 vars in 1112 bytes} [Thu May 19 14:52:52 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:52.886487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad5c3e-64e0-4638-8196-8b39cf951321 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:52.886872 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad5c3e-64e0-4638-8196-8b39cf951321 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:52.887053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad5c3e-64e0-4638-8196-8b39cf951321 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:52.888829 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 486/955] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:52.894701 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a6121-1cba-4efd-aa2b-86d1e94c912c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:52.894998 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a6121-1cba-4efd-aa2b-86d1e94c912c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:52.895311 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a6121-1cba-4efd-aa2b-86d1e94c912c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:52.913092 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0f5a6121-1cba-4efd-aa2b-86d1e94c912c None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:52.914599 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0f5a6121-1cba-4efd-aa2b-86d1e94c912c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:52.982683 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 470/956] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:53.005308 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad5c3e-64e0-4638-8196-8b39cf951321 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:53.059488 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc66be-c017-428f-baeb-73e7de0150d4 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:53.060178 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc66be-c017-428f-baeb-73e7de0150d4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:53.060696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cc66be-c017-428f-baeb-73e7de0150d4 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:53.062638 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 471/957] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:52:53.067924 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99de8fc-96a3-415a-948c-7083cc3c0ac6 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:53.068216 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99de8fc-96a3-415a-948c-7083cc3c0ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:53.068496 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99de8fc-96a3-415a-948c-7083cc3c0ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:53.085976 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c99de8fc-96a3-415a-948c-7083cc3c0ac6 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:53.087159 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c99de8fc-96a3-415a-948c-7083cc3c0ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:53.115463 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad5c3e-64e0-4638-8196-8b39cf951321 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:53.119386 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:53.155603 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa7da5-2c42-4230-8563-b47020009224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:53.156416 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa7da5-2c42-4230-8563-b47020009224 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:53.156699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa7da5-2c42-4230-8563-b47020009224 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:53.156975 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa7da5-2c42-4230-8563-b47020009224 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:53.157677 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa7da5-2c42-4230-8563-b47020009224 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:53.159098 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa7da5-2c42-4230-8563-b47020009224 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:53.167307 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 472/958] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:52:53.171361 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-84aa7da5-2c42-4230-8563-b47020009224 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:52:53.171361 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:53.171361 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:53.171361 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:53.171361 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:53.171361 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:53.171361 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:53.171361 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:53.171361 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:52:53.171361 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:53.171361 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:53.171361 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:53.171361 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:53.171361 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:53.171361 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:53.171361 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:53.171361 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:53.172402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:53.172402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:53.172402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:53.172402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:53.172402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:53.172402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:53.172402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:53.172402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:53.172402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:53.172402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:53.172402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:53.172402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:53.172402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:53.172402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:53.172402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:53.172402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:53.173375 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:53.173375 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:53.173375 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:53.173375 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:53.173375 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:53.173375 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:53.173375 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:53.173375 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:53.173375 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:53.173375 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:53.173375 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:53.173375 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:53.173375 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:52:53.173375 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:53.173375 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 487/959] 10.222.0.24 () {56 vars in 1126 bytes} [Thu May 19 14:52:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:53.180277 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99de8fc-96a3-415a-948c-7083cc3c0ac6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:53.185679 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa7da5-2c42-4230-8563-b47020009224 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:53.206360 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:53.288708 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99de8fc-96a3-415a-948c-7083cc3c0ac6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:53.298148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa7da5-2c42-4230-8563-b47020009224 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:53.333592 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f927d30-59f2-415d-b09d-844c060e6f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:53.334583 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f927d30-59f2-415d-b09d-844c060e6f20 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:53.335145 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f927d30-59f2-415d-b09d-844c060e6f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:53.335766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f927d30-59f2-415d-b09d-844c060e6f20 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:53.336676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f927d30-59f2-415d-b09d-844c060e6f20 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:53.337208 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f927d30-59f2-415d-b09d-844c060e6f20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:53.338780 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f927d30-59f2-415d-b09d-844c060e6f20 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:53.345349 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 473/960] 10.222.0.24 () {56 vars in 1122 bytes} [Thu May 19 14:52:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:53.351238 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f927d30-59f2-415d-b09d-844c060e6f20 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:53.358280 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a40abe-c76a-41bf-9f85-db0713ec1669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:53.359419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a40abe-c76a-41bf-9f85-db0713ec1669 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:53.360349 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a40abe-c76a-41bf-9f85-db0713ec1669 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:53.360808 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a40abe-c76a-41bf-9f85-db0713ec1669 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:53.374065 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a40abe-c76a-41bf-9f85-db0713ec1669 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:52:53.383962 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:53.386148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-c4a40abe-c76a-41bf-9f85-db0713ec1669 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:52:53.386148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:53.386148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:53.386148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:53.386148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:53.386148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:53.386148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:53.386148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:53.386148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:53.386148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:53.386148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:53.386148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:53.386148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:52:53.386148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:52:53.386148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:52:53.386148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:52:53.387342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:52:53.387342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:52:53.387342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:52:53.387342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:52:53.387342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:53.387342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:53.387342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:53.387342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:53.387342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:53.387342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:53.387342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:53.387342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:53.387342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:53.387342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:53.387342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:53.387342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:53.388740 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:53.388740 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:53.388740 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:53.388740 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:53.388740 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:52:53.388740 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:52:53.388740 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:52:53.388740 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:52:53.388740 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:52:53.388740 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:52:53.388740 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:52:53.388740 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:53.395356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 488/961] 10.222.0.24 () {56 vars in 1120 bytes} [Thu May 19 14:52:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:53.400869 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a40abe-c76a-41bf-9f85-db0713ec1669 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:53.487630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f927d30-59f2-415d-b09d-844c060e6f20 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:53.506251 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:53.534435 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c93a06-d2b4-46b7-b7bb-96871d0137c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:53.535289 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c93a06-d2b4-46b7-b7bb-96871d0137c7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:53.535673 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c93a06-d2b4-46b7-b7bb-96871d0137c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:53.535920 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a40abe-c76a-41bf-9f85-db0713ec1669 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:53.536133 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c93a06-d2b4-46b7-b7bb-96871d0137c7 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:53.536935 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c93a06-d2b4-46b7-b7bb-96871d0137c7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:53.537360 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c93a06-d2b4-46b7-b7bb-96871d0137c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:53.539820 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c93a06-d2b4-46b7-b7bb-96871d0137c7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:53.549968 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 474/962] 10.222.0.24 () {56 vars in 1122 bytes} [Thu May 19 14:52:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:53.551967 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c93a06-d2b4-46b7-b7bb-96871d0137c7 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:53.581077 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a814a1-7fb3-45bc-968b-6fadc2b909d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:53.581757 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a814a1-7fb3-45bc-968b-6fadc2b909d6 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:53.582042 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a814a1-7fb3-45bc-968b-6fadc2b909d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:53.582315 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a814a1-7fb3-45bc-968b-6fadc2b909d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:53.583256 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a814a1-7fb3-45bc-968b-6fadc2b909d6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:53.583612 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a814a1-7fb3-45bc-968b-6fadc2b909d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:53.585039 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a814a1-7fb3-45bc-968b-6fadc2b909d6 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:53.599714 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 489/963] 10.222.0.24 () {56 vars in 1115 bytes} [Thu May 19 14:52:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:53.600967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a814a1-7fb3-45bc-968b-6fadc2b909d6 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:53.659914 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:53.666744 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c93a06-d2b4-46b7-b7bb-96871d0137c7 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:53.704418 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc5ca0-a27a-4b49-8f07-cb0dfca9d52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:53.705446 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc5ca0-a27a-4b49-8f07-cb0dfca9d52e None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:53.706030 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc5ca0-a27a-4b49-8f07-cb0dfca9d52e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:53.706529 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc5ca0-a27a-4b49-8f07-cb0dfca9d52e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:53.707588 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc5ca0-a27a-4b49-8f07-cb0dfca9d52e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:53.709263 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc5ca0-a27a-4b49-8f07-cb0dfca9d52e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:53.713082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a814a1-7fb3-45bc-968b-6fadc2b909d6 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:53.743749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 475/964] 10.222.0.24 () {60 vars in 1144 bytes} [Thu May 19 14:52:53 2022] POST /identity/v3/endpoints => generated 349 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:52:53.764667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3971a-60a4-4438-8de7-d8262e58055a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:53.765537 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3971a-60a4-4438-8de7-d8262e58055a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:53.765842 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3971a-60a4-4438-8de7-d8262e58055a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:53.766090 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3971a-60a4-4438-8de7-d8262e58055a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:53.768593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:53.783040 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3971a-60a4-4438-8de7-d8262e58055a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:53.784688 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3971a-60a4-4438-8de7-d8262e58055a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:53.805018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-a0b3971a-60a4-4438-8de7-d8262e58055a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:53.805018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:53.805018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:53.805018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:53.805018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:53.805018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:53.805018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:53.805018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:53.805018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:53.805018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:53.805018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:53.805018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:53.805018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:53.805018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:53.805018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:53.806001 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:53.806001 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:53.806001 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:53.806001 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:53.806001 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:53.806001 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:53.806001 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:53.806001 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:53.806001 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:53.806001 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:53.806001 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:53.806001 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:53.806001 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:53.806001 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:53.806001 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:53.806001 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:53.806001 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:53.806889 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:53.806889 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:53.806889 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:53.806889 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:53.806889 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 490/965] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:53.812828 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc5ca0-a27a-4b49-8f07-cb0dfca9d52e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:53.929930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc5ca0-a27a-4b49-8f07-cb0dfca9d52e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:53.932422 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f513c6-8ede-4ed3-a614-b5c0c2595c74 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:53.932704 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f513c6-8ede-4ed3-a614-b5c0c2595c74 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:53.932976 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f513c6-8ede-4ed3-a614-b5c0c2595c74 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:53.934340 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 491/966] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:53.940148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23cd8e-e7f7-445b-a913-b3f58bea09bc None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:53.940437 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23cd8e-e7f7-445b-a913-b3f58bea09bc None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:53.940699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23cd8e-e7f7-445b-a913-b3f58bea09bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:53.962493 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-1a23cd8e-e7f7-445b-a913-b3f58bea09bc None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:53.962959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1a23cd8e-e7f7-445b-a913-b3f58bea09bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:53.989945 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571eaf1c-4cc7-4daf-bd3f-c154c8278e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:53.990613 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571eaf1c-4cc7-4daf-bd3f-c154c8278e12 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:53.990893 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571eaf1c-4cc7-4daf-bd3f-c154c8278e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:53.991489 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571eaf1c-4cc7-4daf-bd3f-c154c8278e12 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:53.991916 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571eaf1c-4cc7-4daf-bd3f-c154c8278e12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:53.992231 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571eaf1c-4cc7-4daf-bd3f-c154c8278e12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:53.993614 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571eaf1c-4cc7-4daf-bd3f-c154c8278e12 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:54.012415 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 476/967] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:54.017774 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571eaf1c-4cc7-4daf-bd3f-c154c8278e12 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:54.035267 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:54.055700 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 492/968] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:52:54.080782 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23cd8e-e7f7-445b-a913-b3f58bea09bc None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:54.133651 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571eaf1c-4cc7-4daf-bd3f-c154c8278e12 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:54.168979 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ff96c-a800-4a09-9745-0cc49cf8251d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:54.170308 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ff96c-a800-4a09-9745-0cc49cf8251d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:54.170591 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ff96c-a800-4a09-9745-0cc49cf8251d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:54.170863 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ff96c-a800-4a09-9745-0cc49cf8251d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:54.178282 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ff96c-a800-4a09-9745-0cc49cf8251d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:54.179784 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ff96c-a800-4a09-9745-0cc49cf8251d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:54.193623 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23cd8e-e7f7-445b-a913-b3f58bea09bc None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:54.195879 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-e97ff96c-a800-4a09-9745-0cc49cf8251d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:52:54.195879 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:54.195879 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:54.195879 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:54.195879 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:54.195879 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:54.195879 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:54.195879 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:54.195879 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:54.195879 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:54.195879 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:54.195879 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:54.195879 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:54.195879 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:54.195879 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:54.195879 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:54.197109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:54.197109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:54.197109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:54.197109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:54.197109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:54.197109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:54.197109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:54.197109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:54.197109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:54.197109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:54.197109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:54.197109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:54.197109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:54.197109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:54.197109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:54.197109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:54.197109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:54.197109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:54.198124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:54.198124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:54.198124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:54.198124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:54.198124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:54.198124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:54.198124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:54.198124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:54.198124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 19 14:52:54.198124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:54.201844 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 477/969] 10.222.0.24 () {56 vars in 1117 bytes} [Thu May 19 14:52:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:54.203174 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ff96c-a800-4a09-9745-0cc49cf8251d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:54.216287 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:54.237982 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc7359-ac7b-4f4c-a94c-e248658f2880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:54.239069 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc7359-ac7b-4f4c-a94c-e248658f2880 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:54.239637 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc7359-ac7b-4f4c-a94c-e248658f2880 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:54.240088 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc7359-ac7b-4f4c-a94c-e248658f2880 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:54.240993 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc7359-ac7b-4f4c-a94c-e248658f2880 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:54.242526 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc7359-ac7b-4f4c-a94c-e248658f2880 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:54.267949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 493/970] 10.222.0.24 () {60 vars in 1141 bytes} [Thu May 19 14:52:54 2022] POST /identity/v3/services => generated 242 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:52:54.278454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:54.313807 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ff96c-a800-4a09-9745-0cc49cf8251d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:54.361865 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e87e32-e347-410e-b96c-9c5eb35050d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:54.362554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e87e32-e347-410e-b96c-9c5eb35050d2 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:54.362843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e87e32-e347-410e-b96c-9c5eb35050d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:54.363123 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e87e32-e347-410e-b96c-9c5eb35050d2 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:54.364025 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e87e32-e347-410e-b96c-9c5eb35050d2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:54.364338 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e87e32-e347-410e-b96c-9c5eb35050d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:54.365820 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e87e32-e347-410e-b96c-9c5eb35050d2 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:54.386238 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 478/971] 10.222.0.24 () {56 vars in 1149 bytes} [Thu May 19 14:52:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:54.392526 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc7359-ac7b-4f4c-a94c-e248658f2880 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:54.514799 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc7359-ac7b-4f4c-a94c-e248658f2880 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:54.555016 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98930a34-26ee-431e-87eb-be7fb780e1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:54.555626 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98930a34-26ee-431e-87eb-be7fb780e1d0 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:54.555903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98930a34-26ee-431e-87eb-be7fb780e1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:54.556172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98930a34-26ee-431e-87eb-be7fb780e1d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:54.602999 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:54.627503 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98930a34-26ee-431e-87eb-be7fb780e1d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:54.629267 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98930a34-26ee-431e-87eb-be7fb780e1d0 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:54.709852 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e444377-e3d8-41f0-ba2a-a37c4f90fc1f None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:54.710146 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e444377-e3d8-41f0-ba2a-a37c4f90fc1f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:54.710431 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e444377-e3d8-41f0-ba2a-a37c4f90fc1f None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:54.712064 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 479/972] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:54.717791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6a288-3288-4699-b0cc-035e5f43efb8 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:54.718067 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6a288-3288-4699-b0cc-035e5f43efb8 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:54.718409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6a288-3288-4699-b0cc-035e5f43efb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:54.735997 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8db6a288-3288-4699-b0cc-035e5f43efb8 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:54.737296 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8db6a288-3288-4699-b0cc-035e5f43efb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:54.741970 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 494/973] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:52:54 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:52:54.743396 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98930a34-26ee-431e-87eb-be7fb780e1d0 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:54.815643 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 480/974] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:54 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:52:54.819795 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:54.836347 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6a288-3288-4699-b0cc-035e5f43efb8 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:54.843764 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98930a34-26ee-431e-87eb-be7fb780e1d0 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:54.882203 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e3659-6f9c-4019-92ed-c971c0c56cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:54.883107 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e3659-6f9c-4019-92ed-c971c0c56cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:54.883494 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e3659-6f9c-4019-92ed-c971c0c56cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:54.883842 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03e3659-6f9c-4019-92ed-c971c0c56cd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:54.895085 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e3659-6f9c-4019-92ed-c971c0c56cd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:54.896586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03e3659-6f9c-4019-92ed-c971c0c56cd9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:54.910694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:54.915317 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-d03e3659-6f9c-4019-92ed-c971c0c56cd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:54.915317 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:54.915317 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:54.915317 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:54.915317 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:54.915317 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:54.915317 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:54.915317 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:54.915317 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:54.915317 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:54.915317 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:54.915317 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:54.915317 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:52:54.915317 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:52:54.915317 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:52:54.916183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:52:54.916183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:54.916183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:54.916183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:54.916183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:54.916183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:54.916183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:54.916183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:54.916183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:54.916183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:54.916183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:54.916183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:54.916183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:54.916183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:54.916183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:54.916183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:54.916183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:54.917100 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:52:54.917100 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:52:54.917100 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:52:54.917100 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:54.921193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 495/975] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:54.921914 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e3659-6f9c-4019-92ed-c971c0c56cd9 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:54.957614 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6a288-3288-4699-b0cc-035e5f43efb8 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:54.996196 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455c4eb-faea-4321-a383-8c0ce18807dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:54.997126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455c4eb-faea-4321-a383-8c0ce18807dd None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:54.997951 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455c4eb-faea-4321-a383-8c0ce18807dd None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:54.998235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455c4eb-faea-4321-a383-8c0ce18807dd None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:54.999388 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455c4eb-faea-4321-a383-8c0ce18807dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:55.001142 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455c4eb-faea-4321-a383-8c0ce18807dd None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:55.018203 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.sql.core [None req-f455c4eb-faea-4321-a383-8c0ce18807dd None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 14:52:55.018203 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 14:52:55.018203 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [parameters: {'user_id': '9903a9dcd50746ddad3c6f23903169af', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 14:52:55.018203 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80158) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 19 14:52:55.027260 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-f455c4eb-faea-4321-a383-8c0ce18807dd None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 14:52:55.027260 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:55.027260 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 14:52:55.027260 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 14:52:55.027260 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 14:52:55.027260 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 14:52:55.027260 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 14:52:55.027260 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application result = self._query(query) May 19 14:52:55.027260 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 14:52:55.027260 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application conn.query(q) May 19 14:52:55.027260 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 14:52:55.027260 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 14:52:55.027260 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 14:52:55.027260 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application result.read() May 19 14:52:55.027260 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 14:52:55.028114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 14:52:55.028114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 14:52:55.028114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 14:52:55.028114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 14:52:55.028114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 14:52:55.028114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 14:52:55.028114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 14:52:55.028114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 14:52:55.028114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:55.028114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 19 14:52:55.028114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:55.028114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:55.028114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 19 14:52:55.028114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 19 14:52:55.028114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 19 14:52:55.028114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 19 14:52:55.028114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 14:52:55.028114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application next(self.gen) May 19 14:52:55.029112 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 19 14:52:55.029112 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application yield resource May 19 14:52:55.029112 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 19 14:52:55.029112 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application next(self.gen) May 19 14:52:55.029112 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 19 14:52:55.029112 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.session.rollback() May 19 14:52:55.029112 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 19 14:52:55.029112 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.force_reraise() May 19 14:52:55.029112 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 19 14:52:55.029112 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise self.value May 19 14:52:55.029112 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 19 14:52:55.029112 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 19 14:52:55.029112 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 19 14:52:55.029112 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application session.commit() May 19 14:52:55.029112 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 19 14:52:55.029112 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 19 14:52:55.029112 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 19 14:52:55.030271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._prepare_impl() May 19 14:52:55.030271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 19 14:52:55.030271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.session.flush() May 19 14:52:55.030271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 19 14:52:55.030271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._flush(objects) May 19 14:52:55.030271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 19 14:52:55.030271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 19 14:52:55.030271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 19 14:52:55.030271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application compat.raise_( May 19 14:52:55.030271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 14:52:55.030271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception May 19 14:52:55.030271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 19 14:52:55.030271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application flush_context.execute() May 19 14:52:55.030271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 19 14:52:55.030271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rec.execute(self) May 19 14:52:55.030271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 19 14:52:55.030271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 19 14:52:55.031337 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 19 14:52:55.031337 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application _emit_insert_statements( May 19 14:52:55.031337 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 19 14:52:55.031337 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application result = connection._execute_20( May 19 14:52:55.031337 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 19 14:52:55.031337 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 19 14:52:55.031337 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 19 14:52:55.031337 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 19 14:52:55.031337 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 19 14:52:55.031337 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ret = self._execute_context( May 19 14:52:55.031337 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 19 14:52:55.031337 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 19 14:52:55.031337 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 19 14:52:55.031337 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 19 14:52:55.031337 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 19 14:52:55.031337 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception May 19 14:52:55.033193 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 19 14:52:55.033193 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self.dialect.do_execute( May 19 14:52:55.033193 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 19 14:52:55.033193 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 19 14:52:55.033193 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 19 14:52:55.033193 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application result = self._query(query) May 19 14:52:55.033193 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 19 14:52:55.033193 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application conn.query(q) May 19 14:52:55.033193 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 19 14:52:55.033193 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 19 14:52:55.033193 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 19 14:52:55.033193 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application result.read() May 19 14:52:55.033193 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 19 14:52:55.033193 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 19 14:52:55.033193 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 19 14:52:55.033193 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application packet.raise_for_error() May 19 14:52:55.034980 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 19 14:52:55.034980 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 19 14:52:55.034980 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 19 14:52:55.034980 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 19 14:52:55.034980 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 19 14:52:55.034980 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 19 14:52:55.034980 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [parameters: {'user_id': '9903a9dcd50746ddad3c6f23903169af', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 19 14:52:55.034980 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 19 14:52:55.034980 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:55.034980 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:55.034980 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:55.034980 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:55.034980 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:55.034980 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:55.034980 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:55.036676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:55.036676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:55.036676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:55.036676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:55.036676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:55.036676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:55.036676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:55.036676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 19 14:52:55.036676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 19 14:52:55.036676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:55.036676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:55.036676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:55.036676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:55.036676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:55.036676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:55.036676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 19 14:52:55.036676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 19 14:52:55.039654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 19 14:52:55.039654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 19 14:52:55.039654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 19 14:52:55.039654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 19 14:52:55.039654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 19 14:52:55.039654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:55.039654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 481/976] 10.222.0.24 () {60 vars in 1131 bytes} [Thu May 19 14:52:54 2022] POST /identity/v3/users => generated 160 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:55.039654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455c4eb-faea-4321-a383-8c0ce18807dd None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:55.064234 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03e3659-6f9c-4019-92ed-c971c0c56cd9 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:55.093791 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:55.102899 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed96ca4-3ee1-457e-af2c-8a8c86eccd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:55.103728 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed96ca4-3ee1-457e-af2c-8a8c86eccd1c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:55.104015 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed96ca4-3ee1-457e-af2c-8a8c86eccd1c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:55.104289 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed96ca4-3ee1-457e-af2c-8a8c86eccd1c None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:55.105015 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed96ca4-3ee1-457e-af2c-8a8c86eccd1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:55.105475 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed96ca4-3ee1-457e-af2c-8a8c86eccd1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:55.106989 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed96ca4-3ee1-457e-af2c-8a8c86eccd1c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:55.125638 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 496/977] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:52:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:55.126792 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed96ca4-3ee1-457e-af2c-8a8c86eccd1c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:55.167700 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455c4eb-faea-4321-a383-8c0ce18807dd None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:55.187261 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:55.209873 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c066283-9586-423a-957f-c130e0d6a1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:55.210809 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c066283-9586-423a-957f-c130e0d6a1e6 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:55.211215 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c066283-9586-423a-957f-c130e0d6a1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:55.211601 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c066283-9586-423a-957f-c130e0d6a1e6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:55.219954 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c066283-9586-423a-957f-c130e0d6a1e6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:55.221827 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c066283-9586-423a-957f-c130e0d6a1e6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:55.237054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-7c066283-9586-423a-957f-c130e0d6a1e6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:52:55.237054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:55.237054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:55.237054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:55.237054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:55.237054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:55.237054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:55.237054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:55.237054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:55.237054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:55.237054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:55.237054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:55.237054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:52:55.237054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:52:55.237054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:52:55.237054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:52:55.238235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:55.238235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:55.238235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:52:55.238235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:55.238235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:52:55.238235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:52:55.238235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:55.238235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:55.238235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:55.238235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:55.238235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:55.238235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:55.238235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:55.238235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:55.238235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:55.238235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:55.238235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:55.238235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:55.239429 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:55.239429 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:55.239429 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:52:55.239429 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:52:55.239429 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:52:55.239429 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:52:55.239429 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:52:55.239429 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:52:55.239429 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 19 14:52:55.239429 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:55.245442 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 482/978] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:52:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:55.246339 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c066283-9586-423a-957f-c130e0d6a1e6 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:55.269848 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed96ca4-3ee1-457e-af2c-8a8c86eccd1c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:55.305456 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18698c-5f9b-4d82-84ed-de11b2c8e7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:55.306121 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18698c-5f9b-4d82-84ed-de11b2c8e7ed None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:55.306460 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18698c-5f9b-4d82-84ed-de11b2c8e7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:55.306741 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18698c-5f9b-4d82-84ed-de11b2c8e7ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:55.320023 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a18698c-5f9b-4d82-84ed-de11b2c8e7ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:55.321480 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a18698c-5f9b-4d82-84ed-de11b2c8e7ed None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:55.342966 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-9a18698c-5f9b-4d82-84ed-de11b2c8e7ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:55.342966 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:55.342966 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:55.342966 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:55.342966 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:55.342966 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:55.342966 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:55.342966 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:55.342966 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:55.342966 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:55.342966 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:55.342966 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:55.342966 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:52:55.342966 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:52:55.342966 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:52:55.344097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:52:55.344097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:55.344097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:55.344097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:55.344097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:55.344097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:55.344097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:55.344097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:55.344097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:55.344097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:55.344097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:55.344097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:55.344097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:55.344097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:55.344097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:55.344097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:55.344097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:55.345119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:52:55.345119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:52:55.345119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:52:55.345119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:52:55.345119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:52:55.345119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:52:55.345119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:52:55.345119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:55.349149 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 497/979] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:55.350083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18698c-5f9b-4d82-84ed-de11b2c8e7ed None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:55.383139 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c066283-9586-423a-957f-c130e0d6a1e6 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:55.401254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:55.418667 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4712bb2-2b91-497f-b93d-ace707e8989a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:55.420192 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4712bb2-2b91-497f-b93d-ace707e8989a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:55.420685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4712bb2-2b91-497f-b93d-ace707e8989a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:55.421165 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4712bb2-2b91-497f-b93d-ace707e8989a None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:55.422197 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4712bb2-2b91-497f-b93d-ace707e8989a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:55.422715 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4712bb2-2b91-497f-b93d-ace707e8989a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:55.424395 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4712bb2-2b91-497f-b93d-ace707e8989a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:55.456255 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18698c-5f9b-4d82-84ed-de11b2c8e7ed None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:55.471542 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 483/980] 10.222.0.24 () {56 vars in 1101 bytes} [Thu May 19 14:52:55 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:55.496717 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e48eed-f7f9-4089-b003-7a8dc18b5e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:55.498014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e48eed-f7f9-4089-b003-7a8dc18b5e8a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:55.498296 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e48eed-f7f9-4089-b003-7a8dc18b5e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:55.498570 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e48eed-f7f9-4089-b003-7a8dc18b5e8a None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:55.499432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e48eed-f7f9-4089-b003-7a8dc18b5e8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:55.499743 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e48eed-f7f9-4089-b003-7a8dc18b5e8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:55.501277 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e48eed-f7f9-4089-b003-7a8dc18b5e8a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:55.516486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 498/981] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:52:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:55.522514 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4712bb2-2b91-497f-b93d-ace707e8989a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:55.561479 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:55.644560 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4712bb2-2b91-497f-b93d-ace707e8989a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:55.683539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be17a97-465c-4d0a-afff-b1412207dd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:55.684495 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be17a97-465c-4d0a-afff-b1412207dd08 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:55.685374 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be17a97-465c-4d0a-afff-b1412207dd08 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:55.685752 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be17a97-465c-4d0a-afff-b1412207dd08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:55.686697 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be17a97-465c-4d0a-afff-b1412207dd08 None admin] RBAC: Adding query filter params (role.id=24772df324aa4eb7b66c7853b4b01439, scope.project.id=2633b53c336145bba3d4744dbdfe99b7, user.id=fcd1725924134616b903b3e374d45817) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:55.687119 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be17a97-465c-4d0a-afff-b1412207dd08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:55.688675 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be17a97-465c-4d0a-afff-b1412207dd08 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:55.695575 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 484/982] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:52:55 2022] GET /identity/v3/role_assignments?user.id=fcd1725924134616b903b3e374d45817&scope.project.id=2633b53c336145bba3d4744dbdfe99b7&role.id=24772df324aa4eb7b66c7853b4b01439 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:56.111217 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ec242-f146-4ca8-9416-dba59644f698 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:56.111845 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ec242-f146-4ca8-9416-dba59644f698 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:56.111845 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ec242-f146-4ca8-9416-dba59644f698 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:56.113273 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 499/983] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:56.118513 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb30384-3720-4525-9420-e3baee59c943 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:56.118813 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb30384-3720-4525-9420-e3baee59c943 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:56.119094 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb30384-3720-4525-9420-e3baee59c943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:56.137379 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-beb30384-3720-4525-9420-e3baee59c943 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:56.139461 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-beb30384-3720-4525-9420-e3baee59c943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:56.209816 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 485/984] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:56 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:56.232031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ec242-f146-4ca8-9416-dba59644f698 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:56.340544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ec242-f146-4ca8-9416-dba59644f698 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:56.350540 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:56.375526 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24863e4-e035-4d4d-94ba-306f8ecc7947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:56.376250 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24863e4-e035-4d4d-94ba-306f8ecc7947 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:56.376528 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24863e4-e035-4d4d-94ba-306f8ecc7947 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:56.376797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24863e4-e035-4d4d-94ba-306f8ecc7947 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:56.377443 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24863e4-e035-4d4d-94ba-306f8ecc7947 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:56.378819 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24863e4-e035-4d4d-94ba-306f8ecc7947 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:56.391178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-a24863e4-e035-4d4d-94ba-306f8ecc7947 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:52:56.391178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:56.391178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:56.391178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:56.391178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:56.391178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:56.391178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:56.391178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:56.391178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:52:56.391178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:56.391178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:56.391178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:56.391178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:56.391178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:56.391178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:56.391178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:56.391178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:56.392177 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:56.392177 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:56.392177 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:56.392177 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:56.392177 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:56.392177 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:56.392177 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:56.392177 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:56.392177 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:56.392177 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:56.392177 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:56.392177 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:56.392177 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:56.392177 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:56.392177 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:56.392177 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:56.393002 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:56.393002 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:56.393002 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:56.393002 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:56.393002 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:56.393002 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:56.393002 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:56.393002 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:56.393002 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:56.393002 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:56.393002 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:56.393002 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:56.393002 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:52:56.393002 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:56.397620 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 500/985] 10.222.0.24 () {56 vars in 1126 bytes} [Thu May 19 14:52:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:56.398618 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb30384-3720-4525-9420-e3baee59c943 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:56.430010 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:56.508398 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb30384-3720-4525-9420-e3baee59c943 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:56.543694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb9019-a55a-41e6-a460-d62c16f69d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:56.545396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb9019-a55a-41e6-a460-d62c16f69d08 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:56.545919 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb9019-a55a-41e6-a460-d62c16f69d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:56.546426 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb9019-a55a-41e6-a460-d62c16f69d08 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:56.547390 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb9019-a55a-41e6-a460-d62c16f69d08 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:56.547923 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb9019-a55a-41e6-a460-d62c16f69d08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:56.549505 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb9019-a55a-41e6-a460-d62c16f69d08 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:56.555102 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 486/986] 10.222.0.24 () {56 vars in 1122 bytes} [Thu May 19 14:52:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:56.560612 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24863e4-e035-4d4d-94ba-306f8ecc7947 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:56.621813 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640dcb51-2068-434a-820e-bd6e57fba278 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:56.622102 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640dcb51-2068-434a-820e-bd6e57fba278 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:56.622418 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640dcb51-2068-434a-820e-bd6e57fba278 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:56.623811 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 487/987] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:52:56.628581 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4432bc3-1495-4fad-ab35-010719e12935 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:56.628820 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4432bc3-1495-4fad-ab35-010719e12935 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:56.629102 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4432bc3-1495-4fad-ab35-010719e12935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:56.645064 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a4432bc3-1495-4fad-ab35-010719e12935 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:56.646239 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a4432bc3-1495-4fad-ab35-010719e12935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:56.665572 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24863e4-e035-4d4d-94ba-306f8ecc7947 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:56.698932 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a79ee-9e06-470d-b299-7ad6abb2c1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:56.699624 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a79ee-9e06-470d-b299-7ad6abb2c1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:56.699909 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a79ee-9e06-470d-b299-7ad6abb2c1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:56.700210 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a79ee-9e06-470d-b299-7ad6abb2c1a6 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:56.700978 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a79ee-9e06-470d-b299-7ad6abb2c1a6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:56.701288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a79ee-9e06-470d-b299-7ad6abb2c1a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:56.702682 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898a79ee-9e06-470d-b299-7ad6abb2c1a6 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:56.707764 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 501/988] 10.222.0.24 () {56 vars in 1122 bytes} [Thu May 19 14:52:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:56.713346 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a79ee-9e06-470d-b299-7ad6abb2c1a6 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:56.720034 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 488/989] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:56 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:56.738815 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4432bc3-1495-4fad-ab35-010719e12935 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:56.752404 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:56.764313 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:56.830152 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898a79ee-9e06-470d-b299-7ad6abb2c1a6 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:56.846992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4432bc3-1495-4fad-ab35-010719e12935 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:56.869430 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126e5a9-b881-45be-9f9a-71ba607336b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:56.870345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126e5a9-b881-45be-9f9a-71ba607336b9 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:56.870627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126e5a9-b881-45be-9f9a-71ba607336b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:56.870897 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126e5a9-b881-45be-9f9a-71ba607336b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:56.871723 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126e5a9-b881-45be-9f9a-71ba607336b9 None admin] RBAC: Adding query filter params (interface=admin, service_id=52f0a5523b564297a30c72f38408e0f6, region_id=RegionOne) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:56.872030 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126e5a9-b881-45be-9f9a-71ba607336b9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:56.873420 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126e5a9-b881-45be-9f9a-71ba607336b9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:56.878722 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 502/990] 10.222.0.24 () {56 vars in 1249 bytes} [Thu May 19 14:52:56 2022] GET /identity/v3/endpoints?service_id=52f0a5523b564297a30c72f38408e0f6&interface=admin®ion_id=RegionOne => generated 193 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:56.883109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd803fd-1032-4678-98f9-75abb7b740dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:56.884158 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd803fd-1032-4678-98f9-75abb7b740dd None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:56.884331 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126e5a9-b881-45be-9f9a-71ba607336b9 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:56.884595 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd803fd-1032-4678-98f9-75abb7b740dd None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:56.884964 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd803fd-1032-4678-98f9-75abb7b740dd None admin] PATH_INFO: `/v3/services/compute` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:56.885623 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd803fd-1032-4678-98f9-75abb7b740dd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:56.886996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd803fd-1032-4678-98f9-75abb7b740dd None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:56.899252 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-4bd803fd-1032-4678-98f9-75abb7b740dd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:52:56.899252 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:56.899252 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:56.899252 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:56.899252 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:56.899252 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:56.899252 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:56.899252 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:56.899252 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:52:56.899252 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:56.899252 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:56.899252 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:56.899252 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:56.899252 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:56.899252 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:56.899252 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:56.899252 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:56.900273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:56.900273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:56.900273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:56.900273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:56.900273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:56.900273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:56.900273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:56.900273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:56.900273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:56.900273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:56.900273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:56.900273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:56.900273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:56.900273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:56.900273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:56.900273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:56.901105 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:56.901105 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:56.901105 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:56.901105 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:56.901105 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:56.901105 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:56.901105 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:56.901105 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:56.901105 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:56.901105 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:56.901105 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:56.901105 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:56.901105 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:52:56.901105 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:56.907187 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 489/991] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:52:56.907852 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd803fd-1032-4678-98f9-75abb7b740dd None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:56.989703 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:56.993055 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126e5a9-b881-45be-9f9a-71ba607336b9 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:57.001728 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:57.020681 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd803fd-1032-4678-98f9-75abb7b740dd None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:57.038023 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b682f2c-d989-4d9d-9ab8-ebd63c50f6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:57.038702 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b682f2c-d989-4d9d-9ab8-ebd63c50f6bb None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:57.038986 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b682f2c-d989-4d9d-9ab8-ebd63c50f6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:57.039339 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b682f2c-d989-4d9d-9ab8-ebd63c50f6bb None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:57.040033 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b682f2c-d989-4d9d-9ab8-ebd63c50f6bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:57.041471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b682f2c-d989-4d9d-9ab8-ebd63c50f6bb None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:57.048631 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 503/992] 10.222.0.24 () {56 vars in 1087 bytes} [Thu May 19 14:52:56 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 14:52:57.068846 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c09c47-c8c0-4a2e-9098-6283c4c90f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:57.069922 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c09c47-c8c0-4a2e-9098-6283c4c90f3f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:57.070400 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c09c47-c8c0-4a2e-9098-6283c4c90f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:57.070870 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c09c47-c8c0-4a2e-9098-6283c4c90f3f None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:57.071825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c09c47-c8c0-4a2e-9098-6283c4c90f3f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:57.072328 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c09c47-c8c0-4a2e-9098-6283c4c90f3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:57.074093 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c09c47-c8c0-4a2e-9098-6283c4c90f3f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:57.085002 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 490/993] 10.222.0.24 () {56 vars in 1112 bytes} [Thu May 19 14:52:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:57.086298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b682f2c-d989-4d9d-9ab8-ebd63c50f6bb None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:57.195743 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b682f2c-d989-4d9d-9ab8-ebd63c50f6bb None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:57.231166 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87f45a-83d6-446b-b1dc-aaa3192e43f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:57.232415 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87f45a-83d6-446b-b1dc-aaa3192e43f8 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:57.232701 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87f45a-83d6-446b-b1dc-aaa3192e43f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:57.232970 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87f45a-83d6-446b-b1dc-aaa3192e43f8 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:57.233678 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87f45a-83d6-446b-b1dc-aaa3192e43f8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:57.233992 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87f45a-83d6-446b-b1dc-aaa3192e43f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:57.235417 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87f45a-83d6-446b-b1dc-aaa3192e43f8 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:57.240536 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 504/994] 10.222.0.24 () {56 vars in 1112 bytes} [Thu May 19 14:52:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:57.246404 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c09c47-c8c0-4a2e-9098-6283c4c90f3f None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:57.358018 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c09c47-c8c0-4a2e-9098-6283c4c90f3f None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:57.394265 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d8704-43de-4e37-9fea-e715c27da8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:57.394928 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d8704-43de-4e37-9fea-e715c27da8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:57.395220 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d8704-43de-4e37-9fea-e715c27da8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:57.395535 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d8704-43de-4e37-9fea-e715c27da8e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:57.396330 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d8704-43de-4e37-9fea-e715c27da8e5 None admin] RBAC: Adding query filter params (interface=public, service_id=026187356aa843b7bad7205c2de510c2, region_id=RegionOne) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:57.396644 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d8704-43de-4e37-9fea-e715c27da8e5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:57.398010 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d8704-43de-4e37-9fea-e715c27da8e5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:57.408093 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 491/995] 10.222.0.24 () {56 vars in 1251 bytes} [Thu May 19 14:52:57 2022] GET /identity/v3/endpoints?service_id=026187356aa843b7bad7205c2de510c2&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:57.409797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87f45a-83d6-446b-b1dc-aaa3192e43f8 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:57.440227 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:57.514934 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87f45a-83d6-446b-b1dc-aaa3192e43f8 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:57.549052 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2c8e3-f97f-42bb-9f98-e58b8c381d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:57.549721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2c8e3-f97f-42bb-9f98-e58b8c381d09 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:57.550005 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2c8e3-f97f-42bb-9f98-e58b8c381d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:57.550283 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2c8e3-f97f-42bb-9f98-e58b8c381d09 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:57.550967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2c8e3-f97f-42bb-9f98-e58b8c381d09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:57.552365 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2c8e3-f97f-42bb-9f98-e58b8c381d09 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:57.563282 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 505/996] 10.222.0.24 () {56 vars in 1087 bytes} [Thu May 19 14:52:57 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 14:52:57.959062 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c71903-b4f6-4e42-9ed9-0ba6a08c410d None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:57.959408 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c71903-b4f6-4e42-9ed9-0ba6a08c410d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:57.959679 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c71903-b4f6-4e42-9ed9-0ba6a08c410d None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:57.961189 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 492/997] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:57.966260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f862c-51e0-401f-b0f8-cbdb75bfb55f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:57.966627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f862c-51e0-401f-b0f8-cbdb75bfb55f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:57.966984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f862c-51e0-401f-b0f8-cbdb75bfb55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:57.984159 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-458f862c-51e0-401f-b0f8-cbdb75bfb55f None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:57.985341 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-458f862c-51e0-401f-b0f8-cbdb75bfb55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:58.058633 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 506/998] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:57 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:58.080807 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c71903-b4f6-4e42-9ed9-0ba6a08c410d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:58.104941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:58.193034 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c71903-b4f6-4e42-9ed9-0ba6a08c410d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:58.226751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85b363-47fa-46b5-8076-0282cd61e968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:58.227493 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85b363-47fa-46b5-8076-0282cd61e968 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:58.227783 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85b363-47fa-46b5-8076-0282cd61e968 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:58.228064 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85b363-47fa-46b5-8076-0282cd61e968 None admin] PATH_INFO: `/v3/services/image` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:58.228714 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85b363-47fa-46b5-8076-0282cd61e968 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:58.230082 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85b363-47fa-46b5-8076-0282cd61e968 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:58.242788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-eb85b363-47fa-46b5-8076-0282cd61e968 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:52:58.242788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:58.242788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:58.242788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:58.242788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:58.242788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:58.242788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:58.242788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:58.242788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:52:58.242788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:58.242788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:58.242788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:58.242788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:58.242788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:58.242788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:58.242788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:58.242788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:58.243942 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:58.243942 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:58.243942 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:58.243942 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:58.243942 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:58.243942 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:58.243942 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:58.243942 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:58.243942 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:58.243942 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:58.243942 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:58.243942 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:58.243942 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:58.243942 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:58.243942 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:58.243942 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:58.245052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:58.245052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:52:58.245052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:58.245052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:58.245052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:58.245052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:58.245052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:58.245052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:58.245052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:58.245052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:58.245052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:58.245052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:58.245052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:52:58.245052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:52:58.245052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 493/999] 10.222.0.24 () {56 vars in 1105 bytes} [Thu May 19 14:52:58 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:58.252476 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f862c-51e0-401f-b0f8-cbdb75bfb55f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:58.276905 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:58.362081 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f862c-51e0-401f-b0f8-cbdb75bfb55f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:58.397651 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf735e-22c4-4375-b4e2-83956de05dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:58.398321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf735e-22c4-4375-b4e2-83956de05dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:58.398605 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf735e-22c4-4375-b4e2-83956de05dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:58.398884 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf735e-22c4-4375-b4e2-83956de05dc2 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:58.399623 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf735e-22c4-4375-b4e2-83956de05dc2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:58.399935 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf735e-22c4-4375-b4e2-83956de05dc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:58.401297 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf735e-22c4-4375-b4e2-83956de05dc2 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:58.411274 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 507/1000] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:58.412854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85b363-47fa-46b5-8076-0282cd61e968 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:58.494543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:58.515243 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85b363-47fa-46b5-8076-0282cd61e968 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:58.548452 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2e997-5cc7-47fb-b444-5842d12fedd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:58.549161 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2e997-5cc7-47fb-b444-5842d12fedd0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:58.549447 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2e997-5cc7-47fb-b444-5842d12fedd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:58.549775 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2e997-5cc7-47fb-b444-5842d12fedd0 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:58.550485 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2e997-5cc7-47fb-b444-5842d12fedd0 None admin] RBAC: Adding query filter params (type=image) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:58.550795 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2e997-5cc7-47fb-b444-5842d12fedd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:58.552187 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2e997-5cc7-47fb-b444-5842d12fedd0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:58.556883 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 494/1001] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:52:58 2022] GET /identity/v3/services?type=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:59.284743 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0845a7-b0de-4aab-87f0-cee10f3d55ac None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:59.285245 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0845a7-b0de-4aab-87f0-cee10f3d55ac None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:59.285574 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0845a7-b0de-4aab-87f0-cee10f3d55ac None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:59.287364 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 508/1002] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:52:59.293294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae152560-4e7b-470a-9c5a-c8c38aa078e3 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:59.293761 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae152560-4e7b-470a-9c5a-c8c38aa078e3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:59.294690 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae152560-4e7b-470a-9c5a-c8c38aa078e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:59.312442 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ae152560-4e7b-470a-9c5a-c8c38aa078e3 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:59.313657 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ae152560-4e7b-470a-9c5a-c8c38aa078e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:59.395547 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 495/1003] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:59 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:52:59.415394 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0845a7-b0de-4aab-87f0-cee10f3d55ac None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:59.505360 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:59.523092 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0845a7-b0de-4aab-87f0-cee10f3d55ac None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:59.563185 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce672b-163c-4482-8cb3-ea50cb465460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:59.563948 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce672b-163c-4482-8cb3-ea50cb465460 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:59.564231 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce672b-163c-4482-8cb3-ea50cb465460 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:59.564509 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce672b-163c-4482-8cb3-ea50cb465460 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:59.565153 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce672b-163c-4482-8cb3-ea50cb465460 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:59.566533 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce672b-163c-4482-8cb3-ea50cb465460 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:59.579527 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-e6ce672b-163c-4482-8cb3-ea50cb465460 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:52:59.579527 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:59.579527 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:52:59.579527 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:52:59.579527 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:52:59.579527 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:52:59.579527 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:52:59.579527 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:59.579527 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:52:59.579527 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:59.579527 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:52:59.579527 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:59.579527 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:52:59.579527 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:52:59.579527 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:52:59.579527 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:52:59.579527 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:52:59.580525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:52:59.580525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:52:59.580525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:52:59.580525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:52:59.580525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:52:59.580525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:52:59.580525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:52:59.580525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:52:59.580525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:52:59.580525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:52:59.580525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:52:59.580525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:52:59.580525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:52:59.580525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:52:59.580525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:52:59.580525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:52:59.581356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:52:59.581356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:52:59.581356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:52:59.581356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:52:59.581356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:52:59.581356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:52:59.581356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:52:59.581356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:52:59.581356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:52:59.581356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:52:59.581356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:52:59.581356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:52:59.581356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 19 14:52:59.581356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:52:59.586884 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae152560-4e7b-470a-9c5a-c8c38aa078e3 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:59.598118 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 509/1004] 10.222.0.24 () {56 vars in 1126 bytes} [Thu May 19 14:52:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:52:59.672935 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:59.701945 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae152560-4e7b-470a-9c5a-c8c38aa078e3 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:59.735649 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43df125-b58a-40b9-8f80-e0d1dc7e45c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:59.736675 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43df125-b58a-40b9-8f80-e0d1dc7e45c1 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:59.737162 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43df125-b58a-40b9-8f80-e0d1dc7e45c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:59.737680 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43df125-b58a-40b9-8f80-e0d1dc7e45c1 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:59.738589 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43df125-b58a-40b9-8f80-e0d1dc7e45c1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:59.739101 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43df125-b58a-40b9-8f80-e0d1dc7e45c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:59.740636 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43df125-b58a-40b9-8f80-e0d1dc7e45c1 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:59.746460 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 496/1005] 10.222.0.24 () {56 vars in 1122 bytes} [Thu May 19 14:52:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:52:59.752321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce672b-163c-4482-8cb3-ea50cb465460 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:59.794846 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452ddbc-3fd0-494e-93e1-4bd32a0b341a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:59.795676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452ddbc-3fd0-494e-93e1-4bd32a0b341a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:59.795973 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452ddbc-3fd0-494e-93e1-4bd32a0b341a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:59.797826 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 497/1006] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:52:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:52:59.803238 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea1e83-6d42-4abc-b3ff-6e00b6b47c72 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:59.803623 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea1e83-6d42-4abc-b3ff-6e00b6b47c72 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:59.803811 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea1e83-6d42-4abc-b3ff-6e00b6b47c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:59.821061 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8cea1e83-6d42-4abc-b3ff-6e00b6b47c72 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:52:59.822179 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8cea1e83-6d42-4abc-b3ff-6e00b6b47c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:52:59.861158 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce672b-163c-4482-8cb3-ea50cb465460 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:52:59.889374 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 498/1007] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:52:59 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:52:59.896685 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e650f438-bf52-440f-a986-913b060b3675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:52:59.897543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650f438-bf52-440f-a986-913b060b3675 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:52:59.897989 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650f438-bf52-440f-a986-913b060b3675 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:52:59.898414 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650f438-bf52-440f-a986-913b060b3675 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:52:59.899305 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e650f438-bf52-440f-a986-913b060b3675 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:52:59.899759 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e650f438-bf52-440f-a986-913b060b3675 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:52:59.901280 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e650f438-bf52-440f-a986-913b060b3675 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:52:59.910776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 510/1008] 10.222.0.24 () {56 vars in 1122 bytes} [Thu May 19 14:52:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:52:59.911815 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea1e83-6d42-4abc-b3ff-6e00b6b47c72 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:59.913124 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e650f438-bf52-440f-a986-913b060b3675 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:52:59.930143 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:52:59.980298 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:00.017022 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea1e83-6d42-4abc-b3ff-6e00b6b47c72 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:00.017595 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e650f438-bf52-440f-a986-913b060b3675 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:00.050922 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215d61f-add1-43b5-a04b-c0b3f1637647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:00.052005 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215d61f-add1-43b5-a04b-c0b3f1637647 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:00.052474 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215d61f-add1-43b5-a04b-c0b3f1637647 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:00.052960 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215d61f-add1-43b5-a04b-c0b3f1637647 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:00.053791 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215d61f-add1-43b5-a04b-c0b3f1637647 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:00.053976 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a663ad-3bb6-40c4-813e-93644f7d1a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:00.054637 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a663ad-3bb6-40c4-813e-93644f7d1a14 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:00.054925 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a663ad-3bb6-40c4-813e-93644f7d1a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:00.055231 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a663ad-3bb6-40c4-813e-93644f7d1a14 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:00.055978 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a663ad-3bb6-40c4-813e-93644f7d1a14 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:00.056304 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215d61f-add1-43b5-a04b-c0b3f1637647 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:00.057338 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a663ad-3bb6-40c4-813e-93644f7d1a14 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:00.070292 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-d215d61f-add1-43b5-a04b-c0b3f1637647 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:53:00.070292 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:00.070292 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:53:00.070292 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:53:00.070292 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:53:00.070292 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:53:00.070292 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:53:00.070292 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:53:00.070292 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:53:00.070292 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:53:00.070292 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:53:00.070292 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:53:00.070292 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:00.070292 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:00.070292 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:00.070292 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:00.070292 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:00.071387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:00.071387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:00.071387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:00.071387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:00.071387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:00.071387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:00.071387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:53:00.071387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:53:00.071387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:53:00.071387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:53:00.071387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:00.071387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:00.071387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:00.071387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:00.071387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:00.071387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:00.072436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:00.072436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:53:00.072436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:00.072436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:00.072436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:00.072436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:00.072436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:00.072436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:00.072436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:00.072436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:00.072436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:53:00.072436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:53:00.072436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 19 14:53:00.072436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:53:00.073199 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 499/1009] 10.222.0.24 () {60 vars in 1144 bytes} [Thu May 19 14:52:59 2022] POST /identity/v3/endpoints => generated 325 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:53:00.074612 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 511/1010] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:52:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:53:00.085693 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a663ad-3bb6-40c4-813e-93644f7d1a14 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:00.202777 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a663ad-3bb6-40c4-813e-93644f7d1a14 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:00.227974 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:00.241089 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0ca8e-b0ed-4fb1-bafa-2977434aeafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:00.241777 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0ca8e-b0ed-4fb1-bafa-2977434aeafd None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:00.242063 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0ca8e-b0ed-4fb1-bafa-2977434aeafd None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:00.242344 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0ca8e-b0ed-4fb1-bafa-2977434aeafd None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:00.243068 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb0ca8e-b0ed-4fb1-bafa-2977434aeafd None admin] RBAC: Adding query filter params (name=compute) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:00.243411 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb0ca8e-b0ed-4fb1-bafa-2977434aeafd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:00.245070 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb0ca8e-b0ed-4fb1-bafa-2977434aeafd None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:00.255565 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 500/1011] 10.222.0.24 () {56 vars in 1112 bytes} [Thu May 19 14:53:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:00.256892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215d61f-add1-43b5-a04b-c0b3f1637647 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:00.345298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:00.369523 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215d61f-add1-43b5-a04b-c0b3f1637647 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:00.404362 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb41618-e297-4913-9ee4-dd13c9053b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:00.405029 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb41618-e297-4913-9ee4-dd13c9053b3b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:00.405312 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb41618-e297-4913-9ee4-dd13c9053b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:00.405590 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb41618-e297-4913-9ee4-dd13c9053b3b None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:00.406295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb41618-e297-4913-9ee4-dd13c9053b3b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:00.406603 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb41618-e297-4913-9ee4-dd13c9053b3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:00.407991 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb41618-e297-4913-9ee4-dd13c9053b3b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:00.413152 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 512/1012] 10.222.0.24 () {56 vars in 1112 bytes} [Thu May 19 14:53:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:00.418439 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0ca8e-b0ed-4fb1-bafa-2977434aeafd None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:00.523279 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0ca8e-b0ed-4fb1-bafa-2977434aeafd None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:00.556778 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f868ae1-4e99-4b86-b005-17d955f5b853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:00.557428 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f868ae1-4e99-4b86-b005-17d955f5b853 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:00.557717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f868ae1-4e99-4b86-b005-17d955f5b853 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:00.557998 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f868ae1-4e99-4b86-b005-17d955f5b853 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:00.558746 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f868ae1-4e99-4b86-b005-17d955f5b853 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:00.560180 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f868ae1-4e99-4b86-b005-17d955f5b853 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:00.578904 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 501/1013] 10.222.0.24 () {60 vars in 1144 bytes} [Thu May 19 14:53:00 2022] POST /identity/v3/endpoints => generated 334 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:53:00.785307 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020be211-73dc-4939-9a72-51ca3fdff386 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:00.785597 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020be211-73dc-4939-9a72-51ca3fdff386 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:00.785873 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020be211-73dc-4939-9a72-51ca3fdff386 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:00.787361 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 513/1014] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:00.792682 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680d708-05bf-42b7-a8df-f21fa7efae1d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:00.793143 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680d708-05bf-42b7-a8df-f21fa7efae1d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:00.793319 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680d708-05bf-42b7-a8df-f21fa7efae1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:00.810095 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8680d708-05bf-42b7-a8df-f21fa7efae1d None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:00.811332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8680d708-05bf-42b7-a8df-f21fa7efae1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:00.851820 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:00.888623 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 502/1015] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:53:00 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:53:00.910662 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020be211-73dc-4939-9a72-51ca3fdff386 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:01.016467 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020be211-73dc-4939-9a72-51ca3fdff386 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:01.049265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618405f-f146-495f-a617-0adffd7c85e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:01.049918 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618405f-f146-495f-a617-0adffd7c85e9 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:01.050265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618405f-f146-495f-a617-0adffd7c85e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:01.050544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618405f-f146-495f-a617-0adffd7c85e9 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:01.051360 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618405f-f146-495f-a617-0adffd7c85e9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:01.052720 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618405f-f146-495f-a617-0adffd7c85e9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:01.069239 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 514/1016] 10.222.0.24 () {60 vars in 1141 bytes} [Thu May 19 14:53:00 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:53:02.359346 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ef6d6-345f-4e1e-9539-558414b594a5 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:02.359876 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ef6d6-345f-4e1e-9539-558414b594a5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:02.359956 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ef6d6-345f-4e1e-9539-558414b594a5 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:02.361412 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 503/1017] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:02.366566 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08405cee-026d-4206-b3c8-ce67f71353f4 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:02.366964 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08405cee-026d-4206-b3c8-ce67f71353f4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:02.367120 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08405cee-026d-4206-b3c8-ce67f71353f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:02.372569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:02.386526 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-08405cee-026d-4206-b3c8-ce67f71353f4 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:02.388253 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-08405cee-026d-4206-b3c8-ce67f71353f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:02.466832 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 515/1018] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:53:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:53:02.489250 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ef6d6-345f-4e1e-9539-558414b594a5 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:02.589125 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ef6d6-345f-4e1e-9539-558414b594a5 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:02.622587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977920dd-f986-455d-a303-8e21f7cd0182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:02.623403 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977920dd-f986-455d-a303-8e21f7cd0182 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:02.623686 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977920dd-f986-455d-a303-8e21f7cd0182 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:02.623958 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977920dd-f986-455d-a303-8e21f7cd0182 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:02.625114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977920dd-f986-455d-a303-8e21f7cd0182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:02.626542 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977920dd-f986-455d-a303-8e21f7cd0182 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:02.632906 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 504/1019] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:53:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:02.634021 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08405cee-026d-4206-b3c8-ce67f71353f4 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:02.730970 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08405cee-026d-4206-b3c8-ce67f71353f4 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:02.761008 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:02.771081 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2d339-7f10-4872-8675-3c5220936c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:02.771772 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2d339-7f10-4872-8675-3c5220936c3a None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:02.772053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2d339-7f10-4872-8675-3c5220936c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:02.772324 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2d339-7f10-4872-8675-3c5220936c3a None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:02.773031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2d339-7f10-4872-8675-3c5220936c3a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:02.774451 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2d339-7f10-4872-8675-3c5220936c3a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:02.807235 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 516/1020] 10.222.0.24 () {60 vars in 1141 bytes} [Thu May 19 14:53:02 2022] POST /identity/v3/projects => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:53:02.929989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a5568-0517-4026-abea-21916e3f51f1 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:02.930283 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a5568-0517-4026-abea-21916e3f51f1 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:02.930570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a5568-0517-4026-abea-21916e3f51f1 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:02.932020 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 505/1021] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:02.938322 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e42831-e898-4c20-a599-ed511d96a46e None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:02.938617 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e42831-e898-4c20-a599-ed511d96a46e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:02.938900 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e42831-e898-4c20-a599-ed511d96a46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:02.956603 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-c4e42831-e898-4c20-a599-ed511d96a46e None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:02.957817 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c4e42831-e898-4c20-a599-ed511d96a46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:03.030936 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 517/1022] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:53:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:53:03.054307 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a5568-0517-4026-abea-21916e3f51f1 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:03.096767 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:03.161127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a5568-0517-4026-abea-21916e3f51f1 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:03.197925 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46651fe3-7480-4c12-8739-4461889e5bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:03.198700 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46651fe3-7480-4c12-8739-4461889e5bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:03.198991 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46651fe3-7480-4c12-8739-4461889e5bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:03.199291 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46651fe3-7480-4c12-8739-4461889e5bf2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:03.209725 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46651fe3-7480-4c12-8739-4461889e5bf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:53:03.217992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-46651fe3-7480-4c12-8739-4461889e5bf2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:53:03.217992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:03.217992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:03.217992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:03.217992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:03.217992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:03.217992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:03.217992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:03.217992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:03.217992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:03.217992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:03.217992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:03.217992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:53:03.217992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:53:03.217992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:53:03.217992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:53:03.218936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:53:03.218936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:53:03.218936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:53:03.218936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:53:03.218936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:03.218936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:03.218936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:03.218936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:03.218936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:03.218936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:03.218936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:03.218936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:53:03.218936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:03.218936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:03.218936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:03.218936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:03.219843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:03.219843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:03.219843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:03.219843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:03.219843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:53:03.219843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:53:03.219843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:53:03.219843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:53:03.219843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:53:03.219843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:53:03.219843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:53:03.219843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:53:03.219843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 506/1023] 10.222.0.24 () {56 vars in 1120 bytes} [Thu May 19 14:53:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:53:03.226645 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e42831-e898-4c20-a599-ed511d96a46e None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:03.335243 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e42831-e898-4c20-a599-ed511d96a46e None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:03.338167 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db3e37-02b2-46e2-ac19-c4c20f92c275 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:03.338471 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db3e37-02b2-46e2-ac19-c4c20f92c275 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:03.338758 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db3e37-02b2-46e2-ac19-c4c20f92c275 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:03.340178 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 507/1024] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:53:03.345758 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e77424-7e39-47d4-bc2f-d3b67186826c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:03.346056 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e77424-7e39-47d4-bc2f-d3b67186826c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:03.346341 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e77424-7e39-47d4-bc2f-d3b67186826c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:03.348574 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:03.364171 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f7e77424-7e39-47d4-bc2f-d3b67186826c None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:03.365925 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f7e77424-7e39-47d4-bc2f-d3b67186826c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:03.378065 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511250bf-49f6-41e3-9170-5bcdf3df9619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:03.379014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511250bf-49f6-41e3-9170-5bcdf3df9619 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:03.379331 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511250bf-49f6-41e3-9170-5bcdf3df9619 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:03.379606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511250bf-49f6-41e3-9170-5bcdf3df9619 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:03.380522 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511250bf-49f6-41e3-9170-5bcdf3df9619 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:03.381209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511250bf-49f6-41e3-9170-5bcdf3df9619 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:03.382590 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511250bf-49f6-41e3-9170-5bcdf3df9619 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:03.395270 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 518/1025] 10.222.0.24 () {56 vars in 1115 bytes} [Thu May 19 14:53:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:03.399118 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511250bf-49f6-41e3-9170-5bcdf3df9619 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:03.438798 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 508/1026] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:53:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:53:03.461802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e77424-7e39-47d4-bc2f-d3b67186826c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:03.494485 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:03.513950 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511250bf-49f6-41e3-9170-5bcdf3df9619 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:03.548551 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb8931-bdcf-40f1-8e14-9b627557954f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:03.549339 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb8931-bdcf-40f1-8e14-9b627557954f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:03.549619 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb8931-bdcf-40f1-8e14-9b627557954f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:03.549892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb8931-bdcf-40f1-8e14-9b627557954f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:03.561361 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb8931-bdcf-40f1-8e14-9b627557954f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:03.563642 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb8931-bdcf-40f1-8e14-9b627557954f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:03.573863 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e77424-7e39-47d4-bc2f-d3b67186826c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:03.583577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-d5bb8931-bdcf-40f1-8e14-9b627557954f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:53:03.583577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:03.583577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:03.583577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:03.583577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:03.583577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:03.583577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:03.583577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:03.583577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:03.583577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:03.583577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:03.583577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:03.583577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:53:03.583577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:53:03.583577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:53:03.584495 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:53:03.584495 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:03.584495 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:03.584495 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:03.584495 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:03.584495 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:03.584495 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:03.584495 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:03.584495 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:53:03.584495 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:03.584495 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:03.584495 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:03.584495 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:03.584495 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:03.584495 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:03.584495 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:03.584495 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:03.585410 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:53:03.585410 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:53:03.585410 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:53:03.585410 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:53:03.585410 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 519/1027] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:53:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:53:03.590245 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb8931-bdcf-40f1-8e14-9b627557954f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:03.611524 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70239ee4-5175-4722-a769-0dbe32d30cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:03.612320 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70239ee4-5175-4722-a769-0dbe32d30cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:03.612603 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70239ee4-5175-4722-a769-0dbe32d30cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:03.612877 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70239ee4-5175-4722-a769-0dbe32d30cb4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:03.613528 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70239ee4-5175-4722-a769-0dbe32d30cb4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:03.614925 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70239ee4-5175-4722-a769-0dbe32d30cb4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:03.617929 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:03.626919 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-70239ee4-5175-4722-a769-0dbe32d30cb4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:53:03.626919 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:03.626919 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:53:03.626919 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:53:03.626919 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:53:03.626919 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:53:03.626919 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:53:03.626919 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:53:03.626919 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:53:03.626919 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:53:03.626919 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:53:03.626919 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:53:03.626919 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:03.626919 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:03.626919 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:03.626919 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:03.626919 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:03.628200 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:03.628200 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:03.628200 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:03.628200 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:03.628200 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:03.628200 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:03.628200 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:53:03.628200 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:53:03.628200 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:53:03.628200 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:53:03.628200 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:03.628200 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:03.628200 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:03.628200 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:03.628200 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:03.628200 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:03.629046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:03.629046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:53:03.629046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:03.629046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:03.629046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:03.629046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:03.629046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:03.629046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:03.629046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:03.629046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:03.629046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:53:03.629046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:53:03.629046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:53:03.629046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:53:03.629046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 509/1028] 10.222.0.24 () {56 vars in 1105 bytes} [Thu May 19 14:53:03 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:53:03.634047 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70239ee4-5175-4722-a769-0dbe32d30cb4 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:03.702857 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb8931-bdcf-40f1-8e14-9b627557954f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:03.732208 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:03.740078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ebbb8-9e97-45cd-b0a3-3b9e015712c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:03.740696 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ebbb8-9e97-45cd-b0a3-3b9e015712c3 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:03.740974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ebbb8-9e97-45cd-b0a3-3b9e015712c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:03.741245 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ebbb8-9e97-45cd-b0a3-3b9e015712c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:03.741824 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70239ee4-5175-4722-a769-0dbe32d30cb4 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:03.741990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ebbb8-9e97-45cd-b0a3-3b9e015712c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:03.742252 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ebbb8-9e97-45cd-b0a3-3b9e015712c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:03.743645 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ebbb8-9e97-45cd-b0a3-3b9e015712c3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:03.756818 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 520/1029] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:53:03.762398 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ebbb8-9e97-45cd-b0a3-3b9e015712c3 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:03.784195 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981ecc4-94f9-4fa6-acb0-587845dbea8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:03.785229 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981ecc4-94f9-4fa6-acb0-587845dbea8b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:03.785742 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981ecc4-94f9-4fa6-acb0-587845dbea8b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:03.786250 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981ecc4-94f9-4fa6-acb0-587845dbea8b None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:03.787065 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981ecc4-94f9-4fa6-acb0-587845dbea8b None admin] RBAC: Adding query filter params (name=image) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:03.787484 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981ecc4-94f9-4fa6-acb0-587845dbea8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:03.788932 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981ecc4-94f9-4fa6-acb0-587845dbea8b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:03.798940 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 510/1030] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:53:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:53:03.799807 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981ecc4-94f9-4fa6-acb0-587845dbea8b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:03.854803 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:03.872449 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ebbb8-9e97-45cd-b0a3-3b9e015712c3 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:03.906972 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e263a0e-62e3-4919-a962-b411f55b858a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:03.907784 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e263a0e-62e3-4919-a962-b411f55b858a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:03.908061 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e263a0e-62e3-4919-a962-b411f55b858a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:03.908327 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e263a0e-62e3-4919-a962-b411f55b858a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:03.909332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981ecc4-94f9-4fa6-acb0-587845dbea8b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:03.915402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e263a0e-62e3-4919-a962-b411f55b858a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:03.916832 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e263a0e-62e3-4919-a962-b411f55b858a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:03.930977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-6e263a0e-62e3-4919-a962-b411f55b858a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:53:03.930977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:03.930977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:03.930977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:03.930977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:03.930977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:03.930977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:03.930977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:03.930977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:03.930977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:03.930977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:03.930977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:03.930977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:53:03.930977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:53:03.930977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:53:03.930977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:53:03.932075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:03.932075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:03.932075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:53:03.932075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:53:03.932075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:53:03.932075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:53:03.932075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:03.932075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:03.932075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:03.932075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:03.932075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:03.932075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:53:03.932075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:03.932075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:03.932075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:03.932075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:03.932075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:03.932075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:03.933029 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:03.933029 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:03.933029 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:53:03.933029 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:53:03.933029 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:53:03.933029 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:53:03.933029 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:53:03.933029 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:53:03.933029 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:53:03.933029 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:53:03.933029 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 521/1031] 10.222.0.24 () {56 vars in 1093 bytes} [Thu May 19 14:53:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:53:03.937837 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e263a0e-62e3-4919-a962-b411f55b858a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:03.946974 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d366d-d03c-430f-96b6-2b1a42655b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:03.947692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d366d-d03c-430f-96b6-2b1a42655b54 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:03.948350 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d366d-d03c-430f-96b6-2b1a42655b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:03.948639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d366d-d03c-430f-96b6-2b1a42655b54 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:03.949675 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d366d-d03c-430f-96b6-2b1a42655b54 None admin] RBAC: Adding query filter params (type=image) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:03.950538 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d366d-d03c-430f-96b6-2b1a42655b54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:03.952488 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d366d-d03c-430f-96b6-2b1a42655b54 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:03.957911 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 511/1032] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:53:03 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:03.963421 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d366d-d03c-430f-96b6-2b1a42655b54 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:03.987578 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:04.041195 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e263a0e-62e3-4919-a962-b411f55b858a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:04.076733 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d366d-d03c-430f-96b6-2b1a42655b54 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:04.087480 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d759088-75f0-4099-8666-acc0c4828274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:04.088166 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d759088-75f0-4099-8666-acc0c4828274 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:04.088500 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d759088-75f0-4099-8666-acc0c4828274 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:04.088791 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d759088-75f0-4099-8666-acc0c4828274 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:04.089627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d759088-75f0-4099-8666-acc0c4828274 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:04.089938 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d759088-75f0-4099-8666-acc0c4828274 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:04.091398 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d759088-75f0-4099-8666-acc0c4828274 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:04.118394 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 522/1033] 10.222.0.24 () {56 vars in 1133 bytes} [Thu May 19 14:53:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:53:04.124703 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127fa86-7521-4405-824e-0e53fee1a2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:04.125459 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127fa86-7521-4405-824e-0e53fee1a2c5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:04.125733 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d759088-75f0-4099-8666-acc0c4828274 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:04.125874 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127fa86-7521-4405-824e-0e53fee1a2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:04.126218 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127fa86-7521-4405-824e-0e53fee1a2c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:04.127084 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127fa86-7521-4405-824e-0e53fee1a2c5 None admin] RBAC: Adding query filter params (interface=public, service_id=1e468ae4cc954d4484c4fce1d4489124, region_id=RegionOne) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:04.127531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127fa86-7521-4405-824e-0e53fee1a2c5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:04.129016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127fa86-7521-4405-824e-0e53fee1a2c5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:04.129630 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:04.147232 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 512/1034] 10.222.0.24 () {56 vars in 1251 bytes} [Thu May 19 14:53:03 2022] GET /identity/v3/endpoints?service_id=1e468ae4cc954d4484c4fce1d4489124&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:53:04.152452 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127fa86-7521-4405-824e-0e53fee1a2c5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:04.234951 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d759088-75f0-4099-8666-acc0c4828274 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:04.240978 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:04.259466 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127fa86-7521-4405-824e-0e53fee1a2c5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:04.271804 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45263a3f-899b-4991-8d60-e8018e17c333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:04.272455 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45263a3f-899b-4991-8d60-e8018e17c333 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:04.272740 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45263a3f-899b-4991-8d60-e8018e17c333 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:04.273018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45263a3f-899b-4991-8d60-e8018e17c333 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:04.295561 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8de53-b41f-4555-b4b7-b558d45d8431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:04.296240 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8de53-b41f-4555-b4b7-b558d45d8431 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:04.296529 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8de53-b41f-4555-b4b7-b558d45d8431 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:04.296807 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c8de53-b41f-4555-b4b7-b558d45d8431 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:04.297493 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8de53-b41f-4555-b4b7-b558d45d8431 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:04.298878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c8de53-b41f-4555-b4b7-b558d45d8431 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:04.306068 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 513/1035] 10.222.0.24 () {56 vars in 1087 bytes} [Thu May 19 14:53:04 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 14:53:04.359514 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45263a3f-899b-4991-8d60-e8018e17c333 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:04.360990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45263a3f-899b-4991-8d60-e8018e17c333 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:04.363606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:04.487624 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 523/1036] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:53:04 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 14:53:04.489974 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8de53-b41f-4555-b4b7-b558d45d8431 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:04.594530 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c8de53-b41f-4555-b4b7-b558d45d8431 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:04.629355 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6ab8d-d3ba-45a1-85a7-4bff00e5a34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:04.630152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6ab8d-d3ba-45a1-85a7-4bff00e5a34b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:04.630441 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6ab8d-d3ba-45a1-85a7-4bff00e5a34b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:04.630718 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6ab8d-d3ba-45a1-85a7-4bff00e5a34b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:04.642141 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df6ab8d-d3ba-45a1-85a7-4bff00e5a34b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:04.643643 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df6ab8d-d3ba-45a1-85a7-4bff00e5a34b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:04.651547 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:04.661802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-2df6ab8d-d3ba-45a1-85a7-4bff00e5a34b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:53:04.661802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:04.661802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:04.661802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:04.661802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:04.661802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:04.661802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:04.661802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:04.661802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:04.661802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:04.661802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:04.661802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:04.661802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:53:04.661802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:53:04.661802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:53:04.662795 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:53:04.662795 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:04.662795 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:04.662795 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:04.662795 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:04.662795 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:04.662795 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:04.662795 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:04.662795 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:53:04.662795 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:04.662795 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:04.662795 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:04.662795 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:04.662795 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:04.662795 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:04.662795 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:04.662795 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:04.663730 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:53:04.663730 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:53:04.663730 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:53:04.663730 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:53:04.670796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 514/1037] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:53:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:53:04.672323 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45263a3f-899b-4991-8d60-e8018e17c333 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:04.771599 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45263a3f-899b-4991-8d60-e8018e17c333 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:04.773189 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:04.818062 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a2857-0f98-420b-8fe9-92275aa36269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:04.818732 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a2857-0f98-420b-8fe9-92275aa36269 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:04.819016 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a2857-0f98-420b-8fe9-92275aa36269 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:04.819324 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a2857-0f98-420b-8fe9-92275aa36269 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:04.820061 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a2857-0f98-420b-8fe9-92275aa36269 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:04.820370 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a2857-0f98-420b-8fe9-92275aa36269 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:04.821800 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a2857-0f98-420b-8fe9-92275aa36269 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:04.837883 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 524/1038] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:53:04.839550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6ab8d-d3ba-45a1-85a7-4bff00e5a34b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:04.943448 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6ab8d-d3ba-45a1-85a7-4bff00e5a34b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:04.978851 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52b934-e671-48db-b626-9e5bc2ebec9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:04.979678 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52b934-e671-48db-b626-9e5bc2ebec9f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:04.979967 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52b934-e671-48db-b626-9e5bc2ebec9f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:04.980243 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52b934-e671-48db-b626-9e5bc2ebec9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:04.987583 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52b934-e671-48db-b626-9e5bc2ebec9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:04.989032 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52b934-e671-48db-b626-9e5bc2ebec9f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:05.003269 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-7b52b934-e671-48db-b626-9e5bc2ebec9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:53:05.003269 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:05.003269 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:05.003269 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:05.003269 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:05.003269 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:05.003269 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:05.003269 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:05.003269 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:05.003269 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:05.003269 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:05.003269 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:05.003269 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:53:05.003269 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:53:05.003269 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:53:05.004142 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:53:05.004142 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:05.004142 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:05.004142 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:05.004142 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:05.004142 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:05.004142 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:05.004142 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:05.004142 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:53:05.004142 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:05.004142 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:05.004142 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:05.004142 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:05.004142 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:05.004142 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:05.004142 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:05.004142 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:05.005052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:53:05.005052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:53:05.005052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:53:05.005052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:53:05.005052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:53:05.005052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:53:05.005052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:53:05.005052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:53:05.007274 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 515/1039] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:53:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:53:05.010734 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a2857-0f98-420b-8fe9-92275aa36269 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:05.111994 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a2857-0f98-420b-8fe9-92275aa36269 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:05.123213 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62f5a1-0250-4eba-a595-8ebd07aac4fc None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:05.123617 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62f5a1-0250-4eba-a595-8ebd07aac4fc None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:05.123998 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62f5a1-0250-4eba-a595-8ebd07aac4fc None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:05.125471 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 516/1040] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:05.131032 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad568c30-2f97-4f1f-ab36-967f091ae1be None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:05.131351 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad568c30-2f97-4f1f-ab36-967f091ae1be None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:05.131634 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad568c30-2f97-4f1f-ab36-967f091ae1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:05.148567 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ad568c30-2f97-4f1f-ab36-967f091ae1be None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:05.149649 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584e42d-8b60-43f3-bdfd-f3124b4692a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:05.149789 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ad568c30-2f97-4f1f-ab36-967f091ae1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:05.150614 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584e42d-8b60-43f3-bdfd-f3124b4692a5 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:05.151039 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584e42d-8b60-43f3-bdfd-f3124b4692a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:05.151746 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584e42d-8b60-43f3-bdfd-f3124b4692a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:05.154178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9584e42d-8b60-43f3-bdfd-f3124b4692a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:05.154648 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9584e42d-8b60-43f3-bdfd-f3124b4692a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:05.156261 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9584e42d-8b60-43f3-bdfd-f3124b4692a5 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:05.172195 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 525/1041] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:53:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:05.178305 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584e42d-8b60-43f3-bdfd-f3124b4692a5 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:05.203622 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:05.213066 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:05.225972 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 517/1042] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:53:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:53:05.250155 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad568c30-2f97-4f1f-ab36-967f091ae1be None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:05.283800 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584e42d-8b60-43f3-bdfd-f3124b4692a5 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:05.322570 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83150452-688a-4f5b-b0cc-df60aab5a659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:05.323361 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83150452-688a-4f5b-b0cc-df60aab5a659 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:05.323714 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83150452-688a-4f5b-b0cc-df60aab5a659 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:05.324065 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83150452-688a-4f5b-b0cc-df60aab5a659 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:05.325527 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83150452-688a-4f5b-b0cc-df60aab5a659 None admin] RBAC: Adding query filter params (role.id=24772df324aa4eb7b66c7853b4b01439, scope.project.id=2633b53c336145bba3d4744dbdfe99b7, user.id=06fb8bb5aeb143ad95f33c3b43dbd346) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:05.325894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83150452-688a-4f5b-b0cc-df60aab5a659 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:05.327350 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83150452-688a-4f5b-b0cc-df60aab5a659 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:05.332946 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 526/1043] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:53:05 2022] GET /identity/v3/role_assignments?user.id=06fb8bb5aeb143ad95f33c3b43dbd346&scope.project.id=2633b53c336145bba3d4744dbdfe99b7&role.id=24772df324aa4eb7b66c7853b4b01439 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:53:05.370569 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad568c30-2f97-4f1f-ab36-967f091ae1be None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:05.411058 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850080d-8298-4fb8-a888-bbb87760a2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:05.411910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850080d-8298-4fb8-a888-bbb87760a2ec None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:05.412196 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850080d-8298-4fb8-a888-bbb87760a2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:05.412476 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850080d-8298-4fb8-a888-bbb87760a2ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:05.413738 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850080d-8298-4fb8-a888-bbb87760a2ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:05.415244 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850080d-8298-4fb8-a888-bbb87760a2ec None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:05.421814 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 518/1044] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:53:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:53:05.422868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83150452-688a-4f5b-b0cc-df60aab5a659 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:05.519878 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:05.538168 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83150452-688a-4f5b-b0cc-df60aab5a659 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:05.572046 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cf961-15ff-46ba-ae8f-21436b09376a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:05.572713 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cf961-15ff-46ba-ae8f-21436b09376a None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:05.572994 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cf961-15ff-46ba-ae8f-21436b09376a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:05.573271 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cf961-15ff-46ba-ae8f-21436b09376a None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:05.573984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585cf961-15ff-46ba-ae8f-21436b09376a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:05.575994 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585cf961-15ff-46ba-ae8f-21436b09376a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:05.603236 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 527/1045] 10.222.0.24 () {60 vars in 1132 bytes} [Thu May 19 14:53:05 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:53:06.558217 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707076f5-5638-42da-843f-05b13d434ced None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:06.558777 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707076f5-5638-42da-843f-05b13d434ced None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:06.558777 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707076f5-5638-42da-843f-05b13d434ced None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:06.560351 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 519/1046] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:06.565409 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce0489-e989-4770-8b35-3c60fb033b8d None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:06.565778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce0489-e989-4770-8b35-3c60fb033b8d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:06.565962 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce0489-e989-4770-8b35-3c60fb033b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:06.582589 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-65ce0489-e989-4770-8b35-3c60fb033b8d None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:06.583793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-65ce0489-e989-4770-8b35-3c60fb033b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:06.649921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 528/1047] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:53:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:53:06.672975 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707076f5-5638-42da-843f-05b13d434ced None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:06.732942 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:06.777828 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707076f5-5638-42da-843f-05b13d434ced None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:06.812282 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4ff9e-93c3-45dc-8441-0a71fbcd1218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:06.813073 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4ff9e-93c3-45dc-8441-0a71fbcd1218 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:06.813366 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4ff9e-93c3-45dc-8441-0a71fbcd1218 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:06.813645 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4ff9e-93c3-45dc-8441-0a71fbcd1218 None admin] PATH_INFO: `/v3/services/image` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:06.814292 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4ff9e-93c3-45dc-8441-0a71fbcd1218 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:06.815745 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4ff9e-93c3-45dc-8441-0a71fbcd1218 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:06.827837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-0ff4ff9e-93c3-45dc-8441-0a71fbcd1218 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:53:06.827837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:06.827837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:53:06.827837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:53:06.827837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:53:06.827837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:53:06.827837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:53:06.827837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:53:06.827837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:53:06.827837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:53:06.827837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:53:06.827837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:53:06.827837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:06.827837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:06.827837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:06.827837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:06.827837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:06.829044 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:06.829044 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:06.829044 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:06.829044 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:06.829044 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:06.829044 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:06.829044 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:53:06.829044 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:53:06.829044 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:53:06.829044 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:53:06.829044 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:06.829044 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:06.829044 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:06.829044 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:06.829044 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:06.829044 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:06.830069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:06.830069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:53:06.830069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:06.830069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:06.830069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:06.830069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:06.830069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:06.830069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:06.830069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:06.830069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:06.830069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:53:06.830069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:53:06.830069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 19 14:53:06.830069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:53:06.831244 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 520/1048] 10.222.0.24 () {56 vars in 1105 bytes} [Thu May 19 14:53:06 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:53:06.834861 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce0489-e989-4770-8b35-3c60fb033b8d None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:06.903662 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:06.935114 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce0489-e989-4770-8b35-3c60fb033b8d None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:06.969053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f52f1-34fd-469a-abaf-8eb1c5390b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:06.969712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f52f1-34fd-469a-abaf-8eb1c5390b11 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:06.969994 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f52f1-34fd-469a-abaf-8eb1c5390b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:06.970267 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f52f1-34fd-469a-abaf-8eb1c5390b11 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:06.970976 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f52f1-34fd-469a-abaf-8eb1c5390b11 None admin] RBAC: Adding query filter params (name=image) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:06.971309 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f52f1-34fd-469a-abaf-8eb1c5390b11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:06.972675 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f52f1-34fd-469a-abaf-8eb1c5390b11 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:06.982090 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 529/1049] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:53:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:53:06.983253 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4ff9e-93c3-45dc-8441-0a71fbcd1218 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:07.082766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4ff9e-93c3-45dc-8441-0a71fbcd1218 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:07.104364 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:07.116836 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f1c53-045e-49b7-99cc-939f42c8ad9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:07.117507 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f1c53-045e-49b7-99cc-939f42c8ad9d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:07.117796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f1c53-045e-49b7-99cc-939f42c8ad9d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:07.118078 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f1c53-045e-49b7-99cc-939f42c8ad9d None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:07.118784 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f1c53-045e-49b7-99cc-939f42c8ad9d None admin] RBAC: Adding query filter params (type=image) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:07.119095 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f1c53-045e-49b7-99cc-939f42c8ad9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:07.120762 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f1c53-045e-49b7-99cc-939f42c8ad9d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:07.126522 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 521/1050] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:53:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:07.131992 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f52f1-34fd-469a-abaf-8eb1c5390b11 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:07.239051 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f52f1-34fd-469a-abaf-8eb1c5390b11 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:07.273345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e4262-f689-4b1d-8b87-ddce3b60a1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:07.274000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e4262-f689-4b1d-8b87-ddce3b60a1c2 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:07.274277 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e4262-f689-4b1d-8b87-ddce3b60a1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:07.274547 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e4262-f689-4b1d-8b87-ddce3b60a1c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:07.275340 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e4262-f689-4b1d-8b87-ddce3b60a1c2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:07.276648 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e4262-f689-4b1d-8b87-ddce3b60a1c2 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:07.280685 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:07.303231 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 530/1051] 10.222.0.24 () {60 vars in 1144 bytes} [Thu May 19 14:53:07 2022] POST /identity/v3/endpoints => generated 327 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:53:07.603713 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad11dd7-af51-4b32-acf4-b9b7b94cb703 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:07.604238 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad11dd7-af51-4b32-acf4-b9b7b94cb703 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:07.604351 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad11dd7-af51-4b32-acf4-b9b7b94cb703 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:07.605905 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 522/1052] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:07.611643 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9f877-77d0-4c3f-964e-02a11b422064 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:07.612046 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9f877-77d0-4c3f-964e-02a11b422064 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:07.612212 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9f877-77d0-4c3f-964e-02a11b422064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:07.629753 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d2f9f877-77d0-4c3f-964e-02a11b422064 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:07.630950 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d2f9f877-77d0-4c3f-964e-02a11b422064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:07.705719 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 531/1053] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:53:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:53:07.728638 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad11dd7-af51-4b32-acf4-b9b7b94cb703 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:07.839341 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad11dd7-af51-4b32-acf4-b9b7b94cb703 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:07.877241 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad66d13-5d36-4bcc-88df-3108ffa42323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:07.877983 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad66d13-5d36-4bcc-88df-3108ffa42323 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:07.878272 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad66d13-5d36-4bcc-88df-3108ffa42323 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:07.878555 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad66d13-5d36-4bcc-88df-3108ffa42323 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:07.889504 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad66d13-5d36-4bcc-88df-3108ffa42323 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:53:07.897674 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-9ad66d13-5d36-4bcc-88df-3108ffa42323 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:53:07.897674 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:07.897674 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:07.897674 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:07.897674 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:07.897674 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:07.897674 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:07.897674 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:07.897674 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:07.897674 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:07.897674 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:07.897674 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:07.897674 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:53:07.897674 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:53:07.897674 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:53:07.897674 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:53:07.898590 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:53:07.898590 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:53:07.898590 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:53:07.898590 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:53:07.898590 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:07.898590 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:07.898590 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:07.898590 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:07.898590 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:07.898590 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:07.898590 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:07.898590 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:53:07.898590 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:07.898590 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:07.898590 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:07.898590 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:07.899910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:07.899910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:07.899910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:07.899910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:07.899910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:53:07.899910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:53:07.899910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:53:07.899910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:53:07.899910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:53:07.899910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:53:07.899910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:53:07.899910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:53:07.899910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 523/1054] 10.222.0.24 () {56 vars in 1120 bytes} [Thu May 19 14:53:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:53:07.901178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59951266-184c-4498-a260-eb40c217e478 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:07.901476 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59951266-184c-4498-a260-eb40c217e478 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:07.901754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59951266-184c-4498-a260-eb40c217e478 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:07.903810 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 532/1055] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:53:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:07.905054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad66d13-5d36-4bcc-88df-3108ffa42323 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:07.908756 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb44e2c-47a7-4873-978a-540f208e1946 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:07.909051 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb44e2c-47a7-4873-978a-540f208e1946 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:07.909331 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb44e2c-47a7-4873-978a-540f208e1946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:07.926166 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-bbb44e2c-47a7-4873-978a-540f208e1946 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:07.927387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-bbb44e2c-47a7-4873-978a-540f208e1946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:07.952839 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:07.997747 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 533/1056] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:53:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:53:08.006667 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad66d13-5d36-4bcc-88df-3108ffa42323 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:08.021153 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb44e2c-47a7-4873-978a-540f208e1946 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:08.044360 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec99f9-7f4b-41d8-a15a-34bf6483f142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:08.045156 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec99f9-7f4b-41d8-a15a-34bf6483f142 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:08.045448 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec99f9-7f4b-41d8-a15a-34bf6483f142 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:08.045839 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec99f9-7f4b-41d8-a15a-34bf6483f142 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:08.046674 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec99f9-7f4b-41d8-a15a-34bf6483f142 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:08.046907 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec99f9-7f4b-41d8-a15a-34bf6483f142 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:08.048481 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec99f9-7f4b-41d8-a15a-34bf6483f142 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:08.057198 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 524/1057] 10.222.0.24 () {56 vars in 1115 bytes} [Thu May 19 14:53:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:08.062768 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec99f9-7f4b-41d8-a15a-34bf6483f142 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:08.070823 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:08.124470 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb44e2c-47a7-4873-978a-540f208e1946 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:08.159945 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34a28f-6e04-4e8f-a469-3dd8409175f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:08.160742 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34a28f-6e04-4e8f-a469-3dd8409175f3 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:08.161028 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34a28f-6e04-4e8f-a469-3dd8409175f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:08.161377 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34a28f-6e04-4e8f-a469-3dd8409175f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:08.171604 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec99f9-7f4b-41d8-a15a-34bf6483f142 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:08.171753 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34a28f-6e04-4e8f-a469-3dd8409175f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:53:08.179372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-9a34a28f-6e04-4e8f-a469-3dd8409175f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:53:08.179372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:08.179372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:08.179372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:08.179372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:08.179372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:08.179372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:08.179372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:08.179372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:08.179372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:08.179372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:08.179372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:08.179372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:53:08.179372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:53:08.179372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:53:08.179372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:53:08.180298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:53:08.180298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:53:08.180298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:53:08.180298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:53:08.180298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:08.180298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:08.180298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:08.180298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:08.180298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:08.180298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:08.180298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:08.180298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:53:08.180298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:08.180298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:08.180298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:08.180298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:08.181129 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:08.181129 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:08.181129 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:08.181129 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:08.181129 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:53:08.181129 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:53:08.181129 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:53:08.181129 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:53:08.181129 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:53:08.181129 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:53:08.181129 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:53:08.181129 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:53:08.182190 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:08.185546 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 534/1058] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:53:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:53:08.186951 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34a28f-6e04-4e8f-a469-3dd8409175f3 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:08.211468 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43888ab-f9e6-4a42-85e5-2990fca66814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:08.212269 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43888ab-f9e6-4a42-85e5-2990fca66814 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:08.212558 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43888ab-f9e6-4a42-85e5-2990fca66814 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:08.212841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43888ab-f9e6-4a42-85e5-2990fca66814 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:08.224202 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43888ab-f9e6-4a42-85e5-2990fca66814 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:08.225654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43888ab-f9e6-4a42-85e5-2990fca66814 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:08.242923 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-f43888ab-f9e6-4a42-85e5-2990fca66814 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:53:08.242923 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:08.242923 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:08.242923 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:08.242923 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:08.242923 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:08.242923 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:08.242923 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:08.242923 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:08.242923 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:08.242923 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:08.242923 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:08.242923 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:53:08.242923 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:53:08.242923 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:53:08.244124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:53:08.244124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:08.244124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:08.244124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:08.244124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:08.244124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:08.244124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:08.244124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:08.244124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:53:08.244124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:08.244124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:08.244124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:08.244124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:08.244124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:08.244124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:08.244124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:08.244124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:08.245391 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:53:08.245391 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:53:08.245391 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:53:08.245391 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:53:08.245391 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 525/1059] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:53:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:53:08.249983 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43888ab-f9e6-4a42-85e5-2990fca66814 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:08.293748 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34a28f-6e04-4e8f-a469-3dd8409175f3 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:08.303850 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:08.338707 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff7f7b-261e-4834-a9ca-8d081a1d6dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:08.339409 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff7f7b-261e-4834-a9ca-8d081a1d6dcf None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:08.339700 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff7f7b-261e-4834-a9ca-8d081a1d6dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:08.339977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff7f7b-261e-4834-a9ca-8d081a1d6dcf None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:08.341283 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff7f7b-261e-4834-a9ca-8d081a1d6dcf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:08.341591 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff7f7b-261e-4834-a9ca-8d081a1d6dcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:08.342992 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff7f7b-261e-4834-a9ca-8d081a1d6dcf None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:08.356066 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 535/1060] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:53:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:53:08.357137 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff7f7b-261e-4834-a9ca-8d081a1d6dcf None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:08.371009 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43888ab-f9e6-4a42-85e5-2990fca66814 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:08.407088 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e2c3f-94c3-4712-b607-282bb3814957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:08.407785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e2c3f-94c3-4712-b607-282bb3814957 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:08.408077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e2c3f-94c3-4712-b607-282bb3814957 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:08.408403 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e2c3f-94c3-4712-b607-282bb3814957 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:08.409261 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e2c3f-94c3-4712-b607-282bb3814957 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:08.409578 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e2c3f-94c3-4712-b607-282bb3814957 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:08.411019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e2c3f-94c3-4712-b607-282bb3814957 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:08.424830 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 526/1061] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:53:08.430113 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e2c3f-94c3-4712-b607-282bb3814957 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:08.454387 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:08.471378 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff7f7b-261e-4834-a9ca-8d081a1d6dcf None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:08.507517 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f593d-8327-416a-8b85-b6f6f057b268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:08.508415 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f593d-8327-416a-8b85-b6f6f057b268 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:08.508698 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f593d-8327-416a-8b85-b6f6f057b268 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:08.509060 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f593d-8327-416a-8b85-b6f6f057b268 None admin] PATH_INFO: `/v3/users/7e79c3e2b74e4886b35b9f2eb778299c` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:08.523232 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f593d-8327-416a-8b85-b6f6f057b268 None admin] RBAC: Authorizing `identity:get_user(user_id=7e79c3e2b74e4886b35b9f2eb778299c)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:08.524678 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f593d-8327-416a-8b85-b6f6f057b268 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:08.526543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 536/1062] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:53:08 2022] GET /identity/v3/users/7e79c3e2b74e4886b35b9f2eb778299c => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:08.531901 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f593d-8327-416a-8b85-b6f6f057b268 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:08.536807 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e2c3f-94c3-4712-b607-282bb3814957 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:08.560345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:08.572997 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c19dd-85c8-4c6c-9065-423f1ff619ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:08.573797 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c19dd-85c8-4c6c-9065-423f1ff619ab None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:08.574086 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c19dd-85c8-4c6c-9065-423f1ff619ab None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:08.574367 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c19dd-85c8-4c6c-9065-423f1ff619ab None admin] PATH_INFO: `/v3/users/nova` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:08.582943 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c19dd-85c8-4c6c-9065-423f1ff619ab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:08.584375 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c19dd-85c8-4c6c-9065-423f1ff619ab None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:08.599748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-186c19dd-85c8-4c6c-9065-423f1ff619ab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:53:08.599748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:08.599748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:08.599748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:08.599748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:08.599748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:08.599748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:08.599748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:08.599748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:08.599748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:08.599748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:08.599748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:08.599748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:53:08.599748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:53:08.599748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:53:08.599748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:53:08.600696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:08.600696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:08.600696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:53:08.600696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:53:08.600696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:53:08.600696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:53:08.600696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:08.600696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:08.600696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:08.600696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:08.600696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:08.600696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:53:08.600696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:08.600696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:08.600696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:08.600696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:08.600696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:08.600696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:08.601655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:08.601655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:08.601655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:53:08.601655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:53:08.601655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:53:08.601655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:53:08.601655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:53:08.601655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:53:08.601655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:53:08.601655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:53:08.601655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 527/1063] 10.222.0.24 () {56 vars in 1093 bytes} [Thu May 19 14:53:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:53:08.606831 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c19dd-85c8-4c6c-9065-423f1ff619ab None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:08.638464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f593d-8327-416a-8b85-b6f6f057b268 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:08.672045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1ad8b-f983-42f8-af6a-ba9cb36d8ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:08.672621 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1ad8b-f983-42f8-af6a-ba9cb36d8ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:08.672900 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1ad8b-f983-42f8-af6a-ba9cb36d8ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:08.673201 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1ad8b-f983-42f8-af6a-ba9cb36d8ae5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:08.692116 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:08.713639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c19dd-85c8-4c6c-9065-423f1ff619ab None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:08.743389 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1ad8b-f983-42f8-af6a-ba9cb36d8ae5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:08.745085 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1ad8b-f983-42f8-af6a-ba9cb36d8ae5 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:08.749896 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee10ec-67f6-41d4-899b-c027879b9909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:08.750762 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee10ec-67f6-41d4-899b-c027879b9909 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:08.751228 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee10ec-67f6-41d4-899b-c027879b9909 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:08.751669 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee10ec-67f6-41d4-899b-c027879b9909 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:08.752649 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee10ec-67f6-41d4-899b-c027879b9909 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:08.753187 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee10ec-67f6-41d4-899b-c027879b9909 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:08.754872 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee10ec-67f6-41d4-899b-c027879b9909 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:08.773107 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:08.779405 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 528/1064] 10.222.0.24 () {56 vars in 1133 bytes} [Thu May 19 14:53:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:08.780300 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee10ec-67f6-41d4-899b-c027879b9909 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:08.858904 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 537/1065] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:53:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 14:53:08.864654 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1ad8b-f983-42f8-af6a-ba9cb36d8ae5 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:08.900787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee10ec-67f6-41d4-899b-c027879b9909 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:08.935735 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19706920-ab20-4405-9f35-647c378f1e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:08.936604 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19706920-ab20-4405-9f35-647c378f1e12 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:08.936887 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19706920-ab20-4405-9f35-647c378f1e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:08.937914 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19706920-ab20-4405-9f35-647c378f1e12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:08.946070 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:08.950945 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19706920-ab20-4405-9f35-647c378f1e12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:08.952729 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19706920-ab20-4405-9f35-647c378f1e12 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:08.967673 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1ad8b-f983-42f8-af6a-ba9cb36d8ae5 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:08.972506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-19706920-ab20-4405-9f35-647c378f1e12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:53:08.972506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:08.972506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:08.972506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:08.972506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:08.972506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:08.972506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:08.972506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:08.972506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:08.972506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:08.972506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:08.972506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:08.972506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:53:08.972506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:53:08.972506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:53:08.973383 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:53:08.973383 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:08.973383 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:08.973383 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:08.973383 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:08.973383 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:08.973383 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:08.973383 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:08.973383 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:53:08.973383 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:08.973383 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:08.973383 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:08.973383 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:08.973383 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:08.973383 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:08.973383 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:08.973383 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:08.974377 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:53:08.974377 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:53:08.974377 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:53:08.974377 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:53:08.974377 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 529/1066] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:53:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:53:08.979351 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19706920-ab20-4405-9f35-647c378f1e12 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:09.004376 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:09.014446 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881c97a-d53d-411d-ae63-8e86a3302d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:09.015322 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881c97a-d53d-411d-ae63-8e86a3302d3b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:09.015601 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881c97a-d53d-411d-ae63-8e86a3302d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:09.015871 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881c97a-d53d-411d-ae63-8e86a3302d3b None admin] PATH_INFO: `/v3/projects/4d97b222963c4203bfc51b4fd8d91371` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:09.017045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881c97a-d53d-411d-ae63-8e86a3302d3b None admin] RBAC: Authorizing `identity:get_project(project_id=4d97b222963c4203bfc51b4fd8d91371)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:09.018473 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881c97a-d53d-411d-ae63-8e86a3302d3b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:09.020212 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 538/1067] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:53:08 2022] GET /identity/v3/projects/4d97b222963c4203bfc51b4fd8d91371 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:53:09.026014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881c97a-d53d-411d-ae63-8e86a3302d3b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:09.087542 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19706920-ab20-4405-9f35-647c378f1e12 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:09.128958 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c843c7d-a2e4-4399-8a8f-18413f692ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:09.130204 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c843c7d-a2e4-4399-8a8f-18413f692ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:09.130635 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c843c7d-a2e4-4399-8a8f-18413f692ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:09.130920 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c843c7d-a2e4-4399-8a8f-18413f692ac5 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:09.131703 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c843c7d-a2e4-4399-8a8f-18413f692ac5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:09.132024 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c843c7d-a2e4-4399-8a8f-18413f692ac5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:09.132285 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881c97a-d53d-411d-ae63-8e86a3302d3b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:09.133460 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c843c7d-a2e4-4399-8a8f-18413f692ac5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:09.148602 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 530/1068] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:53:09.154767 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c843c7d-a2e4-4399-8a8f-18413f692ac5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:09.170504 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab5dd6-f7c4-46aa-9c8a-5ef9908fce56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:09.171153 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab5dd6-f7c4-46aa-9c8a-5ef9908fce56 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:09.171510 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab5dd6-f7c4-46aa-9c8a-5ef9908fce56 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:09.171777 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab5dd6-f7c4-46aa-9c8a-5ef9908fce56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:09.172606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab5dd6-f7c4-46aa-9c8a-5ef9908fce56 None admin] RBAC: Adding query filter params (role.id=ec4b73b709ca4cdc983e35e955aed57a, scope.project.id=4d97b222963c4203bfc51b4fd8d91371, user.id=7e79c3e2b74e4886b35b9f2eb778299c) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:09.172912 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab5dd6-f7c4-46aa-9c8a-5ef9908fce56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:09.174328 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab5dd6-f7c4-46aa-9c8a-5ef9908fce56 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:09.187654 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 539/1069] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:53:09 2022] GET /identity/v3/role_assignments?user.id=7e79c3e2b74e4886b35b9f2eb778299c&scope.project.id=4d97b222963c4203bfc51b4fd8d91371&role.id=ec4b73b709ca4cdc983e35e955aed57a => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:53:09.210864 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:09.276598 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c843c7d-a2e4-4399-8a8f-18413f692ac5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:09.317642 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4dfd2d-825e-425f-9d8d-d686f4516040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:09.318469 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dfd2d-825e-425f-9d8d-d686f4516040 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:09.318759 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dfd2d-825e-425f-9d8d-d686f4516040 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:09.319041 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dfd2d-825e-425f-9d8d-d686f4516040 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:09.329827 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4dfd2d-825e-425f-9d8d-d686f4516040 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:09.331354 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4dfd2d-825e-425f-9d8d-d686f4516040 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:09.347659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-4b4dfd2d-825e-425f-9d8d-d686f4516040 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:53:09.347659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:09.347659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:09.347659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:09.347659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:09.347659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:09.347659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:09.347659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:09.347659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:09.347659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:09.347659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:09.347659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:09.347659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:53:09.347659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:53:09.347659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:53:09.348668 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:53:09.348668 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:09.348668 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:09.348668 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:09.348668 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:09.348668 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:09.348668 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:09.348668 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:09.348668 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:53:09.348668 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:09.348668 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:09.348668 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:09.348668 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:09.348668 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:09.348668 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:09.348668 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:09.348668 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:09.349578 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:53:09.349578 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:53:09.349578 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:53:09.349578 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:53:09.349578 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:53:09.349578 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:53:09.349578 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:53:09.349578 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:53:09.351549 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 531/1070] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:53:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:53:09.354923 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab5dd6-f7c4-46aa-9c8a-5ef9908fce56 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:09.425871 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:09.474648 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab5dd6-f7c4-46aa-9c8a-5ef9908fce56 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:09.514340 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c59ddd-a0b3-456d-b4b8-a4160c92556c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:09.515008 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c59ddd-a0b3-456d-b4b8-a4160c92556c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:09.515320 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c59ddd-a0b3-456d-b4b8-a4160c92556c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:09.515599 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c59ddd-a0b3-456d-b4b8-a4160c92556c None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:09.516390 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c59ddd-a0b3-456d-b4b8-a4160c92556c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:09.516697 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c59ddd-a0b3-456d-b4b8-a4160c92556c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:09.518135 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c59ddd-a0b3-456d-b4b8-a4160c92556c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:09.532762 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 540/1071] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:53:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:09.538521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4dfd2d-825e-425f-9d8d-d686f4516040 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:09.584280 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cac87-f4bd-41ba-9a04-18a2f013241c None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:09.584598 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cac87-f4bd-41ba-9a04-18a2f013241c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:09.584930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cac87-f4bd-41ba-9a04-18a2f013241c None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:09.586299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 541/1072] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:53:09.592540 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b9eee-aad0-4bd8-b411-967d908607b4 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:09.592821 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b9eee-aad0-4bd8-b411-967d908607b4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:09.593093 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b9eee-aad0-4bd8-b411-967d908607b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:09.610622 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-304b9eee-aad0-4bd8-b411-967d908607b4 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:09.611847 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-304b9eee-aad0-4bd8-b411-967d908607b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:09.661037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4dfd2d-825e-425f-9d8d-d686f4516040 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:09.674353 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:09.687576 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 542/1073] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:53:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:53:09.706201 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a307f2-9fed-4298-8134-3e513709d80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:09.707134 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a307f2-9fed-4298-8134-3e513709d80d None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:09.707405 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a307f2-9fed-4298-8134-3e513709d80d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:09.708779 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a307f2-9fed-4298-8134-3e513709d80d None admin] PATH_INFO: `/v3/projects/2633b53c336145bba3d4744dbdfe99b7/users/06fb8bb5aeb143ad95f33c3b43dbd346/roles/24772df324aa4eb7b66c7853b4b01439` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:09.709853 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b9eee-aad0-4bd8-b411-967d908607b4 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:09.710558 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a307f2-9fed-4298-8134-3e513709d80d None admin] RBAC: Authorizing `identity:create_grant(project_id=2633b53c336145bba3d4744dbdfe99b7, user_id=06fb8bb5aeb143ad95f33c3b43dbd346, role_id=24772df324aa4eb7b66c7853b4b01439)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:09.712073 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a307f2-9fed-4298-8134-3e513709d80d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:09.727611 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 532/1074] 10.222.0.24 () {58 vars in 1439 bytes} [Thu May 19 14:53:09 2022] PUT /identity/v3/projects/2633b53c336145bba3d4744dbdfe99b7/users/06fb8bb5aeb143ad95f33c3b43dbd346/roles/24772df324aa4eb7b66c7853b4b01439 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:53:09.767396 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:09.825244 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b9eee-aad0-4bd8-b411-967d908607b4 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:09.862901 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380dff4-a6d5-4070-bd93-0b3079554342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:09.863804 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380dff4-a6d5-4070-bd93-0b3079554342 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:09.863982 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380dff4-a6d5-4070-bd93-0b3079554342 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:09.864218 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380dff4-a6d5-4070-bd93-0b3079554342 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:09.940749 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380dff4-a6d5-4070-bd93-0b3079554342 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:09.942215 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380dff4-a6d5-4070-bd93-0b3079554342 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:09.990191 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:10.043098 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 543/1075] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:53:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:53:10.049823 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a307f2-9fed-4298-8134-3e513709d80d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:10.149289 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a307f2-9fed-4298-8134-3e513709d80d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:10.182872 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df262f82-e153-431c-8c6d-b1bd63690186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:10.183691 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df262f82-e153-431c-8c6d-b1bd63690186 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:10.183993 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df262f82-e153-431c-8c6d-b1bd63690186 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:10.184282 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df262f82-e153-431c-8c6d-b1bd63690186 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:10.194139 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df262f82-e153-431c-8c6d-b1bd63690186 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:10.195612 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df262f82-e153-431c-8c6d-b1bd63690186 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:10.212720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-df262f82-e153-431c-8c6d-b1bd63690186 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:53:10.212720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:10.212720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:10.212720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:10.212720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:10.212720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:10.212720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:10.212720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:10.212720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:10.212720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:10.212720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:10.212720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:10.212720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:53:10.212720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:53:10.212720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:53:10.213608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:53:10.213608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:10.213608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:10.213608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:10.213608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:10.213608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:10.213608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:10.213608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:10.213608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:53:10.213608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:10.213608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:10.213608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:10.213608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:10.213608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:10.213608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:10.213608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:10.213608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:10.214511 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:53:10.214511 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:53:10.214511 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:53:10.214511 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:53:10.219303 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 533/1076] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:53:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:53:10.220295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380dff4-a6d5-4070-bd93-0b3079554342 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:10.323566 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380dff4-a6d5-4070-bd93-0b3079554342 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:10.358822 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087def5-da9d-4c66-b335-aa8197aaafdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:10.359506 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087def5-da9d-4c66-b335-aa8197aaafdd None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:10.359790 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087def5-da9d-4c66-b335-aa8197aaafdd None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:10.360065 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087def5-da9d-4c66-b335-aa8197aaafdd None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:10.360783 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087def5-da9d-4c66-b335-aa8197aaafdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:10.361088 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087def5-da9d-4c66-b335-aa8197aaafdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:10.362442 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087def5-da9d-4c66-b335-aa8197aaafdd None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:10.374291 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 544/1077] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:11.410519 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d9dce-efb5-46b5-a36a-cf8423e0ce3f None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:11.411030 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d9dce-efb5-46b5-a36a-cf8423e0ce3f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:11.411115 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d9dce-efb5-46b5-a36a-cf8423e0ce3f None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:11.412494 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 534/1078] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:11.417950 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c760c-a621-44c7-a707-a5b6d9e773d1 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:11.418382 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c760c-a621-44c7-a707-a5b6d9e773d1 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:11.418632 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c760c-a621-44c7-a707-a5b6d9e773d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:11.435019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7c0c760c-a621-44c7-a707-a5b6d9e773d1 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:11.436222 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7c0c760c-a621-44c7-a707-a5b6d9e773d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:11.439457 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:11.502278 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 545/1079] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:53:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:53:11.524857 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d9dce-efb5-46b5-a36a-cf8423e0ce3f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:11.548521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:11.625587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d9dce-efb5-46b5-a36a-cf8423e0ce3f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:11.658020 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b72aa-797e-4a0a-879e-12cceeea6733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:11.658810 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b72aa-797e-4a0a-879e-12cceeea6733 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:11.659097 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b72aa-797e-4a0a-879e-12cceeea6733 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:11.659408 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b72aa-797e-4a0a-879e-12cceeea6733 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:11.669443 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b72aa-797e-4a0a-879e-12cceeea6733 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:53:11.677053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-328b72aa-797e-4a0a-879e-12cceeea6733 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:53:11.677053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:11.677053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:11.677053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:11.677053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:11.677053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:11.677053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:11.677053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:11.677053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:11.677053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:11.677053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:11.677053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:11.677053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:53:11.677053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:53:11.677053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:53:11.677053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:53:11.677957 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:53:11.677957 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:53:11.677957 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:53:11.677957 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:53:11.677957 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:11.677957 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:11.677957 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:11.677957 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:11.677957 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:11.677957 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:11.677957 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:11.677957 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:53:11.677957 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:11.677957 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:11.677957 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:11.677957 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:11.678784 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:11.678784 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:11.678784 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:11.678784 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:11.678784 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:53:11.678784 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:53:11.678784 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:53:11.678784 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:53:11.678784 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:53:11.678784 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:53:11.678784 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:53:11.678784 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:53:11.678784 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 535/1080] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:53:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:53:11.684780 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c760c-a621-44c7-a707-a5b6d9e773d1 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:11.784510 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c760c-a621-44c7-a707-a5b6d9e773d1 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:11.817643 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a45b3-6447-4150-84e5-3086935e3c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:11.818305 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a45b3-6447-4150-84e5-3086935e3c42 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:11.818586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a45b3-6447-4150-84e5-3086935e3c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:11.818858 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a45b3-6447-4150-84e5-3086935e3c42 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:11.819637 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a45b3-6447-4150-84e5-3086935e3c42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:11.819941 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a45b3-6447-4150-84e5-3086935e3c42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:11.821289 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a45b3-6447-4150-84e5-3086935e3c42 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:11.834883 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 546/1081] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:53:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:53:11.836565 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b72aa-797e-4a0a-879e-12cceeea6733 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:11.924705 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:11.936226 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505daa3-b35a-40a5-8f67-a4ee5ac4a0f3 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:11.936513 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505daa3-b35a-40a5-8f67-a4ee5ac4a0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:11.936788 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505daa3-b35a-40a5-8f67-a4ee5ac4a0f3 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:11.938129 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 547/1082] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:53:11.942998 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf570d34-3a26-4a17-ad0b-b8e2a37cf6fa None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:11.943305 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf570d34-3a26-4a17-ad0b-b8e2a37cf6fa None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:11.943586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf570d34-3a26-4a17-ad0b-b8e2a37cf6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:11.943964 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b72aa-797e-4a0a-879e-12cceeea6733 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:11.948594 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:11.961096 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-cf570d34-3a26-4a17-ad0b-b8e2a37cf6fa None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:11.962369 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-cf570d34-3a26-4a17-ad0b-b8e2a37cf6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:11.976383 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20497a-cd7f-457a-b0ad-9dc5b963eaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:11.977248 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20497a-cd7f-457a-b0ad-9dc5b963eaa9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:11.977527 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20497a-cd7f-457a-b0ad-9dc5b963eaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:11.977799 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20497a-cd7f-457a-b0ad-9dc5b963eaa9 None admin] PATH_INFO: `/v3/users/7e79c3e2b74e4886b35b9f2eb778299c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:11.978978 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20497a-cd7f-457a-b0ad-9dc5b963eaa9 None admin] RBAC: Authorizing `identity:get_user(user_id=7e79c3e2b74e4886b35b9f2eb778299c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:11.980443 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20497a-cd7f-457a-b0ad-9dc5b963eaa9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:11.982587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 536/1083] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:53:11 2022] GET /identity/v3/users/7e79c3e2b74e4886b35b9f2eb778299c => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:11.988087 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20497a-cd7f-457a-b0ad-9dc5b963eaa9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:12.029865 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 548/1084] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:53:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:53:12.052982 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf570d34-3a26-4a17-ad0b-b8e2a37cf6fa None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:12.087395 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20497a-cd7f-457a-b0ad-9dc5b963eaa9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:12.120313 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689acfc-b3ff-4728-ad61-3435b66bfc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:12.121163 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689acfc-b3ff-4728-ad61-3435b66bfc05 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:12.121451 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689acfc-b3ff-4728-ad61-3435b66bfc05 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:12.122274 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689acfc-b3ff-4728-ad61-3435b66bfc05 None admin] PATH_INFO: `/v3/projects/4d97b222963c4203bfc51b4fd8d91371` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:12.123469 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689acfc-b3ff-4728-ad61-3435b66bfc05 None admin] RBAC: Authorizing `identity:get_project(project_id=4d97b222963c4203bfc51b4fd8d91371)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:12.124918 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689acfc-b3ff-4728-ad61-3435b66bfc05 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:12.126604 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 537/1085] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:53:11 2022] GET /identity/v3/projects/4d97b222963c4203bfc51b4fd8d91371 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:53:12.132496 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689acfc-b3ff-4728-ad61-3435b66bfc05 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:12.149095 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf570d34-3a26-4a17-ad0b-b8e2a37cf6fa None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:12.151100 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:12.178535 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:12.184048 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345d84b-0851-4501-b6b0-11b902d67ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:12.184864 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345d84b-0851-4501-b6b0-11b902d67ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:12.185155 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345d84b-0851-4501-b6b0-11b902d67ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:12.185437 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345d84b-0851-4501-b6b0-11b902d67ce3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:12.195576 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345d84b-0851-4501-b6b0-11b902d67ce3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:53:12.204181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-e345d84b-0851-4501-b6b0-11b902d67ce3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:53:12.204181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:12.204181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:12.204181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:12.204181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:12.204181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:12.204181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:12.204181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:12.204181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:12.204181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:12.204181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:12.204181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:12.204181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:53:12.204181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:53:12.204181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:53:12.204181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:53:12.205094 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:53:12.205094 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:53:12.205094 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:53:12.205094 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:53:12.205094 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:12.205094 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:12.205094 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:12.205094 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:12.205094 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:12.205094 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:12.205094 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:12.205094 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:53:12.205094 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:12.205094 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:12.205094 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:12.205094 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:12.205921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:12.205921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:12.205921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:12.205921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:12.205921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:53:12.205921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:53:12.205921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:53:12.205921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:53:12.205921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:53:12.205921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:53:12.205921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 19 14:53:12.205921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:53:12.205921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 549/1086] 10.222.0.24 () {56 vars in 1120 bytes} [Thu May 19 14:53:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:53:12.211248 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345d84b-0851-4501-b6b0-11b902d67ce3 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:12.230186 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689acfc-b3ff-4728-ad61-3435b66bfc05 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:12.263901 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7d00c-ef23-4a95-9fe8-de98b60ae7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:12.264773 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7d00c-ef23-4a95-9fe8-de98b60ae7cd None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:12.265055 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7d00c-ef23-4a95-9fe8-de98b60ae7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:12.265325 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7d00c-ef23-4a95-9fe8-de98b60ae7cd None admin] PATH_INFO: `/v3/projects/4d97b222963c4203bfc51b4fd8d91371/users/7e79c3e2b74e4886b35b9f2eb778299c/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:12.267281 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7d00c-ef23-4a95-9fe8-de98b60ae7cd None admin] RBAC: Authorizing `identity:create_grant(project_id=4d97b222963c4203bfc51b4fd8d91371, user_id=7e79c3e2b74e4886b35b9f2eb778299c, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:12.268741 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7d00c-ef23-4a95-9fe8-de98b60ae7cd None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:12.281036 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 538/1087] 10.222.0.24 () {58 vars in 1439 bytes} [Thu May 19 14:53:12 2022] PUT /identity/v3/projects/4d97b222963c4203bfc51b4fd8d91371/users/7e79c3e2b74e4886b35b9f2eb778299c/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 14:53:12.314141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345d84b-0851-4501-b6b0-11b902d67ce3 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:12.353051 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea1b08-1a09-44f2-b0eb-b92a75676e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:12.353737 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea1b08-1a09-44f2-b0eb-b92a75676e51 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:12.354023 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea1b08-1a09-44f2-b0eb-b92a75676e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:12.354302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea1b08-1a09-44f2-b0eb-b92a75676e51 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:12.355068 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea1b08-1a09-44f2-b0eb-b92a75676e51 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:12.355414 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea1b08-1a09-44f2-b0eb-b92a75676e51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:12.356832 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccea1b08-1a09-44f2-b0eb-b92a75676e51 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:12.365989 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 550/1088] 10.222.0.24 () {56 vars in 1115 bytes} [Thu May 19 14:53:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:53:12.372802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7d00c-ef23-4a95-9fe8-de98b60ae7cd None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:12.455065 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:12.483688 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7d00c-ef23-4a95-9fe8-de98b60ae7cd None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:12.530383 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb30b19-2d74-4bbf-9c71-54233fcb59be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:12.531175 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb30b19-2d74-4bbf-9c71-54233fcb59be None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:12.531499 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb30b19-2d74-4bbf-9c71-54233fcb59be None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:12.531783 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb30b19-2d74-4bbf-9c71-54233fcb59be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:12.542403 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb30b19-2d74-4bbf-9c71-54233fcb59be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:12.543891 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb30b19-2d74-4bbf-9c71-54233fcb59be None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:12.561004 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-4bb30b19-2d74-4bbf-9c71-54233fcb59be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:53:12.561004 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:12.561004 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:12.561004 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:12.561004 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:12.561004 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:12.561004 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:12.561004 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:12.561004 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:12.561004 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:12.561004 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:12.561004 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:12.561004 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:53:12.561004 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:53:12.561004 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:53:12.561885 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:53:12.561885 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:12.561885 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:12.561885 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:12.561885 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:12.561885 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:12.561885 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:12.561885 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:12.561885 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:53:12.561885 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:12.561885 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:12.561885 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:12.561885 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:12.561885 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:12.561885 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:12.561885 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:12.561885 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:12.562949 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:53:12.562949 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:53:12.562949 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:53:12.562949 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:53:12.562949 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 539/1089] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:53:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:53:12.567918 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea1b08-1a09-44f2-b0eb-b92a75676e51 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:12.623146 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:12.666393 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccea1b08-1a09-44f2-b0eb-b92a75676e51 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:12.699613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc3fa8-a3bf-40d5-90e6-2c22498e9125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:12.700273 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc3fa8-a3bf-40d5-90e6-2c22498e9125 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:12.700556 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc3fa8-a3bf-40d5-90e6-2c22498e9125 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:12.700835 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc3fa8-a3bf-40d5-90e6-2c22498e9125 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:12.701551 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc3fa8-a3bf-40d5-90e6-2c22498e9125 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:12.701858 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc3fa8-a3bf-40d5-90e6-2c22498e9125 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:12.703233 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc3fa8-a3bf-40d5-90e6-2c22498e9125 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:12.714635 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 551/1090] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:12.720196 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb30b19-2d74-4bbf-9c71-54233fcb59be None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:12.817947 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb30b19-2d74-4bbf-9c71-54233fcb59be None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:12.845905 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:12.851912 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e93f30-1cd0-4026-89a7-4d004dff0eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:12.852707 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e93f30-1cd0-4026-89a7-4d004dff0eda None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:12.852997 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e93f30-1cd0-4026-89a7-4d004dff0eda None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:12.853280 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e93f30-1cd0-4026-89a7-4d004dff0eda None admin] PATH_INFO: `/v3/users/nova` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:12.861375 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e93f30-1cd0-4026-89a7-4d004dff0eda None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:12.862821 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e93f30-1cd0-4026-89a7-4d004dff0eda None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:12.877396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-02e93f30-1cd0-4026-89a7-4d004dff0eda None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 19 14:53:12.877396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:12.877396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:12.877396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:12.877396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:12.877396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:12.877396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:12.877396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:12.877396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:12.877396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:12.877396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:12.877396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:12.877396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:53:12.877396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:53:12.877396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:53:12.877396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:53:12.878365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:12.878365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:12.878365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:53:12.878365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:53:12.878365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:53:12.878365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:53:12.878365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:12.878365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:12.878365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:12.878365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:12.878365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:12.878365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:53:12.878365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:12.878365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:12.878365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:12.878365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:12.878365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:12.878365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:12.879357 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:12.879357 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:12.879357 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:53:12.879357 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:53:12.879357 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:53:12.879357 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:53:12.879357 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:53:12.879357 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:53:12.879357 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 19 14:53:12.879357 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:53:12.879357 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 540/1091] 10.222.0.24 () {56 vars in 1093 bytes} [Thu May 19 14:53:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:53:12.884272 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc3fa8-a3bf-40d5-90e6-2c22498e9125 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:12.979716 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc3fa8-a3bf-40d5-90e6-2c22498e9125 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:12.993666 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:13.015009 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6a89e-6cca-49af-a781-b87b3d06e52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:13.015732 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6a89e-6cca-49af-a781-b87b3d06e52f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:13.016012 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6a89e-6cca-49af-a781-b87b3d06e52f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:13.016284 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6a89e-6cca-49af-a781-b87b3d06e52f None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:13.017123 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be6a89e-6cca-49af-a781-b87b3d06e52f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:13.017432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be6a89e-6cca-49af-a781-b87b3d06e52f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:13.018854 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be6a89e-6cca-49af-a781-b87b3d06e52f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:13.036291 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 552/1092] 10.222.0.24 () {56 vars in 1133 bytes} [Thu May 19 14:53:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:53:13.041905 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e93f30-1cd0-4026-89a7-4d004dff0eda None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:13.139959 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e93f30-1cd0-4026-89a7-4d004dff0eda None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:13.173077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940058d-a637-4d7a-bf9f-45885fb42d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:13.173728 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940058d-a637-4d7a-bf9f-45885fb42d9d None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:13.174018 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940058d-a637-4d7a-bf9f-45885fb42d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:13.174298 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940058d-a637-4d7a-bf9f-45885fb42d9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:13.229163 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:13.240308 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940058d-a637-4d7a-bf9f-45885fb42d9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:13.241700 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940058d-a637-4d7a-bf9f-45885fb42d9d None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:13.338130 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 541/1093] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:53:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 14:53:13.343925 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6a89e-6cca-49af-a781-b87b3d06e52f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:13.441164 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6a89e-6cca-49af-a781-b87b3d06e52f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:13.475058 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf15482-377b-46c0-bc35-32772960cc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:13.476002 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf15482-377b-46c0-bc35-32772960cc9d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:13.476281 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf15482-377b-46c0-bc35-32772960cc9d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:13.476550 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf15482-377b-46c0-bc35-32772960cc9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:13.486440 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf15482-377b-46c0-bc35-32772960cc9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:13.487915 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf15482-377b-46c0-bc35-32772960cc9d None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:13.505149 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-adf15482-377b-46c0-bc35-32772960cc9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:53:13.505149 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:13.505149 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:13.505149 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:13.505149 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:13.505149 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:13.505149 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:13.505149 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:13.505149 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:13.505149 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:13.505149 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:13.505149 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:13.505149 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:53:13.505149 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:53:13.505149 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:53:13.506178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:53:13.506178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:13.506178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:13.506178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:13.506178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:13.506178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:13.506178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:13.506178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:13.506178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:53:13.506178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:13.506178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:13.506178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:13.506178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:13.506178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:13.506178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:13.506178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:13.506178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:13.507319 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:53:13.507319 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:53:13.507319 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:53:13.507319 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:53:13.510900 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 553/1094] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:53:13.512646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940058d-a637-4d7a-bf9f-45885fb42d9d None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:13.600224 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:13.610530 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940058d-a637-4d7a-bf9f-45885fb42d9d None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:13.644098 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2550d3a-a849-450d-8610-7c328fe590c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:13.644754 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2550d3a-a849-450d-8610-7c328fe590c8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:13.645037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2550d3a-a849-450d-8610-7c328fe590c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:13.645313 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2550d3a-a849-450d-8610-7c328fe590c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:13.646033 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2550d3a-a849-450d-8610-7c328fe590c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:13.646338 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2550d3a-a849-450d-8610-7c328fe590c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:13.647753 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2550d3a-a849-450d-8610-7c328fe590c8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:13.663775 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 542/1095] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:13.664953 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf15482-377b-46c0-bc35-32772960cc9d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:13.689329 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:13.761475 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf15482-377b-46c0-bc35-32772960cc9d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:13.797686 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec8d82-1b03-47e6-bcb7-b434a428ddeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:13.798499 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec8d82-1b03-47e6-bcb7-b434a428ddeb None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:13.798779 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec8d82-1b03-47e6-bcb7-b434a428ddeb None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:13.799053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec8d82-1b03-47e6-bcb7-b434a428ddeb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:13.805995 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec8d82-1b03-47e6-bcb7-b434a428ddeb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:13.807468 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec8d82-1b03-47e6-bcb7-b434a428ddeb None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:13.821402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-52ec8d82-1b03-47e6-bcb7-b434a428ddeb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:53:13.821402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:13.821402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:13.821402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:13.821402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:13.821402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:13.821402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:13.821402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:13.821402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:13.821402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:13.821402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:13.821402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:13.821402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:53:13.821402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:53:13.821402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:53:13.822541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:53:13.822541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:13.822541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:13.822541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:13.822541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:13.822541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:13.822541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:13.822541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:13.822541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:53:13.822541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:13.822541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:13.822541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:13.822541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:13.822541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:13.822541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:13.822541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:13.822541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:13.823714 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:53:13.823714 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:53:13.823714 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:53:13.823714 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:53:13.823714 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:53:13.823714 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:53:13.823714 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:53:13.823714 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:53:13.823714 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 554/1096] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:53:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:53:13.828881 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2550d3a-a849-450d-8610-7c328fe590c8 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:13.927918 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2550d3a-a849-450d-8610-7c328fe590c8 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:13.959891 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905a2d8-5076-4915-97f5-28dd80d289a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:13.960546 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905a2d8-5076-4915-97f5-28dd80d289a8 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:13.960839 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905a2d8-5076-4915-97f5-28dd80d289a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:13.961117 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905a2d8-5076-4915-97f5-28dd80d289a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:13.961900 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905a2d8-5076-4915-97f5-28dd80d289a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:13.962212 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905a2d8-5076-4915-97f5-28dd80d289a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:13.963685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905a2d8-5076-4915-97f5-28dd80d289a8 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:13.976452 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 543/1097] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:53:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:13.983055 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec8d82-1b03-47e6-bcb7-b434a428ddeb None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:14.067178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:14.083064 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec8d82-1b03-47e6-bcb7-b434a428ddeb None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:14.116082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5bc7b-6304-4434-9d12-60cec881b13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:14.116733 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5bc7b-6304-4434-9d12-60cec881b13e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:14.117013 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5bc7b-6304-4434-9d12-60cec881b13e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:14.117286 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5bc7b-6304-4434-9d12-60cec881b13e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:14.118107 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5bc7b-6304-4434-9d12-60cec881b13e None admin] RBAC: Adding query filter params (role.id=24772df324aa4eb7b66c7853b4b01439, scope.project.id=2633b53c336145bba3d4744dbdfe99b7, user.id=06fb8bb5aeb143ad95f33c3b43dbd346) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:14.118415 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5bc7b-6304-4434-9d12-60cec881b13e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:14.120114 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5bc7b-6304-4434-9d12-60cec881b13e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:14.125784 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 555/1098] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:53:13 2022] GET /identity/v3/role_assignments?user.id=06fb8bb5aeb143ad95f33c3b43dbd346&scope.project.id=2633b53c336145bba3d4744dbdfe99b7&role.id=24772df324aa4eb7b66c7853b4b01439 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:14.514719 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70b7bf-23a2-4764-b97c-42a08f95bad9 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:14.515332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70b7bf-23a2-4764-b97c-42a08f95bad9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:14.515332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70b7bf-23a2-4764-b97c-42a08f95bad9 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:14.516694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 544/1099] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:14.522159 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a827a-9851-41ec-b239-fc129e279f8f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:14.522450 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a827a-9851-41ec-b239-fc129e279f8f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:14.522729 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a827a-9851-41ec-b239-fc129e279f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:14.540351 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-485a827a-9851-41ec-b239-fc129e279f8f None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:14.541718 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-485a827a-9851-41ec-b239-fc129e279f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:14.608786 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 556/1100] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:53:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:53:14.632511 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70b7bf-23a2-4764-b97c-42a08f95bad9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:14.645484 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:14.740643 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70b7bf-23a2-4764-b97c-42a08f95bad9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:14.774164 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418433fe-200c-43b2-b010-b731c180f3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:14.774897 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418433fe-200c-43b2-b010-b731c180f3c7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:14.775176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418433fe-200c-43b2-b010-b731c180f3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:14.775480 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418433fe-200c-43b2-b010-b731c180f3c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:14.786004 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418433fe-200c-43b2-b010-b731c180f3c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:53:14.794158 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-418433fe-200c-43b2-b010-b731c180f3c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:53:14.794158 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:14.794158 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:14.794158 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:14.794158 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:14.794158 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:14.794158 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:14.794158 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:14.794158 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:14.794158 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:14.794158 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:14.794158 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:14.794158 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:53:14.794158 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:53:14.794158 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:53:14.794158 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:53:14.795222 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:53:14.795222 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:53:14.795222 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:53:14.795222 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:53:14.795222 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:14.795222 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:14.795222 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:14.795222 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:14.795222 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:14.795222 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:14.795222 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:14.795222 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:53:14.795222 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:14.795222 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:14.795222 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:14.795222 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:14.796720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:14.796720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:14.796720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:14.796720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:14.796720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:53:14.796720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:53:14.796720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:53:14.796720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:53:14.796720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:53:14.796720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:53:14.796720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:53:14.796720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:53:14.796720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 545/1101] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:53:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:53:14.801332 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a827a-9851-41ec-b239-fc129e279f8f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:14.880525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:14.903655 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a827a-9851-41ec-b239-fc129e279f8f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:14.936905 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a9114-e220-4e07-8875-5368419c1fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:14.937566 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a9114-e220-4e07-8875-5368419c1fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:14.937844 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a9114-e220-4e07-8875-5368419c1fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:14.938116 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a9114-e220-4e07-8875-5368419c1fc7 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:14.938856 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a9114-e220-4e07-8875-5368419c1fc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:14.939158 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a9114-e220-4e07-8875-5368419c1fc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:14.940556 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a9114-e220-4e07-8875-5368419c1fc7 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:14.949201 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 557/1102] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:53:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:14.955612 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418433fe-200c-43b2-b010-b731c180f3c7 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:15.025369 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:15.055893 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418433fe-200c-43b2-b010-b731c180f3c7 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:15.088059 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39491ad1-0dac-41cc-a47b-0e1a24953fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:15.088922 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39491ad1-0dac-41cc-a47b-0e1a24953fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:15.089208 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39491ad1-0dac-41cc-a47b-0e1a24953fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:15.089492 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39491ad1-0dac-41cc-a47b-0e1a24953fe2 None admin] PATH_INFO: `/v3/users/7e79c3e2b74e4886b35b9f2eb778299c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:15.091455 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39491ad1-0dac-41cc-a47b-0e1a24953fe2 None admin] RBAC: Authorizing `identity:get_user(user_id=7e79c3e2b74e4886b35b9f2eb778299c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:15.092894 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39491ad1-0dac-41cc-a47b-0e1a24953fe2 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:15.094510 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 546/1103] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:53:14 2022] GET /identity/v3/users/7e79c3e2b74e4886b35b9f2eb778299c => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:15.100223 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a9114-e220-4e07-8875-5368419c1fc7 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:15.195029 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a9114-e220-4e07-8875-5368419c1fc7 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:15.227137 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d2072-66db-4e35-8164-2daea87ec39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:15.227791 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d2072-66db-4e35-8164-2daea87ec39b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:15.228068 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d2072-66db-4e35-8164-2daea87ec39b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:15.228338 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d2072-66db-4e35-8164-2daea87ec39b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:15.238134 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:15.292570 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d2072-66db-4e35-8164-2daea87ec39b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:15.293953 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d2072-66db-4e35-8164-2daea87ec39b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:15.387819 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 558/1104] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:53:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:53:15.393495 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39491ad1-0dac-41cc-a47b-0e1a24953fe2 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:15.491134 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39491ad1-0dac-41cc-a47b-0e1a24953fe2 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:15.524192 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eac48e-4181-47e3-bea0-c08ec3f0cfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:15.525044 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eac48e-4181-47e3-bea0-c08ec3f0cfd0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:15.525338 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eac48e-4181-47e3-bea0-c08ec3f0cfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:15.525616 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eac48e-4181-47e3-bea0-c08ec3f0cfd0 None admin] PATH_INFO: `/v3/projects/4d97b222963c4203bfc51b4fd8d91371` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:15.526783 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eac48e-4181-47e3-bea0-c08ec3f0cfd0 None admin] RBAC: Authorizing `identity:get_project(project_id=4d97b222963c4203bfc51b4fd8d91371)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:15.528312 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eac48e-4181-47e3-bea0-c08ec3f0cfd0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:15.529996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 547/1105] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:53:15 2022] GET /identity/v3/projects/4d97b222963c4203bfc51b4fd8d91371 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:15.536105 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d2072-66db-4e35-8164-2daea87ec39b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:15.576327 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:15.632470 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d2072-66db-4e35-8164-2daea87ec39b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:15.667254 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9012d13-2869-49da-84a4-345719b24d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:15.667915 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9012d13-2869-49da-84a4-345719b24d5c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:15.668722 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9012d13-2869-49da-84a4-345719b24d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:15.669027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9012d13-2869-49da-84a4-345719b24d5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:15.669859 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9012d13-2869-49da-84a4-345719b24d5c None admin] RBAC: Adding query filter params (role.id=ec4b73b709ca4cdc983e35e955aed57a, scope.project.id=4d97b222963c4203bfc51b4fd8d91371, user.id=7e79c3e2b74e4886b35b9f2eb778299c) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:15.670172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9012d13-2869-49da-84a4-345719b24d5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:15.671622 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9012d13-2869-49da-84a4-345719b24d5c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:15.677454 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 559/1106] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:53:15 2022] GET /identity/v3/role_assignments?user.id=7e79c3e2b74e4886b35b9f2eb778299c&scope.project.id=4d97b222963c4203bfc51b4fd8d91371&role.id=ec4b73b709ca4cdc983e35e955aed57a => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:17.916657 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a0908-da69-4c6f-93e3-e6d1c92ba6d3 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:17.917216 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a0908-da69-4c6f-93e3-e6d1c92ba6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:17.917216 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a0908-da69-4c6f-93e3-e6d1c92ba6d3 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:17.918586 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 548/1107] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:17.923885 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb30661-827e-4b08-9ac3-3f8d670ea9e7 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:17.924291 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb30661-827e-4b08-9ac3-3f8d670ea9e7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:17.924443 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb30661-827e-4b08-9ac3-3f8d670ea9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:17.940828 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-dbb30661-827e-4b08-9ac3-3f8d670ea9e7 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:17.942010 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-dbb30661-827e-4b08-9ac3-3f8d670ea9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:18.006945 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 560/1108] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:53:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:53:18.032041 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a0908-da69-4c6f-93e3-e6d1c92ba6d3 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:18.041776 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:18.132240 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a0908-da69-4c6f-93e3-e6d1c92ba6d3 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:18.163899 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0d012-dbe3-4b9a-906a-4c68fb6bd090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:18.164673 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0d012-dbe3-4b9a-906a-4c68fb6bd090 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:18.164962 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0d012-dbe3-4b9a-906a-4c68fb6bd090 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:18.165241 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0d012-dbe3-4b9a-906a-4c68fb6bd090 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:18.166403 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0d012-dbe3-4b9a-906a-4c68fb6bd090 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:18.167912 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0d012-dbe3-4b9a-906a-4c68fb6bd090 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:18.169946 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 549/1109] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:53:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:18.175491 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb30661-827e-4b08-9ac3-3f8d670ea9e7 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:18.207922 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:18.271964 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb30661-827e-4b08-9ac3-3f8d670ea9e7 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:18.304326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e8334-5370-42bf-9303-79dd49061773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:18.304973 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e8334-5370-42bf-9303-79dd49061773 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:18.305248 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e8334-5370-42bf-9303-79dd49061773 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:18.305517 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e8334-5370-42bf-9303-79dd49061773 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:18.306222 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e8334-5370-42bf-9303-79dd49061773 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:18.307661 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e8334-5370-42bf-9303-79dd49061773 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:18.326843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 561/1110] 10.222.0.24 () {60 vars in 1132 bytes} [Thu May 19 14:53:18 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:53:20.554681 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023b83d-f7c2-4c52-ad4e-f10f5a837261 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:20.555222 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023b83d-f7c2-4c52-ad4e-f10f5a837261 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:20.555334 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023b83d-f7c2-4c52-ad4e-f10f5a837261 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:20.556612 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 550/1111] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:20.562475 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52de733-f176-487c-8d2e-6ac6c68e8465 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:20.562862 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52de733-f176-487c-8d2e-6ac6c68e8465 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:20.563034 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52de733-f176-487c-8d2e-6ac6c68e8465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:20.579956 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-c52de733-f176-487c-8d2e-6ac6c68e8465 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:20.581097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c52de733-f176-487c-8d2e-6ac6c68e8465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:20.645327 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 562/1112] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:53:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:53:20.669508 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023b83d-f7c2-4c52-ad4e-f10f5a837261 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:20.741611 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:20.766569 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023b83d-f7c2-4c52-ad4e-f10f5a837261 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:20.799434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648be429-0010-43e9-860a-a5dcb95a0acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:20.800268 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648be429-0010-43e9-860a-a5dcb95a0acf None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:20.800554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648be429-0010-43e9-860a-a5dcb95a0acf None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:20.800830 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648be429-0010-43e9-860a-a5dcb95a0acf None admin] PATH_INFO: `/v3/roles/9d41dc09d0f646b1994526fcbd8d3622` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:20.802287 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648be429-0010-43e9-860a-a5dcb95a0acf None admin] RBAC: Authorizing `identity:get_role(role_id=9d41dc09d0f646b1994526fcbd8d3622)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:20.803686 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648be429-0010-43e9-860a-a5dcb95a0acf None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:20.805024 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 551/1113] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:53:20 2022] GET /identity/v3/roles/9d41dc09d0f646b1994526fcbd8d3622 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:20.810546 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52de733-f176-487c-8d2e-6ac6c68e8465 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:20.830871 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:20.907090 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52de733-f176-487c-8d2e-6ac6c68e8465 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:20.940164 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b330e99-0dd3-4b5f-8bd9-5bdfd580d378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:20.941576 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b330e99-0dd3-4b5f-8bd9-5bdfd580d378 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:20.941929 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b330e99-0dd3-4b5f-8bd9-5bdfd580d378 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:20.942213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b330e99-0dd3-4b5f-8bd9-5bdfd580d378 None admin] PATH_INFO: `/v3/users/49886ea26799423e9c813f13c7ab323a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:20.955288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b330e99-0dd3-4b5f-8bd9-5bdfd580d378 None admin] RBAC: Authorizing `identity:get_user(user_id=49886ea26799423e9c813f13c7ab323a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:20.956727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b330e99-0dd3-4b5f-8bd9-5bdfd580d378 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:20.958346 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 563/1114] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:53:20 2022] GET /identity/v3/users/49886ea26799423e9c813f13c7ab323a => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:20.963891 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648be429-0010-43e9-860a-a5dcb95a0acf None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:21.061944 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648be429-0010-43e9-860a-a5dcb95a0acf None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:21.093392 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b53a07-84ca-4633-b00b-d7bac280f93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:21.093964 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b53a07-84ca-4633-b00b-d7bac280f93b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:21.094250 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b53a07-84ca-4633-b00b-d7bac280f93b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:21.094529 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b53a07-84ca-4633-b00b-d7bac280f93b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:21.106454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:21.159511 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b53a07-84ca-4633-b00b-d7bac280f93b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:21.160954 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b53a07-84ca-4633-b00b-d7bac280f93b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:21.254776 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 552/1115] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:53:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:53:21.260618 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b330e99-0dd3-4b5f-8bd9-5bdfd580d378 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:21.340341 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:21.361482 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b330e99-0dd3-4b5f-8bd9-5bdfd580d378 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:21.393589 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46844b-a3c1-4cea-bad9-7d1608d59de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:21.394427 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46844b-a3c1-4cea-bad9-7d1608d59de4 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:21.394704 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46844b-a3c1-4cea-bad9-7d1608d59de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:21.394975 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46844b-a3c1-4cea-bad9-7d1608d59de4 None admin] PATH_INFO: `/v3/projects/4d97b222963c4203bfc51b4fd8d91371` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:21.396153 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46844b-a3c1-4cea-bad9-7d1608d59de4 None admin] RBAC: Authorizing `identity:get_project(project_id=4d97b222963c4203bfc51b4fd8d91371)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:21.397573 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46844b-a3c1-4cea-bad9-7d1608d59de4 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:21.399246 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 564/1116] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:53:21 2022] GET /identity/v3/projects/4d97b222963c4203bfc51b4fd8d91371 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:21.405762 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b53a07-84ca-4633-b00b-d7bac280f93b None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:21.446454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:21.504984 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b53a07-84ca-4633-b00b-d7bac280f93b None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:21.537197 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1bf628-3039-4e77-9768-eeaa4b4342f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:21.537840 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bf628-3039-4e77-9768-eeaa4b4342f0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:21.538124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bf628-3039-4e77-9768-eeaa4b4342f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:21.538401 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bf628-3039-4e77-9768-eeaa4b4342f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:21.539244 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1bf628-3039-4e77-9768-eeaa4b4342f0 None admin] RBAC: Adding query filter params (role.id=9d41dc09d0f646b1994526fcbd8d3622, scope.project.id=4d97b222963c4203bfc51b4fd8d91371, user.id=49886ea26799423e9c813f13c7ab323a) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:21.539676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1bf628-3039-4e77-9768-eeaa4b4342f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:21.541095 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1bf628-3039-4e77-9768-eeaa4b4342f0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:21.546915 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 553/1117] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:53:21 2022] GET /identity/v3/role_assignments?user.id=49886ea26799423e9c813f13c7ab323a&scope.project.id=4d97b222963c4203bfc51b4fd8d91371&role.id=9d41dc09d0f646b1994526fcbd8d3622 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:23.729999 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b49c91-5753-4e75-9bb9-579a2cfe8f5d None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:23.730539 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b49c91-5753-4e75-9bb9-579a2cfe8f5d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:23.730640 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b49c91-5753-4e75-9bb9-579a2cfe8f5d None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:23.732113 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 565/1118] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:23.737346 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f79a5-0a52-4bfc-95ae-0e60173e3861 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:23.737720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f79a5-0a52-4bfc-95ae-0e60173e3861 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:23.737914 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f79a5-0a52-4bfc-95ae-0e60173e3861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:23.754824 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-419f79a5-0a52-4bfc-95ae-0e60173e3861 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:23.756032 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-419f79a5-0a52-4bfc-95ae-0e60173e3861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:23.820603 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 554/1119] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:53:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:53:23.843038 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b49c91-5753-4e75-9bb9-579a2cfe8f5d None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:23.941523 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b49c91-5753-4e75-9bb9-579a2cfe8f5d None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:23.973447 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ae579-dc2f-4f38-bfb9-ac10f8f2d83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:23.974353 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ae579-dc2f-4f38-bfb9-ac10f8f2d83e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:23.974638 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ae579-dc2f-4f38-bfb9-ac10f8f2d83e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:23.974914 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ae579-dc2f-4f38-bfb9-ac10f8f2d83e None admin] PATH_INFO: `/v3/roles/9d41dc09d0f646b1994526fcbd8d3622` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:23.976411 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ae579-dc2f-4f38-bfb9-ac10f8f2d83e None admin] RBAC: Authorizing `identity:get_role(role_id=9d41dc09d0f646b1994526fcbd8d3622)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:23.977779 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ae579-dc2f-4f38-bfb9-ac10f8f2d83e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:23.979114 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 566/1120] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:53:23 2022] GET /identity/v3/roles/9d41dc09d0f646b1994526fcbd8d3622 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:23.985807 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f79a5-0a52-4bfc-95ae-0e60173e3861 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:24.020095 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:24.082201 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f79a5-0a52-4bfc-95ae-0e60173e3861 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:24.114582 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c2d3e-fc8f-4e1f-b38f-68808eb4cca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:24.115476 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c2d3e-fc8f-4e1f-b38f-68808eb4cca4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:24.115763 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c2d3e-fc8f-4e1f-b38f-68808eb4cca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:24.116042 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c2d3e-fc8f-4e1f-b38f-68808eb4cca4 None admin] PATH_INFO: `/v3/users/49886ea26799423e9c813f13c7ab323a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:24.117213 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70c2d3e-fc8f-4e1f-b38f-68808eb4cca4 None admin] RBAC: Authorizing `identity:get_user(user_id=49886ea26799423e9c813f13c7ab323a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:24.118654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70c2d3e-fc8f-4e1f-b38f-68808eb4cca4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:24.120579 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 555/1121] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:53:23 2022] GET /identity/v3/users/49886ea26799423e9c813f13c7ab323a => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:24.126957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ae579-dc2f-4f38-bfb9-ac10f8f2d83e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:24.142093 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:24.229815 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ae579-dc2f-4f38-bfb9-ac10f8f2d83e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:24.263179 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafd18e-39ff-412e-9ba7-e8e672e7d5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:24.263998 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafd18e-39ff-412e-9ba7-e8e672e7d5ae None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:24.264281 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafd18e-39ff-412e-9ba7-e8e672e7d5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:24.264554 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafd18e-39ff-412e-9ba7-e8e672e7d5ae None admin] PATH_INFO: `/v3/projects/4d97b222963c4203bfc51b4fd8d91371` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:24.265714 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafd18e-39ff-412e-9ba7-e8e672e7d5ae None admin] RBAC: Authorizing `identity:get_project(project_id=4d97b222963c4203bfc51b4fd8d91371)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:24.267132 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafd18e-39ff-412e-9ba7-e8e672e7d5ae None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:24.268964 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 567/1122] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:53:24 2022] GET /identity/v3/projects/4d97b222963c4203bfc51b4fd8d91371 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:24.274841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c2d3e-fc8f-4e1f-b38f-68808eb4cca4 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:24.370334 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c2d3e-fc8f-4e1f-b38f-68808eb4cca4 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:24.372600 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:24.403501 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e3200-cd3c-4b44-9e43-4a1b65a2fce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:24.404404 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e3200-cd3c-4b44-9e43-4a1b65a2fce6 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:24.404691 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e3200-cd3c-4b44-9e43-4a1b65a2fce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:24.404970 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e3200-cd3c-4b44-9e43-4a1b65a2fce6 None admin] PATH_INFO: `/v3/projects/4d97b222963c4203bfc51b4fd8d91371/users/49886ea26799423e9c813f13c7ab323a/roles/9d41dc09d0f646b1994526fcbd8d3622` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:24.407122 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e3200-cd3c-4b44-9e43-4a1b65a2fce6 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d97b222963c4203bfc51b4fd8d91371, user_id=49886ea26799423e9c813f13c7ab323a, role_id=9d41dc09d0f646b1994526fcbd8d3622)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:24.408577 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e3200-cd3c-4b44-9e43-4a1b65a2fce6 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:24.420946 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 556/1123] 10.222.0.24 () {58 vars in 1439 bytes} [Thu May 19 14:53:24 2022] PUT /identity/v3/projects/4d97b222963c4203bfc51b4fd8d91371/users/49886ea26799423e9c813f13c7ab323a/roles/9d41dc09d0f646b1994526fcbd8d3622 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:53:26.606817 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf70501-4110-4b35-9159-e270c9d85abb None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:26.607328 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf70501-4110-4b35-9159-e270c9d85abb None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:26.607328 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf70501-4110-4b35-9159-e270c9d85abb None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:26.608665 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 568/1124] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:53:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:26.613985 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279b2cb-da5a-457e-b5c9-67ca3d05f23a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:26.614356 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279b2cb-da5a-457e-b5c9-67ca3d05f23a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:26.614561 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279b2cb-da5a-457e-b5c9-67ca3d05f23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:26.631587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-3279b2cb-da5a-457e-b5c9-67ca3d05f23a None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:26.632784 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3279b2cb-da5a-457e-b5c9-67ca3d05f23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:26.696883 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 557/1125] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:53:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:53:26.721009 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf70501-4110-4b35-9159-e270c9d85abb None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:26.799277 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:26.819224 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf70501-4110-4b35-9159-e270c9d85abb None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:26.851837 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e40409-c7dd-4702-af7b-6fe5e9fd9273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:26.852682 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e40409-c7dd-4702-af7b-6fe5e9fd9273 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:26.852966 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e40409-c7dd-4702-af7b-6fe5e9fd9273 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:26.853244 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e40409-c7dd-4702-af7b-6fe5e9fd9273 None admin] PATH_INFO: `/v3/roles/9d41dc09d0f646b1994526fcbd8d3622` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:26.854698 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e40409-c7dd-4702-af7b-6fe5e9fd9273 None admin] RBAC: Authorizing `identity:get_role(role_id=9d41dc09d0f646b1994526fcbd8d3622)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:26.856593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e40409-c7dd-4702-af7b-6fe5e9fd9273 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:26.857996 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 569/1126] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:53:26 2022] GET /identity/v3/roles/9d41dc09d0f646b1994526fcbd8d3622 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:26.863616 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279b2cb-da5a-457e-b5c9-67ca3d05f23a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:26.951767 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:26.958945 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279b2cb-da5a-457e-b5c9-67ca3d05f23a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:26.991864 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972518c-327e-4b24-92d4-b3f60979eefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:26.992712 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972518c-327e-4b24-92d4-b3f60979eefc None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:26.992989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972518c-327e-4b24-92d4-b3f60979eefc None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:26.993258 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972518c-327e-4b24-92d4-b3f60979eefc None admin] PATH_INFO: `/v3/users/49886ea26799423e9c813f13c7ab323a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:26.994414 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972518c-327e-4b24-92d4-b3f60979eefc None admin] RBAC: Authorizing `identity:get_user(user_id=49886ea26799423e9c813f13c7ab323a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:26.996691 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972518c-327e-4b24-92d4-b3f60979eefc None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:26.998260 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 558/1127] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:53:26 2022] GET /identity/v3/users/49886ea26799423e9c813f13c7ab323a => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:27.003784 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e40409-c7dd-4702-af7b-6fe5e9fd9273 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:27.098183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e40409-c7dd-4702-af7b-6fe5e9fd9273 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:27.131110 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd722d-a754-4111-b2de-b0f2cd47b509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:27.131709 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd722d-a754-4111-b2de-b0f2cd47b509 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:27.131993 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd722d-a754-4111-b2de-b0f2cd47b509 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:27.132268 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd722d-a754-4111-b2de-b0f2cd47b509 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:27.149944 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:27.196938 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd722d-a754-4111-b2de-b0f2cd47b509 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:27.198362 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd722d-a754-4111-b2de-b0f2cd47b509 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:27.291520 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 570/1128] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:53:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:53:27.297891 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972518c-327e-4b24-92d4-b3f60979eefc None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:27.393678 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972518c-327e-4b24-92d4-b3f60979eefc None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:27.426707 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654baedc-6bfd-4e6c-b8be-dd5ab44a4149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:27.427579 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654baedc-6bfd-4e6c-b8be-dd5ab44a4149 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:27.427868 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654baedc-6bfd-4e6c-b8be-dd5ab44a4149 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:27.428148 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654baedc-6bfd-4e6c-b8be-dd5ab44a4149 None admin] PATH_INFO: `/v3/projects/4d97b222963c4203bfc51b4fd8d91371` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:27.429322 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654baedc-6bfd-4e6c-b8be-dd5ab44a4149 None admin] RBAC: Authorizing `identity:get_project(project_id=4d97b222963c4203bfc51b4fd8d91371)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:27.430762 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654baedc-6bfd-4e6c-b8be-dd5ab44a4149 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:27.432473 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 559/1129] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:53:27 2022] GET /identity/v3/projects/4d97b222963c4203bfc51b4fd8d91371 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:27.438471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd722d-a754-4111-b2de-b0f2cd47b509 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:27.486352 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:27.535615 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd722d-a754-4111-b2de-b0f2cd47b509 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:27.568253 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f25c8-2e6f-4508-b1d5-3664ffa85ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:27.568892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f25c8-2e6f-4508-b1d5-3664ffa85ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:27.569169 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f25c8-2e6f-4508-b1d5-3664ffa85ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:27.569438 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f25c8-2e6f-4508-b1d5-3664ffa85ec6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:27.570248 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f25c8-2e6f-4508-b1d5-3664ffa85ec6 None admin] RBAC: Adding query filter params (role.id=9d41dc09d0f646b1994526fcbd8d3622, scope.project.id=4d97b222963c4203bfc51b4fd8d91371, user.id=49886ea26799423e9c813f13c7ab323a) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:27.570549 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f25c8-2e6f-4508-b1d5-3664ffa85ec6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:27.571978 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f25c8-2e6f-4508-b1d5-3664ffa85ec6 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:27.577479 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 571/1130] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:53:27 2022] GET /identity/v3/role_assignments?user.id=49886ea26799423e9c813f13c7ab323a&scope.project.id=4d97b222963c4203bfc51b4fd8d91371&role.id=9d41dc09d0f646b1994526fcbd8d3622 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:29.803920 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2e54a-e5f3-485a-b445-6ba9fe040be6 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:29.804474 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2e54a-e5f3-485a-b445-6ba9fe040be6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:29.804474 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2e54a-e5f3-485a-b445-6ba9fe040be6 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:29.805848 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 560/1131] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:29.811052 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28014ff-3b61-4dcc-800a-bd62e2066353 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:29.811465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28014ff-3b61-4dcc-800a-bd62e2066353 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:29.811647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28014ff-3b61-4dcc-800a-bd62e2066353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:29.827916 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a28014ff-3b61-4dcc-800a-bd62e2066353 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:29.829087 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a28014ff-3b61-4dcc-800a-bd62e2066353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:29.893759 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 572/1132] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:53:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:53:29.917132 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2e54a-e5f3-485a-b445-6ba9fe040be6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:29.946701 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:30.016670 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2e54a-e5f3-485a-b445-6ba9fe040be6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:30.050233 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08364390-77c0-4624-8e41-a71d269954d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:30.051017 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08364390-77c0-4624-8e41-a71d269954d5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:30.051334 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08364390-77c0-4624-8e41-a71d269954d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:30.051616 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08364390-77c0-4624-8e41-a71d269954d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:30.052780 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08364390-77c0-4624-8e41-a71d269954d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:30.054276 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08364390-77c0-4624-8e41-a71d269954d5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:30.055850 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 561/1133] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:53:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:30.061576 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28014ff-3b61-4dcc-800a-bd62e2066353 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:30.105121 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:30.156891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28014ff-3b61-4dcc-800a-bd62e2066353 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:30.188812 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76786ed-8615-47bc-9d85-1f66f826366c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:30.189463 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76786ed-8615-47bc-9d85-1f66f826366c None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:30.189747 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76786ed-8615-47bc-9d85-1f66f826366c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:30.190025 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76786ed-8615-47bc-9d85-1f66f826366c None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:30.190732 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76786ed-8615-47bc-9d85-1f66f826366c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:30.192182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76786ed-8615-47bc-9d85-1f66f826366c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:30.217165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 573/1134] 10.222.0.24 () {60 vars in 1141 bytes} [Thu May 19 14:53:30 2022] POST /identity/v3/projects => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:53:32.419353 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ccf11-b7f1-4a85-9bac-fc840ba3edee None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:32.419847 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ccf11-b7f1-4a85-9bac-fc840ba3edee None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:32.419938 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ccf11-b7f1-4a85-9bac-fc840ba3edee None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:32.421256 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 562/1135] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:32.426423 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ed3aa-f302-41e4-a0bc-e6f37d25e849 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:32.426861 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ed3aa-f302-41e4-a0bc-e6f37d25e849 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:32.426965 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ed3aa-f302-41e4-a0bc-e6f37d25e849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:32.443325 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7e4ed3aa-f302-41e4-a0bc-e6f37d25e849 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:32.444487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7e4ed3aa-f302-41e4-a0bc-e6f37d25e849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:32.508230 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 574/1136] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:53:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:53:32.532844 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ccf11-b7f1-4a85-9bac-fc840ba3edee None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:32.635000 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:32.640721 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ccf11-b7f1-4a85-9bac-fc840ba3edee None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:32.672664 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69be4ee-ee8e-4475-8d3b-7d7a7797269f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:32.673442 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69be4ee-ee8e-4475-8d3b-7d7a7797269f None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:32.673726 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69be4ee-ee8e-4475-8d3b-7d7a7797269f None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:32.674002 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69be4ee-ee8e-4475-8d3b-7d7a7797269f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:32.675145 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69be4ee-ee8e-4475-8d3b-7d7a7797269f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:32.676594 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69be4ee-ee8e-4475-8d3b-7d7a7797269f None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:32.678195 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 563/1137] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:53:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:32.684438 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ed3aa-f302-41e4-a0bc-e6f37d25e849 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:32.710674 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:32.781668 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ed3aa-f302-41e4-a0bc-e6f37d25e849 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:32.814142 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5246a7d8-b966-4b80-8e78-a78e842878f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:32.814802 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246a7d8-b966-4b80-8e78-a78e842878f0 None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:32.815088 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246a7d8-b966-4b80-8e78-a78e842878f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:32.815399 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246a7d8-b966-4b80-8e78-a78e842878f0 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:32.816123 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5246a7d8-b966-4b80-8e78-a78e842878f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:32.817543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5246a7d8-b966-4b80-8e78-a78e842878f0 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:32.837062 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 575/1138] 10.222.0.24 () {60 vars in 1132 bytes} [Thu May 19 14:53:32 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 14:53:35.053752 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7aaff8-d3e4-49cc-9bdf-8acd3dfb60f6 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:35.054283 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7aaff8-d3e4-49cc-9bdf-8acd3dfb60f6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:35.054369 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7aaff8-d3e4-49cc-9bdf-8acd3dfb60f6 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:35.055749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 564/1139] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:35.061183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1d042-2442-4390-8806-a7ddd36b1f75 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:35.061614 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1d042-2442-4390-8806-a7ddd36b1f75 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:35.061735 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1d042-2442-4390-8806-a7ddd36b1f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:35.077972 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-77d1d042-2442-4390-8806-a7ddd36b1f75 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:35.079129 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-77d1d042-2442-4390-8806-a7ddd36b1f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:35.143049 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 576/1140] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:53:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:53:35.166283 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7aaff8-d3e4-49cc-9bdf-8acd3dfb60f6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:35.269996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7aaff8-d3e4-49cc-9bdf-8acd3dfb60f6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:35.306898 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5922a-4d25-4e6f-9043-da3611584d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:35.307689 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5922a-4d25-4e6f-9043-da3611584d24 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:35.308243 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5922a-4d25-4e6f-9043-da3611584d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:35.308769 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5922a-4d25-4e6f-9043-da3611584d24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:35.321068 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5922a-4d25-4e6f-9043-da3611584d24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:53:35.329903 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-2ad5922a-4d25-4e6f-9043-da3611584d24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:53:35.329903 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:35.329903 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:35.329903 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:35.329903 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:35.329903 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:35.329903 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:35.329903 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:35.329903 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:35.329903 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:35.329903 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:35.329903 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:35.329903 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:53:35.329903 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:53:35.329903 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:53:35.329903 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:53:35.331077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:53:35.331077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:53:35.331077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:53:35.331077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:53:35.331077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:35.331077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:35.331077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:35.331077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:35.331077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:35.331077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:35.331077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:35.331077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:53:35.331077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:35.331077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:35.331077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:35.331077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:35.332103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:35.332103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:35.332103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:35.332103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:35.332103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:53:35.332103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:53:35.332103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:53:35.332103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:53:35.332103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:53:35.332103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:53:35.332103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:53:35.332103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:53:35.332103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 565/1141] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:53:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:53:35.337177 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1d042-2442-4390-8806-a7ddd36b1f75 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:35.351838 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:35.434522 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1d042-2442-4390-8806-a7ddd36b1f75 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:35.468378 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41b31f-4778-4294-90f6-a7516dd72017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:35.469030 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41b31f-4778-4294-90f6-a7516dd72017 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:35.469312 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41b31f-4778-4294-90f6-a7516dd72017 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:35.469583 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41b31f-4778-4294-90f6-a7516dd72017 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:35.470323 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41b31f-4778-4294-90f6-a7516dd72017 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:35.470629 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41b31f-4778-4294-90f6-a7516dd72017 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:35.472020 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41b31f-4778-4294-90f6-a7516dd72017 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:35.479866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 577/1142] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:53:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:35.485628 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5922a-4d25-4e6f-9043-da3611584d24 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:35.514835 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:35.587777 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5922a-4d25-4e6f-9043-da3611584d24 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:35.619255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630440e8-3eff-42a0-bf30-ee109be4b6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:35.620914 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630440e8-3eff-42a0-bf30-ee109be4b6eb None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:35.621212 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630440e8-3eff-42a0-bf30-ee109be4b6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:35.621478 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630440e8-3eff-42a0-bf30-ee109be4b6eb None admin] PATH_INFO: `/v3/users/7f0059ca7c984fe385e8489232adb97d` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:35.639340 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630440e8-3eff-42a0-bf30-ee109be4b6eb None admin] RBAC: Authorizing `identity:get_user(user_id=7f0059ca7c984fe385e8489232adb97d)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:35.640814 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630440e8-3eff-42a0-bf30-ee109be4b6eb None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:35.642565 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 566/1143] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:53:35 2022] GET /identity/v3/users/7f0059ca7c984fe385e8489232adb97d => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:35.648763 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41b31f-4778-4294-90f6-a7516dd72017 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:35.722625 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:35.747084 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41b31f-4778-4294-90f6-a7516dd72017 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:35.779264 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001cfa6-8330-4f75-a6c7-c3dc48924bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:35.779911 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001cfa6-8330-4f75-a6c7-c3dc48924bfc None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:35.780195 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001cfa6-8330-4f75-a6c7-c3dc48924bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:35.780471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001cfa6-8330-4f75-a6c7-c3dc48924bfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:35.845392 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001cfa6-8330-4f75-a6c7-c3dc48924bfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:35.846771 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001cfa6-8330-4f75-a6c7-c3dc48924bfc None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:35.916980 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:35.941238 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 578/1144] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:53:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 14:53:35.947030 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630440e8-3eff-42a0-bf30-ee109be4b6eb None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:36.026306 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:36.042292 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630440e8-3eff-42a0-bf30-ee109be4b6eb None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:36.075618 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e6a83-70dd-4341-93b6-457c2406827c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:36.076469 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e6a83-70dd-4341-93b6-457c2406827c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:36.076752 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e6a83-70dd-4341-93b6-457c2406827c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:36.077025 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e6a83-70dd-4341-93b6-457c2406827c None admin] PATH_INFO: `/v3/projects/dc0138cf758e4900a635a690504199b0` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:36.078182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e6a83-70dd-4341-93b6-457c2406827c None admin] RBAC: Authorizing `identity:get_project(project_id=dc0138cf758e4900a635a690504199b0)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:36.079638 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e6a83-70dd-4341-93b6-457c2406827c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:36.081302 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 567/1145] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:53:35 2022] GET /identity/v3/projects/dc0138cf758e4900a635a690504199b0 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:36.087158 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001cfa6-8330-4f75-a6c7-c3dc48924bfc None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:36.181505 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001cfa6-8330-4f75-a6c7-c3dc48924bfc None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:36.213563 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955d562-f7bb-45b2-a3e2-e8fed8357c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:36.214218 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955d562-f7bb-45b2-a3e2-e8fed8357c4c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:36.214497 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955d562-f7bb-45b2-a3e2-e8fed8357c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:36.214768 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955d562-f7bb-45b2-a3e2-e8fed8357c4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:36.215616 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955d562-f7bb-45b2-a3e2-e8fed8357c4c None admin] RBAC: Adding query filter params (role.id=ec4b73b709ca4cdc983e35e955aed57a, scope.project.id=dc0138cf758e4900a635a690504199b0, user.id=7f0059ca7c984fe385e8489232adb97d) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:36.215921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955d562-f7bb-45b2-a3e2-e8fed8357c4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:36.217316 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955d562-f7bb-45b2-a3e2-e8fed8357c4c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:36.222454 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 579/1146] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:53:36 2022] GET /identity/v3/role_assignments?user.id=7f0059ca7c984fe385e8489232adb97d&scope.project.id=dc0138cf758e4900a635a690504199b0&role.id=ec4b73b709ca4cdc983e35e955aed57a => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:38.385397 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab369c-4154-4fde-98c0-b54aa7a0733c None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:38.386413 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab369c-4154-4fde-98c0-b54aa7a0733c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:38.386508 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab369c-4154-4fde-98c0-b54aa7a0733c None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:38.387855 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 568/1147] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:53:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:38.393079 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0331f7-def3-4cd1-ac03-640926638eb2 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:38.393487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0331f7-def3-4cd1-ac03-640926638eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:38.393617 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0331f7-def3-4cd1-ac03-640926638eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:38.410423 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-4c0331f7-def3-4cd1-ac03-640926638eb2 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:38.411628 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4c0331f7-def3-4cd1-ac03-640926638eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:38.439372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:38.475746 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 580/1148] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:53:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:53:38.498774 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab369c-4154-4fde-98c0-b54aa7a0733c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:38.600439 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab369c-4154-4fde-98c0-b54aa7a0733c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:38.633101 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15705d6a-e0e5-4021-a114-709a5e90ff36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:38.633882 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15705d6a-e0e5-4021-a114-709a5e90ff36 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:38.634173 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15705d6a-e0e5-4021-a114-709a5e90ff36 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:38.634446 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15705d6a-e0e5-4021-a114-709a5e90ff36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:38.644843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15705d6a-e0e5-4021-a114-709a5e90ff36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:53:38.652410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-15705d6a-e0e5-4021-a114-709a5e90ff36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:53:38.652410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:38.652410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:38.652410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:38.652410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:38.652410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:38.652410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:38.652410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:38.652410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:38.652410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:38.652410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:38.652410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:38.652410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:53:38.652410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:53:38.652410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:53:38.652410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:53:38.653483 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:53:38.653483 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:53:38.653483 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:53:38.653483 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:53:38.653483 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:38.653483 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:38.653483 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:38.653483 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:38.653483 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:38.653483 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:38.653483 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:38.653483 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:53:38.653483 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:38.653483 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:38.653483 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:38.653483 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:38.654511 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:38.654511 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:38.654511 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:38.654511 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:38.654511 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:53:38.654511 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:53:38.654511 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:53:38.654511 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:53:38.654511 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:53:38.654511 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:53:38.654511 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:53:38.654511 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:53:38.654511 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 569/1149] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:53:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:53:38.659553 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0331f7-def3-4cd1-ac03-640926638eb2 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:38.754515 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0331f7-def3-4cd1-ac03-640926638eb2 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:38.786963 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082cf00-99b5-4f97-8407-f70f48c31be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:38.787646 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082cf00-99b5-4f97-8407-f70f48c31be4 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:38.787933 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082cf00-99b5-4f97-8407-f70f48c31be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:38.788209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082cf00-99b5-4f97-8407-f70f48c31be4 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:38.788949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082cf00-99b5-4f97-8407-f70f48c31be4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:38.789258 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082cf00-99b5-4f97-8407-f70f48c31be4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:38.790626 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082cf00-99b5-4f97-8407-f70f48c31be4 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:38.798390 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 581/1150] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:53:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:38.804004 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15705d6a-e0e5-4021-a114-709a5e90ff36 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:38.819886 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:38.902923 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15705d6a-e0e5-4021-a114-709a5e90ff36 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:38.935350 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3cfc18-a2ec-4d59-94d5-764feab557e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:38.936205 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3cfc18-a2ec-4d59-94d5-764feab557e5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:38.936492 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3cfc18-a2ec-4d59-94d5-764feab557e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:38.936768 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3cfc18-a2ec-4d59-94d5-764feab557e5 None admin] PATH_INFO: `/v3/users/7f0059ca7c984fe385e8489232adb97d` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:38.937939 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3cfc18-a2ec-4d59-94d5-764feab557e5 None admin] RBAC: Authorizing `identity:get_user(user_id=7f0059ca7c984fe385e8489232adb97d)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:38.939396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3cfc18-a2ec-4d59-94d5-764feab557e5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:38.941003 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 570/1151] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:53:38 2022] GET /identity/v3/users/7f0059ca7c984fe385e8489232adb97d => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:38.946683 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082cf00-99b5-4f97-8407-f70f48c31be4 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:38.976993 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:39.045142 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082cf00-99b5-4f97-8407-f70f48c31be4 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:39.077346 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595e543-b01b-4581-beb3-74440795151b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:39.078192 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595e543-b01b-4581-beb3-74440795151b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:39.078475 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595e543-b01b-4581-beb3-74440795151b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:39.078749 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595e543-b01b-4581-beb3-74440795151b None admin] PATH_INFO: `/v3/projects/dc0138cf758e4900a635a690504199b0` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:39.079930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595e543-b01b-4581-beb3-74440795151b None admin] RBAC: Authorizing `identity:get_project(project_id=dc0138cf758e4900a635a690504199b0)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:39.081395 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595e543-b01b-4581-beb3-74440795151b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:39.083058 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 582/1152] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:53:38 2022] GET /identity/v3/projects/dc0138cf758e4900a635a690504199b0 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:39.088822 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3cfc18-a2ec-4d59-94d5-764feab557e5 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:39.166230 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:39.186154 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3cfc18-a2ec-4d59-94d5-764feab557e5 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:39.217484 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d25b8-ab17-45b1-a5e9-36dbd5b81045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:39.218352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d25b8-ab17-45b1-a5e9-36dbd5b81045 None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:39.218635 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d25b8-ab17-45b1-a5e9-36dbd5b81045 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:39.218908 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d25b8-ab17-45b1-a5e9-36dbd5b81045 None admin] PATH_INFO: `/v3/projects/dc0138cf758e4900a635a690504199b0/users/7f0059ca7c984fe385e8489232adb97d/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:39.220867 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d25b8-ab17-45b1-a5e9-36dbd5b81045 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc0138cf758e4900a635a690504199b0, user_id=7f0059ca7c984fe385e8489232adb97d, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:39.222289 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d25b8-ab17-45b1-a5e9-36dbd5b81045 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:39.235641 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 571/1153] 10.222.0.24 () {58 vars in 1439 bytes} [Thu May 19 14:53:39 2022] PUT /identity/v3/projects/dc0138cf758e4900a635a690504199b0/users/7f0059ca7c984fe385e8489232adb97d/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:53:41.397672 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4890ef6-0571-4671-a82d-cafe615ffbec None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:41.398173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4890ef6-0571-4671-a82d-cafe615ffbec None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:41.398263 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4890ef6-0571-4671-a82d-cafe615ffbec None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:41.399610 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 583/1154] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:41.404895 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba48c96-7223-4a1c-a1ee-cf2bd155e0e5 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:41.405310 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba48c96-7223-4a1c-a1ee-cf2bd155e0e5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:41.405468 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba48c96-7223-4a1c-a1ee-cf2bd155e0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:41.422291 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-3ba48c96-7223-4a1c-a1ee-cf2bd155e0e5 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:41.423498 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3ba48c96-7223-4a1c-a1ee-cf2bd155e0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:41.486352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 572/1155] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:53:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:53:41.510357 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4890ef6-0571-4671-a82d-cafe615ffbec None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:41.606817 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:41.612053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4890ef6-0571-4671-a82d-cafe615ffbec None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:41.644173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47087f04-7f71-4b5b-82e6-06742e32302e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:41.644939 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47087f04-7f71-4b5b-82e6-06742e32302e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:41.645215 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47087f04-7f71-4b5b-82e6-06742e32302e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:41.645484 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47087f04-7f71-4b5b-82e6-06742e32302e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:41.655632 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47087f04-7f71-4b5b-82e6-06742e32302e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:53:41.663119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-47087f04-7f71-4b5b-82e6-06742e32302e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:53:41.663119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:41.663119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:41.663119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:41.663119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:41.663119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:41.663119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:41.663119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:41.663119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:41.663119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:41.663119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:41.663119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:41.663119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:53:41.663119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:53:41.663119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:53:41.663119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:53:41.664253 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:53:41.664253 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:53:41.664253 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:53:41.664253 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:53:41.664253 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:41.664253 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:41.664253 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:41.664253 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:41.664253 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:41.664253 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:41.664253 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:41.664253 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:53:41.664253 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:41.664253 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:41.664253 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:41.664253 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:41.665467 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:41.665467 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:41.665467 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:41.665467 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:41.665467 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:53:41.665467 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:53:41.665467 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:53:41.665467 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:53:41.665467 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:53:41.665467 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:53:41.665467 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:53:41.665467 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:53:41.665467 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 584/1156] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:53:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:53:41.670854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba48c96-7223-4a1c-a1ee-cf2bd155e0e5 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:41.735524 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:41.766627 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba48c96-7223-4a1c-a1ee-cf2bd155e0e5 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:41.799151 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176190d4-c6bb-4fbf-8899-f44df056d3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:41.799833 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176190d4-c6bb-4fbf-8899-f44df056d3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:41.800115 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176190d4-c6bb-4fbf-8899-f44df056d3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:41.800389 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176190d4-c6bb-4fbf-8899-f44df056d3a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:41.801132 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176190d4-c6bb-4fbf-8899-f44df056d3a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:41.801438 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176190d4-c6bb-4fbf-8899-f44df056d3a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:41.802793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176190d4-c6bb-4fbf-8899-f44df056d3a9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:41.810480 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 573/1157] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:53:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:41.816162 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47087f04-7f71-4b5b-82e6-06742e32302e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:41.913034 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47087f04-7f71-4b5b-82e6-06742e32302e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:41.944322 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6408c7-4910-4659-b4c5-cffe450b39b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:41.945182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6408c7-4910-4659-b4c5-cffe450b39b1 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:41.945463 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6408c7-4910-4659-b4c5-cffe450b39b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:41.945737 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6408c7-4910-4659-b4c5-cffe450b39b1 None admin] PATH_INFO: `/v3/users/7f0059ca7c984fe385e8489232adb97d` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:41.946891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6408c7-4910-4659-b4c5-cffe450b39b1 None admin] RBAC: Authorizing `identity:get_user(user_id=7f0059ca7c984fe385e8489232adb97d)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:41.948830 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6408c7-4910-4659-b4c5-cffe450b39b1 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:41.950426 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 585/1158] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:53:41 2022] GET /identity/v3/users/7f0059ca7c984fe385e8489232adb97d => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:41.956079 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176190d4-c6bb-4fbf-8899-f44df056d3a9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:42.051097 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176190d4-c6bb-4fbf-8899-f44df056d3a9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:42.078465 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:42.083745 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fe609-b78b-413e-bdb2-15c514132fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:42.084396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fe609-b78b-413e-bdb2-15c514132fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:42.084684 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fe609-b78b-413e-bdb2-15c514132fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:42.084971 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fe609-b78b-413e-bdb2-15c514132fb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:42.149535 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fe609-b78b-413e-bdb2-15c514132fb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:42.150998 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fe609-b78b-413e-bdb2-15c514132fb9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:42.244737 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 574/1159] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:53:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:53:42.250951 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6408c7-4910-4659-b4c5-cffe450b39b1 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:42.278248 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:42.348805 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6408c7-4910-4659-b4c5-cffe450b39b1 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:42.381279 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c1d40-ff86-41b8-8b71-5e802d05607c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:42.382128 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c1d40-ff86-41b8-8b71-5e802d05607c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:42.382408 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c1d40-ff86-41b8-8b71-5e802d05607c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:42.382683 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c1d40-ff86-41b8-8b71-5e802d05607c None admin] PATH_INFO: `/v3/projects/dc0138cf758e4900a635a690504199b0` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:42.383862 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1c1d40-ff86-41b8-8b71-5e802d05607c None admin] RBAC: Authorizing `identity:get_project(project_id=dc0138cf758e4900a635a690504199b0)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:42.385291 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1c1d40-ff86-41b8-8b71-5e802d05607c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:42.387621 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 586/1160] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:53:42 2022] GET /identity/v3/projects/dc0138cf758e4900a635a690504199b0 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:42.393611 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fe609-b78b-413e-bdb2-15c514132fb9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:42.422361 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:42.487695 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fe609-b78b-413e-bdb2-15c514132fb9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:42.520683 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75239d16-0d2c-4bfd-ad97-a6bac2f2a139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:42.521271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75239d16-0d2c-4bfd-ad97-a6bac2f2a139 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:42.521619 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75239d16-0d2c-4bfd-ad97-a6bac2f2a139 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:42.521897 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75239d16-0d2c-4bfd-ad97-a6bac2f2a139 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:42.522715 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75239d16-0d2c-4bfd-ad97-a6bac2f2a139 None admin] RBAC: Adding query filter params (role.id=ec4b73b709ca4cdc983e35e955aed57a, scope.project.id=dc0138cf758e4900a635a690504199b0, user.id=7f0059ca7c984fe385e8489232adb97d) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:42.523030 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75239d16-0d2c-4bfd-ad97-a6bac2f2a139 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:42.524482 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75239d16-0d2c-4bfd-ad97-a6bac2f2a139 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:42.530079 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 575/1161] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:53:42 2022] GET /identity/v3/role_assignments?user.id=7f0059ca7c984fe385e8489232adb97d&scope.project.id=dc0138cf758e4900a635a690504199b0&role.id=ec4b73b709ca4cdc983e35e955aed57a => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:44.756150 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976bd84-0c12-44bc-a86f-b8b2c5b20ae3 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:44.756777 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976bd84-0c12-44bc-a86f-b8b2c5b20ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:44.756777 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976bd84-0c12-44bc-a86f-b8b2c5b20ae3 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:44.758039 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 587/1162] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:44.763319 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d5bcf-ba93-4674-9bf9-1cb34fe98724 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:44.763740 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d5bcf-ba93-4674-9bf9-1cb34fe98724 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:44.763887 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d5bcf-ba93-4674-9bf9-1cb34fe98724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:44.780559 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c69d5bcf-ba93-4674-9bf9-1cb34fe98724 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:44.781734 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c69d5bcf-ba93-4674-9bf9-1cb34fe98724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:44.845728 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 576/1163] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:53:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:53:44.868491 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2976bd84-0c12-44bc-a86f-b8b2c5b20ae3 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:44.963338 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:44.971942 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2976bd84-0c12-44bc-a86f-b8b2c5b20ae3 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:45.004620 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d395c-61a9-4213-abd7-20954f383ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:45.005258 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d395c-61a9-4213-abd7-20954f383ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:45.005543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d395c-61a9-4213-abd7-20954f383ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:45.005818 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d395c-61a9-4213-abd7-20954f383ad9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:45.070754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d395c-61a9-4213-abd7-20954f383ad9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:45.072169 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d395c-61a9-4213-abd7-20954f383ad9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:45.159830 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:45.167276 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 588/1164] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:53:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:53:45.173195 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d5bcf-ba93-4674-9bf9-1cb34fe98724 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:45.199038 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:45.268632 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d5bcf-ba93-4674-9bf9-1cb34fe98724 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:45.300248 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9be850-a119-4a7c-a127-4b02119d5a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:45.301032 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9be850-a119-4a7c-a127-4b02119d5a5e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:45.301316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9be850-a119-4a7c-a127-4b02119d5a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:45.301592 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9be850-a119-4a7c-a127-4b02119d5a5e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:45.308554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9be850-a119-4a7c-a127-4b02119d5a5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:45.310014 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9be850-a119-4a7c-a127-4b02119d5a5e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:45.324543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-5b9be850-a119-4a7c-a127-4b02119d5a5e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 14:53:45.324543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:45.324543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 19 14:53:45.324543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 19 14:53:45.324543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:53:45.324543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:53:45.324543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:53:45.324543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:53:45.324543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 19 14:53:45.324543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:53:45.324543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:53:45.324543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:53:45.324543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:45.324543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:45.324543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:45.324543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:45.324543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:45.325959 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:45.325959 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:45.325959 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:45.325959 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:45.325959 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:45.325959 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:45.325959 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:53:45.325959 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:53:45.325959 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:53:45.325959 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:53:45.325959 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:45.325959 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:45.325959 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:45.325959 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:45.325959 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:45.325959 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:45.327025 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:45.327025 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:53:45.327025 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:45.327025 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:45.327025 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:45.327025 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:45.327025 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:45.327025 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:45.327025 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:45.327025 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:45.327025 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 19 14:53:45.327025 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:53:45.327025 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 19 14:53:45.327025 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:53:45.327025 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 577/1165] 10.222.0.24 () {56 vars in 1117 bytes} [Thu May 19 14:53:45 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:53:45.331547 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d395c-61a9-4213-abd7-20954f383ad9 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:45.426109 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d395c-61a9-4213-abd7-20954f383ad9 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:45.459092 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dccbb-4a13-486e-bb50-f78227adccb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:45.459760 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dccbb-4a13-486e-bb50-f78227adccb9 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:45.460047 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dccbb-4a13-486e-bb50-f78227adccb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:45.460322 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dccbb-4a13-486e-bb50-f78227adccb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:45.461036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91dccbb-4a13-486e-bb50-f78227adccb9 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:45.461341 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91dccbb-4a13-486e-bb50-f78227adccb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:45.462691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91dccbb-4a13-486e-bb50-f78227adccb9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:45.469699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 589/1166] 10.222.0.24 () {56 vars in 1115 bytes} [Thu May 19 14:53:45 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:47.650432 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee2ba6-109d-43da-8db4-c84163e490e3 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:47.651478 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee2ba6-109d-43da-8db4-c84163e490e3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:47.651478 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee2ba6-109d-43da-8db4-c84163e490e3 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:47.652829 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 578/1167] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:53:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:47.658155 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac19a55-f374-4f05-9b32-1f6f7cb07214 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:47.658553 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac19a55-f374-4f05-9b32-1f6f7cb07214 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:47.658711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac19a55-f374-4f05-9b32-1f6f7cb07214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:47.675640 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-aac19a55-f374-4f05-9b32-1f6f7cb07214 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:47.676813 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-aac19a55-f374-4f05-9b32-1f6f7cb07214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:47.727854 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:47.741348 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 590/1168] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:53:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:53:47.765059 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee2ba6-109d-43da-8db4-c84163e490e3 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:47.847889 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:47.863869 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee2ba6-109d-43da-8db4-c84163e490e3 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:47.896260 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab81ed3-dbdd-4dd3-83d6-3332b002e279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:47.896908 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab81ed3-dbdd-4dd3-83d6-3332b002e279 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:47.897198 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab81ed3-dbdd-4dd3-83d6-3332b002e279 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:47.897481 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab81ed3-dbdd-4dd3-83d6-3332b002e279 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:47.898226 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab81ed3-dbdd-4dd3-83d6-3332b002e279 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:47.899630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab81ed3-dbdd-4dd3-83d6-3332b002e279 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:47.913227 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 579/1169] 10.222.0.24 () {60 vars in 1138 bytes} [Thu May 19 14:53:47 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:53:50.128728 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518976c-d68e-432e-b035-e30247d5d0a9 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:50.129280 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518976c-d68e-432e-b035-e30247d5d0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:50.129280 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518976c-d68e-432e-b035-e30247d5d0a9 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:50.130630 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 591/1170] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:50.135959 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5403897-d5ed-4a4f-a01d-63bbe1d936cd None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:50.136369 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5403897-d5ed-4a4f-a01d-63bbe1d936cd None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:50.136529 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5403897-d5ed-4a4f-a01d-63bbe1d936cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:50.152769 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e5403897-d5ed-4a4f-a01d-63bbe1d936cd None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:50.153941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e5403897-d5ed-4a4f-a01d-63bbe1d936cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:50.217582 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 580/1171] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:53:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:53:50.240724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518976c-d68e-432e-b035-e30247d5d0a9 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:50.338648 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518976c-d68e-432e-b035-e30247d5d0a9 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:50.373338 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42213ce4-e326-4193-a822-11d08c0be864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:50.374212 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42213ce4-e326-4193-a822-11d08c0be864 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:50.374494 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42213ce4-e326-4193-a822-11d08c0be864 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:50.374799 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42213ce4-e326-4193-a822-11d08c0be864 None admin] PATH_INFO: `/v3/domains/c0a7ddc1722b451494473d0b275b667a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:50.389632 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42213ce4-e326-4193-a822-11d08c0be864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c0a7ddc1722b451494473d0b275b667a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:50.391016 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42213ce4-e326-4193-a822-11d08c0be864 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:50.392756 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 592/1172] 10.222.0.24 () {56 vars in 1183 bytes} [Thu May 19 14:53:50 2022] GET /identity/v3/domains/c0a7ddc1722b451494473d0b275b667a => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:50.398796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5403897-d5ed-4a4f-a01d-63bbe1d936cd None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:50.472527 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:50.496768 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5403897-d5ed-4a4f-a01d-63bbe1d936cd None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:50.529818 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02669dd-7d4f-4cad-ae07-b5f8ada43137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:50.530476 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02669dd-7d4f-4cad-ae07-b5f8ada43137 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:50.530758 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02669dd-7d4f-4cad-ae07-b5f8ada43137 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:50.531034 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02669dd-7d4f-4cad-ae07-b5f8ada43137 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:50.531763 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02669dd-7d4f-4cad-ae07-b5f8ada43137 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:50.533210 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02669dd-7d4f-4cad-ae07-b5f8ada43137 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:50.556947 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 581/1173] 10.222.0.24 () {60 vars in 1141 bytes} [Thu May 19 14:53:50 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:53:52.817148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8e5fe-6b86-47cb-ae4a-96ef69221ce6 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:52.817677 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8e5fe-6b86-47cb-ae4a-96ef69221ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:52.817768 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8e5fe-6b86-47cb-ae4a-96ef69221ce6 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:52.819065 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 593/1174] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:52.824445 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711c4c9-38d6-4be2-b9c0-21348819be22 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:52.824824 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711c4c9-38d6-4be2-b9c0-21348819be22 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:52.825024 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711c4c9-38d6-4be2-b9c0-21348819be22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:52.841849 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a711c4c9-38d6-4be2-b9c0-21348819be22 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:52.843037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a711c4c9-38d6-4be2-b9c0-21348819be22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:52.907008 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 582/1175] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:53:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:53:52.932106 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8e5fe-6b86-47cb-ae4a-96ef69221ce6 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:52.981439 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:53.032038 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8e5fe-6b86-47cb-ae4a-96ef69221ce6 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:53.065006 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dde2c0-33f1-4876-a5be-b10b5195b739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:53.065860 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dde2c0-33f1-4876-a5be-b10b5195b739 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:53.066146 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dde2c0-33f1-4876-a5be-b10b5195b739 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:53.066424 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dde2c0-33f1-4876-a5be-b10b5195b739 None admin] PATH_INFO: `/v3/domains/c0a7ddc1722b451494473d0b275b667a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:53.067675 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dde2c0-33f1-4876-a5be-b10b5195b739 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c0a7ddc1722b451494473d0b275b667a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:53.069077 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dde2c0-33f1-4876-a5be-b10b5195b739 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:53.070679 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 594/1176] 10.222.0.24 () {56 vars in 1183 bytes} [Thu May 19 14:53:52 2022] GET /identity/v3/domains/c0a7ddc1722b451494473d0b275b667a => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:53.076501 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711c4c9-38d6-4be2-b9c0-21348819be22 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:53.132386 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:53.173282 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711c4c9-38d6-4be2-b9c0-21348819be22 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:53.211771 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5829257-b044-4c85-bb03-621d70135e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:53.212429 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5829257-b044-4c85-bb03-621d70135e1a None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:53.212711 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5829257-b044-4c85-bb03-621d70135e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:53.212988 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5829257-b044-4c85-bb03-621d70135e1a None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:53.214550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5829257-b044-4c85-bb03-621d70135e1a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:53.215993 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5829257-b044-4c85-bb03-621d70135e1a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:53.234862 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 583/1177] 10.222.0.24 () {60 vars in 1132 bytes} [Thu May 19 14:53:53 2022] POST /identity/v3/users => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:53:55.499744 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402205e8-44b3-4e8e-b4b3-12cc9d0e4fb0 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:55.500289 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402205e8-44b3-4e8e-b4b3-12cc9d0e4fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:55.500289 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402205e8-44b3-4e8e-b4b3-12cc9d0e4fb0 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:55.501630 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 595/1178] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:55.506872 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c6187-369b-4433-868d-d5b427f79515 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:55.507300 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c6187-369b-4433-868d-d5b427f79515 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:55.507461 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c6187-369b-4433-868d-d5b427f79515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:55.524105 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9b3c6187-369b-4433-868d-d5b427f79515 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:55.525272 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9b3c6187-369b-4433-868d-d5b427f79515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:55.589156 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 584/1179] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:53:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:53:55.614373 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402205e8-44b3-4e8e-b4b3-12cc9d0e4fb0 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:55.715326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402205e8-44b3-4e8e-b4b3-12cc9d0e4fb0 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:55.730824 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:55.749474 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73e101-fdb7-4774-896f-a160f0eb5f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:55.750265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73e101-fdb7-4774-896f-a160f0eb5f77 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:55.750546 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73e101-fdb7-4774-896f-a160f0eb5f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:55.750819 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73e101-fdb7-4774-896f-a160f0eb5f77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:55.761268 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d73e101-fdb7-4774-896f-a160f0eb5f77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:53:55.768867 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-6d73e101-fdb7-4774-896f-a160f0eb5f77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:53:55.768867 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:55.768867 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:55.768867 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:55.768867 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:55.768867 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:55.768867 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:55.768867 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:55.768867 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:55.768867 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:55.768867 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:55.768867 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:55.768867 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:53:55.768867 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:53:55.768867 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:53:55.768867 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:53:55.769959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:53:55.769959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:53:55.769959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:53:55.769959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:53:55.769959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:55.769959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:55.769959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:55.769959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:55.769959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:55.769959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:55.769959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:55.769959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:53:55.769959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:55.769959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:55.769959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:55.769959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:55.771027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:55.771027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:55.771027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:55.771027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:55.771027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:53:55.771027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:53:55.771027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:53:55.771027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:53:55.771027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:53:55.771027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:53:55.771027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:53:55.771027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:53:55.771027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 596/1180] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:53:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:53:55.776238 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c6187-369b-4433-868d-d5b427f79515 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:55.819364 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:55.873099 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c6187-369b-4433-868d-d5b427f79515 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:55.905363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad3c7d-101d-4b50-b2c1-79e6c5adb049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:55.906020 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad3c7d-101d-4b50-b2c1-79e6c5adb049 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:55.906307 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad3c7d-101d-4b50-b2c1-79e6c5adb049 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:55.906587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad3c7d-101d-4b50-b2c1-79e6c5adb049 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:55.907362 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad3c7d-101d-4b50-b2c1-79e6c5adb049 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:55.907675 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad3c7d-101d-4b50-b2c1-79e6c5adb049 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:55.909053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad3c7d-101d-4b50-b2c1-79e6c5adb049 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:55.916896 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 585/1181] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:53:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:55.922606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73e101-fdb7-4774-896f-a160f0eb5f77 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:56.020806 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73e101-fdb7-4774-896f-a160f0eb5f77 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:56.053076 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e645dc8-4926-4f6a-a95e-5a76625fc004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:56.053932 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e645dc8-4926-4f6a-a95e-5a76625fc004 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:56.054215 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e645dc8-4926-4f6a-a95e-5a76625fc004 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:56.054492 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e645dc8-4926-4f6a-a95e-5a76625fc004 None admin] PATH_INFO: `/v3/users/da9985387e7c41649fe4bbcee3cd371d` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:56.068112 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e645dc8-4926-4f6a-a95e-5a76625fc004 None admin] RBAC: Authorizing `identity:get_user(user_id=da9985387e7c41649fe4bbcee3cd371d)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:56.069560 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e645dc8-4926-4f6a-a95e-5a76625fc004 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:56.071173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 597/1182] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:53:55 2022] GET /identity/v3/users/da9985387e7c41649fe4bbcee3cd371d => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:56.077439 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad3c7d-101d-4b50-b2c1-79e6c5adb049 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:56.174227 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad3c7d-101d-4b50-b2c1-79e6c5adb049 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:56.180856 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:56.207362 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbe960-7004-4aa1-a12f-a6b775a54158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:56.208012 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbe960-7004-4aa1-a12f-a6b775a54158 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:56.208300 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbe960-7004-4aa1-a12f-a6b775a54158 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:56.208580 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbe960-7004-4aa1-a12f-a6b775a54158 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:56.273854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbe960-7004-4aa1-a12f-a6b775a54158 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:56.275343 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbe960-7004-4aa1-a12f-a6b775a54158 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:56.372160 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 586/1183] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:53:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:53:56.377924 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e645dc8-4926-4f6a-a95e-5a76625fc004 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:56.409886 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:56.472705 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e645dc8-4926-4f6a-a95e-5a76625fc004 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:56.505395 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037fe3f-f76e-4e80-8866-148ae759ab24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:56.506231 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037fe3f-f76e-4e80-8866-148ae759ab24 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:56.506507 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037fe3f-f76e-4e80-8866-148ae759ab24 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:56.506774 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037fe3f-f76e-4e80-8866-148ae759ab24 None admin] PATH_INFO: `/v3/projects/5a2adcaed1e54eddbd858bea6e720410` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:56.507946 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037fe3f-f76e-4e80-8866-148ae759ab24 None admin] RBAC: Authorizing `identity:get_project(project_id=5a2adcaed1e54eddbd858bea6e720410)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:56.509356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037fe3f-f76e-4e80-8866-148ae759ab24 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:56.511018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 598/1184] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:53:56 2022] GET /identity/v3/projects/5a2adcaed1e54eddbd858bea6e720410 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:56.516980 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbe960-7004-4aa1-a12f-a6b775a54158 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:56.524772 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:56.613199 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbe960-7004-4aa1-a12f-a6b775a54158 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:56.645440 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196af586-2299-403c-8a24-bb1bf3fbd04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:56.646081 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196af586-2299-403c-8a24-bb1bf3fbd04c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:56.646368 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196af586-2299-403c-8a24-bb1bf3fbd04c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:56.646646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196af586-2299-403c-8a24-bb1bf3fbd04c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:56.647493 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196af586-2299-403c-8a24-bb1bf3fbd04c None admin] RBAC: Adding query filter params (role.id=ec4b73b709ca4cdc983e35e955aed57a, scope.project.id=5a2adcaed1e54eddbd858bea6e720410, user.id=da9985387e7c41649fe4bbcee3cd371d) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:56.647808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196af586-2299-403c-8a24-bb1bf3fbd04c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:56.649239 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196af586-2299-403c-8a24-bb1bf3fbd04c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:56.654994 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 587/1185] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:53:56 2022] GET /identity/v3/role_assignments?user.id=da9985387e7c41649fe4bbcee3cd371d&scope.project.id=5a2adcaed1e54eddbd858bea6e720410&role.id=ec4b73b709ca4cdc983e35e955aed57a => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:58.796933 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca2f35-5c10-4444-8670-4ae2a45ae9ba None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:58.797462 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca2f35-5c10-4444-8670-4ae2a45ae9ba None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:58.797462 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca2f35-5c10-4444-8670-4ae2a45ae9ba None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:58.798821 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 599/1186] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:53:58.804140 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdeb61-c01d-4586-a41b-6e83ef601b17 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:58.804579 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdeb61-c01d-4586-a41b-6e83ef601b17 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:58.804706 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdeb61-c01d-4586-a41b-6e83ef601b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:58.821394 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-35bdeb61-c01d-4586-a41b-6e83ef601b17 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:53:58.823168 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-35bdeb61-c01d-4586-a41b-6e83ef601b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:53:58.882989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:58.888791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 588/1187] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:53:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:53:58.910235 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca2f35-5c10-4444-8670-4ae2a45ae9ba None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:59.006420 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca2f35-5c10-4444-8670-4ae2a45ae9ba None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:59.007913 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:59.040413 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed05591-b3bb-442b-ab1f-80a1120e2289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:59.041245 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed05591-b3bb-442b-ab1f-80a1120e2289 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:59.041523 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed05591-b3bb-442b-ab1f-80a1120e2289 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:59.041791 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed05591-b3bb-442b-ab1f-80a1120e2289 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:59.051570 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed05591-b3bb-442b-ab1f-80a1120e2289 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:53:59.059926 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-eed05591-b3bb-442b-ab1f-80a1120e2289 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:53:59.059926 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:53:59.059926 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:53:59.059926 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:53:59.059926 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:53:59.059926 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:53:59.059926 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:53:59.059926 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:53:59.059926 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:53:59.059926 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:53:59.059926 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:53:59.059926 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:53:59.059926 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:53:59.059926 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:53:59.059926 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:53:59.059926 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:53:59.061053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:53:59.061053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:53:59.061053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:53:59.061053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:53:59.061053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:53:59.061053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:53:59.061053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:53:59.061053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:53:59.061053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:53:59.061053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:53:59.061053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:53:59.061053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:53:59.061053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:53:59.061053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:53:59.061053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:53:59.061053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:53:59.062093 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:53:59.062093 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:53:59.062093 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:53:59.062093 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:53:59.062093 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:53:59.062093 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:53:59.062093 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:53:59.062093 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:53:59.062093 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:53:59.062093 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:53:59.062093 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:53:59.062093 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:53:59.062093 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 600/1188] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:53:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:53:59.068398 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdeb61-c01d-4586-a41b-6e83ef601b17 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:59.163848 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdeb61-c01d-4586-a41b-6e83ef601b17 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:59.196520 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8911f-7400-4142-ab51-af68df3d6463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:59.197204 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8911f-7400-4142-ab51-af68df3d6463 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:59.197494 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8911f-7400-4142-ab51-af68df3d6463 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:59.197773 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8911f-7400-4142-ab51-af68df3d6463 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:59.198512 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b8911f-7400-4142-ab51-af68df3d6463 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:53:59.198822 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b8911f-7400-4142-ab51-af68df3d6463 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:59.200220 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b8911f-7400-4142-ab51-af68df3d6463 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:59.208023 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 589/1189] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:53:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:59.214018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed05591-b3bb-442b-ab1f-80a1120e2289 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:59.309116 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed05591-b3bb-442b-ab1f-80a1120e2289 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:59.340884 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e5d6b-a058-4fc6-9440-7460b1a244cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:59.341754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e5d6b-a058-4fc6-9440-7460b1a244cd None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:59.342039 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e5d6b-a058-4fc6-9440-7460b1a244cd None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:59.342314 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e5d6b-a058-4fc6-9440-7460b1a244cd None admin] PATH_INFO: `/v3/users/da9985387e7c41649fe4bbcee3cd371d` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:59.343533 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e5d6b-a058-4fc6-9440-7460b1a244cd None admin] RBAC: Authorizing `identity:get_user(user_id=da9985387e7c41649fe4bbcee3cd371d)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:59.344965 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e5d6b-a058-4fc6-9440-7460b1a244cd None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:59.346579 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 601/1190] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:53:59 2022] GET /identity/v3/users/da9985387e7c41649fe4bbcee3cd371d => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:59.352207 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8911f-7400-4142-ab51-af68df3d6463 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:59.411680 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:59.452124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8911f-7400-4142-ab51-af68df3d6463 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:59.484594 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5d38e-124c-4e92-9b7c-0cfbe4c85c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:59.485450 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5d38e-124c-4e92-9b7c-0cfbe4c85c68 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:59.485737 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5d38e-124c-4e92-9b7c-0cfbe4c85c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:59.486015 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5d38e-124c-4e92-9b7c-0cfbe4c85c68 None admin] PATH_INFO: `/v3/projects/5a2adcaed1e54eddbd858bea6e720410` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:59.487181 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5d38e-124c-4e92-9b7c-0cfbe4c85c68 None admin] RBAC: Authorizing `identity:get_project(project_id=5a2adcaed1e54eddbd858bea6e720410)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:59.488634 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5d38e-124c-4e92-9b7c-0cfbe4c85c68 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:59.490317 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 590/1191] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:53:59 2022] GET /identity/v3/projects/5a2adcaed1e54eddbd858bea6e720410 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:53:59.497065 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e5d6b-a058-4fc6-9440-7460b1a244cd None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:53:59.527308 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:53:59.594803 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e5d6b-a058-4fc6-9440-7460b1a244cd None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:53:59.628781 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aff0b1-826a-4878-a633-3dd7c8aba0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:53:59.629656 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aff0b1-826a-4878-a633-3dd7c8aba0f2 None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:53:59.629936 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aff0b1-826a-4878-a633-3dd7c8aba0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:53:59.630208 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aff0b1-826a-4878-a633-3dd7c8aba0f2 None admin] PATH_INFO: `/v3/projects/5a2adcaed1e54eddbd858bea6e720410/users/da9985387e7c41649fe4bbcee3cd371d/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:53:59.632161 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aff0b1-826a-4878-a633-3dd7c8aba0f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a2adcaed1e54eddbd858bea6e720410, user_id=da9985387e7c41649fe4bbcee3cd371d, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:53:59.633599 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aff0b1-826a-4878-a633-3dd7c8aba0f2 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:53:59.645967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 602/1192] 10.222.0.24 () {58 vars in 1439 bytes} [Thu May 19 14:53:59 2022] PUT /identity/v3/projects/5a2adcaed1e54eddbd858bea6e720410/users/da9985387e7c41649fe4bbcee3cd371d/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:54:01.814095 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf0621-c29d-4202-9b9f-1cb7042255a0 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:01.814622 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf0621-c29d-4202-9b9f-1cb7042255a0 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:01.814715 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf0621-c29d-4202-9b9f-1cb7042255a0 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:01.816049 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 591/1193] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:54:01.821197 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a119ef6-852c-48f0-b7ce-cda46f44e2cb None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:01.821578 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a119ef6-852c-48f0-b7ce-cda46f44e2cb None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:01.821748 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a119ef6-852c-48f0-b7ce-cda46f44e2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:01.839060 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9a119ef6-852c-48f0-b7ce-cda46f44e2cb None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:54:01.840241 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9a119ef6-852c-48f0-b7ce-cda46f44e2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:54:01.903616 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 603/1194] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:54:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:54:01.927366 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf0621-c29d-4202-9b9f-1cb7042255a0 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:02.023267 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf0621-c29d-4202-9b9f-1cb7042255a0 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:02.050714 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:02.056494 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78280bc-79d0-4e35-bf1d-401760c6fb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:02.057273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78280bc-79d0-4e35-bf1d-401760c6fb13 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:02.057556 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78280bc-79d0-4e35-bf1d-401760c6fb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:02.057831 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78280bc-79d0-4e35-bf1d-401760c6fb13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:02.068629 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78280bc-79d0-4e35-bf1d-401760c6fb13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:54:02.076220 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-d78280bc-79d0-4e35-bf1d-401760c6fb13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:54:02.076220 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:54:02.076220 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:54:02.076220 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:54:02.076220 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:54:02.076220 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:54:02.076220 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:54:02.076220 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:54:02.076220 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:54:02.076220 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:54:02.076220 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:54:02.076220 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:54:02.076220 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:54:02.076220 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:54:02.076220 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:54:02.076220 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:54:02.077352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:54:02.077352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:54:02.077352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:54:02.077352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:54:02.077352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:54:02.077352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:54:02.077352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:54:02.077352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:54:02.077352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:54:02.077352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:54:02.077352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:54:02.077352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:54:02.077352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:54:02.077352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:54:02.077352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:54:02.077352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:54:02.078470 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:54:02.078470 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:54:02.078470 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:54:02.078470 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:54:02.078470 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:54:02.078470 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:54:02.078470 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:54:02.078470 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:54:02.078470 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:54:02.078470 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:54:02.078470 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:54:02.078470 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:54:02.078470 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 592/1195] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:54:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:54:02.083291 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a119ef6-852c-48f0-b7ce-cda46f44e2cb None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:02.104435 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:02.180377 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a119ef6-852c-48f0-b7ce-cda46f44e2cb None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:02.213425 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c07cf0-5ce1-4fb3-881b-6cbe287523e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:02.214116 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c07cf0-5ce1-4fb3-881b-6cbe287523e1 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:02.214399 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c07cf0-5ce1-4fb3-881b-6cbe287523e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:02.214676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c07cf0-5ce1-4fb3-881b-6cbe287523e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:02.215450 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c07cf0-5ce1-4fb3-881b-6cbe287523e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:02.215755 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c07cf0-5ce1-4fb3-881b-6cbe287523e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:02.217120 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c07cf0-5ce1-4fb3-881b-6cbe287523e1 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:02.224936 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 604/1196] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:54:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:54:02.231376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78280bc-79d0-4e35-bf1d-401760c6fb13 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:02.326555 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78280bc-79d0-4e35-bf1d-401760c6fb13 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:02.358906 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8211c-9cab-44b5-8a10-7ecfeed5f1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:02.359793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8211c-9cab-44b5-8a10-7ecfeed5f1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:02.360071 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8211c-9cab-44b5-8a10-7ecfeed5f1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:02.360341 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8211c-9cab-44b5-8a10-7ecfeed5f1a3 None admin] PATH_INFO: `/v3/users/da9985387e7c41649fe4bbcee3cd371d` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:02.361494 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8211c-9cab-44b5-8a10-7ecfeed5f1a3 None admin] RBAC: Authorizing `identity:get_user(user_id=da9985387e7c41649fe4bbcee3cd371d)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:02.362922 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8211c-9cab-44b5-8a10-7ecfeed5f1a3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:02.364588 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 593/1197] 10.222.0.24 () {56 vars in 1177 bytes} [Thu May 19 14:54:02 2022] GET /identity/v3/users/da9985387e7c41649fe4bbcee3cd371d => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:02.370618 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c07cf0-5ce1-4fb3-881b-6cbe287523e1 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:02.452878 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:02.470953 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c07cf0-5ce1-4fb3-881b-6cbe287523e1 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:02.502692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968f97f-fead-4e8b-8524-10ed0f43c793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:02.503354 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968f97f-fead-4e8b-8524-10ed0f43c793 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:02.503635 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968f97f-fead-4e8b-8524-10ed0f43c793 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:02.503904 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968f97f-fead-4e8b-8524-10ed0f43c793 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:02.567304 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968f97f-fead-4e8b-8524-10ed0f43c793 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:02.568722 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968f97f-fead-4e8b-8524-10ed0f43c793 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:02.644164 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:02.661850 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 605/1198] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:54:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:54:02.667748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8211c-9cab-44b5-8a10-7ecfeed5f1a3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:02.723788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:02.777644 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8211c-9cab-44b5-8a10-7ecfeed5f1a3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:02.810429 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b7c9d4-7b56-4f4c-bcaf-92cda05903e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:02.811307 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7c9d4-7b56-4f4c-bcaf-92cda05903e7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:02.811595 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7c9d4-7b56-4f4c-bcaf-92cda05903e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:02.811879 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b7c9d4-7b56-4f4c-bcaf-92cda05903e7 None admin] PATH_INFO: `/v3/projects/5a2adcaed1e54eddbd858bea6e720410` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:02.813043 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b7c9d4-7b56-4f4c-bcaf-92cda05903e7 None admin] RBAC: Authorizing `identity:get_project(project_id=5a2adcaed1e54eddbd858bea6e720410)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:02.814479 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b7c9d4-7b56-4f4c-bcaf-92cda05903e7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:02.816197 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 594/1199] 10.222.0.24 () {56 vars in 1186 bytes} [Thu May 19 14:54:02 2022] GET /identity/v3/projects/5a2adcaed1e54eddbd858bea6e720410 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:02.822869 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968f97f-fead-4e8b-8524-10ed0f43c793 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:54:02.919046 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968f97f-fead-4e8b-8524-10ed0f43c793 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:54:02.951406 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7242db-418a-48a4-9ef5-afecc8e5c7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:54:02.952043 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7242db-418a-48a4-9ef5-afecc8e5c7e7 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:54:02.952322 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7242db-418a-48a4-9ef5-afecc8e5c7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:54:02.952593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7242db-418a-48a4-9ef5-afecc8e5c7e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:54:02.953412 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7242db-418a-48a4-9ef5-afecc8e5c7e7 None admin] RBAC: Adding query filter params (role.id=ec4b73b709ca4cdc983e35e955aed57a, scope.project.id=5a2adcaed1e54eddbd858bea6e720410, user.id=da9985387e7c41649fe4bbcee3cd371d) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:54:02.953721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7242db-418a-48a4-9ef5-afecc8e5c7e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:54:02.955141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7242db-418a-48a4-9ef5-afecc8e5c7e7 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:54:02.960740 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 606/1200] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:54:02 2022] GET /identity/v3/role_assignments?user.id=da9985387e7c41649fe4bbcee3cd371d&scope.project.id=5a2adcaed1e54eddbd858bea6e720410&role.id=ec4b73b709ca4cdc983e35e955aed57a => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:54:12.805846 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=37 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:54:12.958177 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=77 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:03.730698 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f503e26-1e21-469d-bf94-efbc8a017829 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:03.730698 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f503e26-1e21-469d-bf94-efbc8a017829 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:03.730698 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f503e26-1e21-469d-bf94-efbc8a017829 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:03.730698 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 595/1201] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:55:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:55:03.737117 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e54320-3b19-47ea-bf12-5bbbc463364f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:03.737570 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e54320-3b19-47ea-bf12-5bbbc463364f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:03.737665 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e54320-3b19-47ea-bf12-5bbbc463364f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:03.762668 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-12e54320-3b19-47ea-bf12-5bbbc463364f None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:55:03.763985 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-12e54320-3b19-47ea-bf12-5bbbc463364f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:55:03.845001 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 607/1202] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:55:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:55:03.872020 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f503e26-1e21-469d-bf94-efbc8a017829 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:04.022826 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f503e26-1e21-469d-bf94-efbc8a017829 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:04.071291 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16323f-6fd0-46d2-9e57-b1d570bc2d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:04.072125 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16323f-6fd0-46d2-9e57-b1d570bc2d69 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:04.072476 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16323f-6fd0-46d2-9e57-b1d570bc2d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:04.072745 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16323f-6fd0-46d2-9e57-b1d570bc2d69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:04.084425 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16323f-6fd0-46d2-9e57-b1d570bc2d69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:04.086318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16323f-6fd0-46d2-9e57-b1d570bc2d69 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:04.105109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-8a16323f-6fd0-46d2-9e57-b1d570bc2d69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:55:04.105109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:04.105109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:04.105109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:04.105109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:04.105109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:04.105109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:04.105109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:04.105109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:04.105109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:04.105109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:04.105109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:04.105109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:55:04.105109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:55:04.105109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:55:04.106388 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:55:04.106388 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:04.106388 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:04.106388 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:04.106388 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:04.106388 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:04.106388 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:04.106388 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:04.106388 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:55:04.106388 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:04.106388 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:04.106388 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:04.106388 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:04.106388 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:04.106388 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:04.106388 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:04.106388 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:04.107748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:55:04.107748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:55:04.107748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:55:04.107748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:55:04.109437 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 596/1203] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:55:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:55:04.116321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e54320-3b19-47ea-bf12-5bbbc463364f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:04.268729 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e54320-3b19-47ea-bf12-5bbbc463364f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:04.301850 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:04.316713 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a3e5f-3720-47ef-acec-26e63ad1e44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:04.317398 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a3e5f-3720-47ef-acec-26e63ad1e44a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:04.317678 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a3e5f-3720-47ef-acec-26e63ad1e44a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:04.317950 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a3e5f-3720-47ef-acec-26e63ad1e44a None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:04.318673 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a3e5f-3720-47ef-acec-26e63ad1e44a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:04.319515 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a3e5f-3720-47ef-acec-26e63ad1e44a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:04.320939 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a3e5f-3720-47ef-acec-26e63ad1e44a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:04.334490 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 608/1204] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:55:04.340846 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16323f-6fd0-46d2-9e57-b1d570bc2d69 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:04.415794 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:04.473644 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16323f-6fd0-46d2-9e57-b1d570bc2d69 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:04.526499 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a37682-47b3-40d6-aba9-8ec0563ffe63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:04.527243 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a37682-47b3-40d6-aba9-8ec0563ffe63 None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:04.529717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a37682-47b3-40d6-aba9-8ec0563ffe63 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:04.529717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a37682-47b3-40d6-aba9-8ec0563ffe63 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:04.529717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a37682-47b3-40d6-aba9-8ec0563ffe63 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:04.530498 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a37682-47b3-40d6-aba9-8ec0563ffe63 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:04.560748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 597/1205] 10.222.0.24 () {60 vars in 1132 bytes} [Thu May 19 14:55:04 2022] POST /identity/v3/users => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:55:07.109121 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07bec3-bf34-4189-9f31-7c70fb98a139 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:07.109693 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07bec3-bf34-4189-9f31-7c70fb98a139 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:07.109693 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07bec3-bf34-4189-9f31-7c70fb98a139 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:07.111390 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 609/1206] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:55:07.117340 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebeedd-2ab4-4aa7-ac20-f229f563b4c4 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:07.117787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebeedd-2ab4-4aa7-ac20-f229f563b4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:07.117950 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebeedd-2ab4-4aa7-ac20-f229f563b4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:07.137504 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-42ebeedd-2ab4-4aa7-ac20-f229f563b4c4 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:55:07.139165 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-42ebeedd-2ab4-4aa7-ac20-f229f563b4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:55:07.224319 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 598/1207] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:55:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:55:07.253595 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07bec3-bf34-4189-9f31-7c70fb98a139 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:07.388422 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07bec3-bf34-4189-9f31-7c70fb98a139 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:07.434381 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9ac2d-08ea-48ec-85e0-f8b87667030d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:07.435258 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9ac2d-08ea-48ec-85e0-f8b87667030d None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:07.435544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9ac2d-08ea-48ec-85e0-f8b87667030d None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:07.435822 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9ac2d-08ea-48ec-85e0-f8b87667030d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:07.448187 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9ac2d-08ea-48ec-85e0-f8b87667030d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:55:07.457435 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-baf9ac2d-08ea-48ec-85e0-f8b87667030d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:55:07.457435 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:07.457435 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:07.457435 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:07.457435 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:07.457435 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:07.457435 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:07.457435 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:07.457435 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:07.457435 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:07.457435 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:07.457435 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:07.457435 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:55:07.457435 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:55:07.457435 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:55:07.457435 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:55:07.458466 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:55:07.458466 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:55:07.458466 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:55:07.458466 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:55:07.458466 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:07.458466 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:07.458466 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:07.458466 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:07.458466 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:07.458466 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:07.458466 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:07.458466 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:55:07.458466 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:07.458466 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:07.458466 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:07.458466 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:07.463930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:07.463930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:07.463930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:07.463930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:07.463930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:55:07.463930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:55:07.463930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:55:07.463930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:55:07.463930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:55:07.463930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:55:07.463930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:55:07.463930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:55:07.463930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 610/1208] 10.222.0.24 () {56 vars in 1102 bytes} [Thu May 19 14:55:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:55:07.468546 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebeedd-2ab4-4aa7-ac20-f229f563b4c4 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:07.512745 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:07.597657 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebeedd-2ab4-4aa7-ac20-f229f563b4c4 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:07.640898 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d6a9c-9191-473b-a952-fedaa3b323f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:07.641693 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d6a9c-9191-473b-a952-fedaa3b323f4 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:07.641979 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d6a9c-9191-473b-a952-fedaa3b323f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:07.642250 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d6a9c-9191-473b-a952-fedaa3b323f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:07.643165 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d6a9c-9191-473b-a952-fedaa3b323f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:07.643594 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d6a9c-9191-473b-a952-fedaa3b323f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:07.645254 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d6a9c-9191-473b-a952-fedaa3b323f4 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:07.655232 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 599/1209] 10.222.0.24 () {56 vars in 1103 bytes} [Thu May 19 14:55:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:07.661643 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9ac2d-08ea-48ec-85e0-f8b87667030d None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:07.726044 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:07.789834 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9ac2d-08ea-48ec-85e0-f8b87667030d None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:07.830896 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67fbb7-b93c-400c-be3d-b457b3f97cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:07.831858 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67fbb7-b93c-400c-be3d-b457b3f97cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:07.832139 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67fbb7-b93c-400c-be3d-b457b3f97cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:07.832413 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67fbb7-b93c-400c-be3d-b457b3f97cd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:07.845076 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67fbb7-b93c-400c-be3d-b457b3f97cd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:07.846658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67fbb7-b93c-400c-be3d-b457b3f97cd5 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:07.868393 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-af67fbb7-b93c-400c-be3d-b457b3f97cd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:55:07.868393 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:07.868393 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:07.868393 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:07.868393 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:07.868393 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:07.868393 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:07.868393 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:07.868393 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:07.868393 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:07.868393 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:07.868393 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:07.868393 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:55:07.868393 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:55:07.868393 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:55:07.869425 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:55:07.869425 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:07.869425 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:07.869425 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:07.869425 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:07.869425 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:07.869425 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:07.869425 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:07.869425 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:55:07.869425 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:07.869425 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:07.869425 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:07.869425 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:07.869425 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:07.869425 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:07.869425 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:07.869425 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:07.870811 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:55:07.870811 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:55:07.870811 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:55:07.870811 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:55:07.870811 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 611/1210] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:55:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:55:07.875883 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d6a9c-9191-473b-a952-fedaa3b323f4 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:07.983547 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:07.987106 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d6a9c-9191-473b-a952-fedaa3b323f4 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:08.025530 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459113d-06d6-4690-bf0d-49f77c9019a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:08.026196 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459113d-06d6-4690-bf0d-49f77c9019a0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:08.026586 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459113d-06d6-4690-bf0d-49f77c9019a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:08.026978 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459113d-06d6-4690-bf0d-49f77c9019a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:08.028002 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459113d-06d6-4690-bf0d-49f77c9019a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:08.028334 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459113d-06d6-4690-bf0d-49f77c9019a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:08.029826 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459113d-06d6-4690-bf0d-49f77c9019a0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:08.044627 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 600/1211] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:55:08.050604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67fbb7-b93c-400c-be3d-b457b3f97cd5 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:08.157986 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67fbb7-b93c-400c-be3d-b457b3f97cd5 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:08.159752 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:08.198358 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463cbb3a-cdf2-403d-8ac7-f135d2b83e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:08.199169 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463cbb3a-cdf2-403d-8ac7-f135d2b83e8f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:08.199475 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463cbb3a-cdf2-403d-8ac7-f135d2b83e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:08.199757 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463cbb3a-cdf2-403d-8ac7-f135d2b83e8f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:08.207432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463cbb3a-cdf2-403d-8ac7-f135d2b83e8f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:08.208881 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463cbb3a-cdf2-403d-8ac7-f135d2b83e8f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:08.228454 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-463cbb3a-cdf2-403d-8ac7-f135d2b83e8f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 14:55:08.228454 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:08.228454 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:08.228454 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:08.228454 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:08.228454 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:08.228454 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:08.228454 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:08.228454 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:08.228454 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:08.228454 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:08.228454 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:08.228454 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:55:08.228454 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:55:08.228454 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:55:08.228454 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:55:08.231464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:08.231464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:08.231464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:55:08.231464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:55:08.231464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:55:08.231464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:55:08.231464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:08.231464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:08.231464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:08.231464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:08.231464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:08.231464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:55:08.231464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:08.231464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:08.231464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:08.231464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:08.231464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:08.231464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:08.232744 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:08.232744 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:08.232744 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:55:08.232744 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:55:08.232744 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:55:08.232744 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:55:08.232744 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:55:08.232744 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:55:08.232744 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 14:55:08.232744 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:55:08.232744 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 612/1212] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:55:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:55:08.240731 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459113d-06d6-4690-bf0d-49f77c9019a0 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:08.372666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459113d-06d6-4690-bf0d-49f77c9019a0 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:08.409810 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5fae9-0a99-485b-896e-69a9793bf0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:08.410481 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5fae9-0a99-485b-896e-69a9793bf0ac None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:08.410809 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5fae9-0a99-485b-896e-69a9793bf0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:08.411089 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5fae9-0a99-485b-896e-69a9793bf0ac None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:08.412047 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5fae9-0a99-485b-896e-69a9793bf0ac None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:08.412391 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5fae9-0a99-485b-896e-69a9793bf0ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:08.414008 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5fae9-0a99-485b-896e-69a9793bf0ac None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:08.432682 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 601/1213] 10.222.0.24 () {56 vars in 1143 bytes} [Thu May 19 14:55:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:08.438238 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463cbb3a-cdf2-403d-8ac7-f135d2b83e8f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:08.562731 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463cbb3a-cdf2-403d-8ac7-f135d2b83e8f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:08.602376 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833579eb-2100-45bf-a55c-2208618cbf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:08.603033 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833579eb-2100-45bf-a55c-2208618cbf23 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:08.603344 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833579eb-2100-45bf-a55c-2208618cbf23 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:08.603666 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833579eb-2100-45bf-a55c-2208618cbf23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:08.637687 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:08.679614 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833579eb-2100-45bf-a55c-2208618cbf23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:08.681169 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833579eb-2100-45bf-a55c-2208618cbf23 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:08.795751 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 613/1214] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:55:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 14:55:08.801582 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5fae9-0a99-485b-896e-69a9793bf0ac None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:08.824912 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:08.924335 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5fae9-0a99-485b-896e-69a9793bf0ac None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:08.963820 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c886d9f-0955-4be0-9e4f-a8b9f2a55b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:08.964624 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c886d9f-0955-4be0-9e4f-a8b9f2a55b42 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:08.964909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c886d9f-0955-4be0-9e4f-a8b9f2a55b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:08.965193 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c886d9f-0955-4be0-9e4f-a8b9f2a55b42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:08.976760 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c886d9f-0955-4be0-9e4f-a8b9f2a55b42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:08.978375 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c886d9f-0955-4be0-9e4f-a8b9f2a55b42 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:08.998890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-6c886d9f-0955-4be0-9e4f-a8b9f2a55b42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:55:08.998890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:08.998890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:08.998890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:08.998890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:08.998890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:08.998890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:08.998890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:08.998890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:08.998890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:08.998890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:08.998890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:08.998890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:55:08.998890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:55:08.998890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:55:09.000454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:55:09.000454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:09.000454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:09.000454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:09.000454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:09.000454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:09.000454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:09.000454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:09.000454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:55:09.000454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:09.000454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:09.000454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:09.000454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:09.000454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:09.000454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:09.000454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:09.000454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:09.001542 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:55:09.001542 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:55:09.001542 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:55:09.001542 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:55:09.001542 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 602/1215] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:55:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:55:09.007544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833579eb-2100-45bf-a55c-2208618cbf23 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:09.087425 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:09.136289 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833579eb-2100-45bf-a55c-2208618cbf23 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:09.177665 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29826da2-7b31-41a3-ab72-73b8e453465b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:09.178892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29826da2-7b31-41a3-ab72-73b8e453465b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:09.179180 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29826da2-7b31-41a3-ab72-73b8e453465b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:09.179489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29826da2-7b31-41a3-ab72-73b8e453465b None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:09.180272 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29826da2-7b31-41a3-ab72-73b8e453465b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:09.180615 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29826da2-7b31-41a3-ab72-73b8e453465b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:09.182019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29826da2-7b31-41a3-ab72-73b8e453465b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:09.195132 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 614/1216] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:09.200988 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c886d9f-0955-4be0-9e4f-a8b9f2a55b42 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:09.281413 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:09.316755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c886d9f-0955-4be0-9e4f-a8b9f2a55b42 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:09.355564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92eddd0-f335-4ad3-ae0b-c60d8d769708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:09.356284 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92eddd0-f335-4ad3-ae0b-c60d8d769708 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:09.356634 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92eddd0-f335-4ad3-ae0b-c60d8d769708 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:09.356950 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92eddd0-f335-4ad3-ae0b-c60d8d769708 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:09.364369 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92eddd0-f335-4ad3-ae0b-c60d8d769708 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:09.366004 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92eddd0-f335-4ad3-ae0b-c60d8d769708 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:09.381686 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-b92eddd0-f335-4ad3-ae0b-c60d8d769708 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:55:09.381686 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:09.381686 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:09.381686 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:09.381686 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:09.381686 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:09.381686 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:09.381686 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:09.381686 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:09.381686 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:09.381686 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:09.381686 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:09.381686 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:55:09.381686 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:55:09.381686 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:55:09.382654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:55:09.382654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:09.382654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:09.382654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:09.382654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:09.382654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:09.382654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:09.382654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:09.382654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:55:09.382654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:09.382654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:09.382654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:09.382654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:09.382654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:09.382654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:09.382654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:09.382654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:09.383600 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:55:09.383600 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:55:09.383600 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:55:09.383600 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:55:09.383600 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:55:09.383600 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:55:09.383600 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:55:09.383600 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:55:09.388384 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 603/1217] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:55:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:55:09.391421 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29826da2-7b31-41a3-ab72-73b8e453465b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:09.504197 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29826da2-7b31-41a3-ab72-73b8e453465b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:09.531931 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:09.547807 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907ba5a-334c-46a9-bfe7-db1e07d7d706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:09.548532 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907ba5a-334c-46a9-bfe7-db1e07d7d706 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:09.548860 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907ba5a-334c-46a9-bfe7-db1e07d7d706 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:09.549154 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907ba5a-334c-46a9-bfe7-db1e07d7d706 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:09.550080 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907ba5a-334c-46a9-bfe7-db1e07d7d706 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:09.550438 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907ba5a-334c-46a9-bfe7-db1e07d7d706 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:09.552002 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b907ba5a-334c-46a9-bfe7-db1e07d7d706 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:09.568291 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 615/1218] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:55:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:55:09.574691 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92eddd0-f335-4ad3-ae0b-c60d8d769708 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:09.684806 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92eddd0-f335-4ad3-ae0b-c60d8d769708 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:09.716257 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:09.723453 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a18a2-2bcc-4be2-bfb4-5648d1d2ec49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:09.724183 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a18a2-2bcc-4be2-bfb4-5648d1d2ec49 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:09.724509 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a18a2-2bcc-4be2-bfb4-5648d1d2ec49 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:09.724794 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a18a2-2bcc-4be2-bfb4-5648d1d2ec49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:09.725805 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a18a2-2bcc-4be2-bfb4-5648d1d2ec49 None admin] RBAC: Adding query filter params (role.id=4d4ff927beb7409996558ecf7143d419, scope.project.id=2633b53c336145bba3d4744dbdfe99b7, user.id=adec680c4f5f4e6dbe5989d5d7acf620) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:09.726129 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a18a2-2bcc-4be2-bfb4-5648d1d2ec49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:09.727590 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a18a2-2bcc-4be2-bfb4-5648d1d2ec49 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:09.733856 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 604/1219] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:55:09 2022] GET /identity/v3/role_assignments?user.id=adec680c4f5f4e6dbe5989d5d7acf620&scope.project.id=2633b53c336145bba3d4744dbdfe99b7&role.id=4d4ff927beb7409996558ecf7143d419 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:12.079060 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b6ec2-92f9-4266-8f4f-d9c5c9670cb6 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:12.079717 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b6ec2-92f9-4266-8f4f-d9c5c9670cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:12.079717 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b6ec2-92f9-4266-8f4f-d9c5c9670cb6 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:12.080990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 616/1220] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:55:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:55:12.088360 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11e5cd-7165-4047-b9eb-44420f0643eb None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:12.088830 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11e5cd-7165-4047-b9eb-44420f0643eb None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:12.088967 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11e5cd-7165-4047-b9eb-44420f0643eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:12.107225 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ae11e5cd-7165-4047-b9eb-44420f0643eb None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:55:12.108786 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ae11e5cd-7165-4047-b9eb-44420f0643eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:55:12.179584 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 605/1221] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:55:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:55:12.205836 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b6ec2-92f9-4266-8f4f-d9c5c9670cb6 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:12.324251 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b6ec2-92f9-4266-8f4f-d9c5c9670cb6 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:12.363251 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e2098-66d0-4202-91cd-240bffaf4b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:12.363988 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e2098-66d0-4202-91cd-240bffaf4b72 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:12.364270 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e2098-66d0-4202-91cd-240bffaf4b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:12.364543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e2098-66d0-4202-91cd-240bffaf4b72 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:12.376277 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e2098-66d0-4202-91cd-240bffaf4b72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:55:12.385353 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-327e2098-66d0-4202-91cd-240bffaf4b72 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:55:12.385353 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:12.385353 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:12.385353 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:12.385353 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:12.385353 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:12.385353 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:12.385353 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:12.385353 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:12.385353 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:12.385353 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:12.385353 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:12.385353 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:55:12.385353 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:55:12.385353 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:55:12.385353 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:55:12.386488 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:55:12.386488 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:55:12.386488 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:55:12.386488 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:55:12.386488 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:12.386488 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:12.386488 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:12.386488 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:12.386488 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:12.386488 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:12.386488 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:12.386488 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:55:12.386488 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:12.386488 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:12.386488 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:12.386488 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:12.387502 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:12.387502 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:12.387502 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:12.387502 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:12.387502 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:55:12.387502 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:55:12.387502 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:55:12.387502 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:55:12.387502 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:55:12.387502 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:55:12.387502 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:55:12.387502 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:55:12.387502 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 617/1222] 10.222.0.24 () {56 vars in 1102 bytes} [Thu May 19 14:55:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:55:12.393091 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11e5cd-7165-4047-b9eb-44420f0643eb None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:12.499975 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11e5cd-7165-4047-b9eb-44420f0643eb None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:12.527895 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:12.540573 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf092c3-b977-4a65-acf7-4638f367a208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:12.541414 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf092c3-b977-4a65-acf7-4638f367a208 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:12.541539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf092c3-b977-4a65-acf7-4638f367a208 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:12.541807 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf092c3-b977-4a65-acf7-4638f367a208 None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:12.542563 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf092c3-b977-4a65-acf7-4638f367a208 None admin] RBAC: Adding query filter params (name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:12.542878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf092c3-b977-4a65-acf7-4638f367a208 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:12.544295 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf092c3-b977-4a65-acf7-4638f367a208 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:12.555206 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 606/1223] 10.222.0.24 () {56 vars in 1103 bytes} [Thu May 19 14:55:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:12.560996 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e2098-66d0-4202-91cd-240bffaf4b72 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:12.608359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:12.679192 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e2098-66d0-4202-91cd-240bffaf4b72 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:12.714363 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e2fd9-8b5a-4a5b-8af7-ee6b614de2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:12.715241 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e2fd9-8b5a-4a5b-8af7-ee6b614de2e5 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:12.715493 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e2fd9-8b5a-4a5b-8af7-ee6b614de2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:12.715811 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e2fd9-8b5a-4a5b-8af7-ee6b614de2e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:12.727047 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e2fd9-8b5a-4a5b-8af7-ee6b614de2e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:12.728579 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e2fd9-8b5a-4a5b-8af7-ee6b614de2e5 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:12.747721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-ad5e2fd9-8b5a-4a5b-8af7-ee6b614de2e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:55:12.747721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:12.747721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:12.747721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:12.747721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:12.747721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:12.747721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:12.747721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:12.747721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:12.747721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:12.747721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:12.747721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:12.747721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:55:12.747721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:55:12.747721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:55:12.748633 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:55:12.748633 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:12.748633 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:12.748633 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:12.748633 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:12.748633 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:12.748633 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:12.748633 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:12.748633 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:55:12.748633 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:12.748633 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:12.748633 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:12.748633 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:12.748633 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:12.748633 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:12.748633 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:12.748633 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:12.749682 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:55:12.749682 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:55:12.749682 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:55:12.749682 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:55:12.749682 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 618/1224] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:55:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:55:12.754862 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf092c3-b977-4a65-acf7-4638f367a208 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:12.866787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf092c3-b977-4a65-acf7-4638f367a208 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:12.914620 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5192660-e41e-444c-ac9b-c13cddbdcbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:12.915372 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5192660-e41e-444c-ac9b-c13cddbdcbf9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:12.915687 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5192660-e41e-444c-ac9b-c13cddbdcbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:12.915996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5192660-e41e-444c-ac9b-c13cddbdcbf9 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:12.916762 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5192660-e41e-444c-ac9b-c13cddbdcbf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:12.917093 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5192660-e41e-444c-ac9b-c13cddbdcbf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:12.918493 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5192660-e41e-444c-ac9b-c13cddbdcbf9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:12.931671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 607/1225] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:12.937158 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e2fd9-8b5a-4a5b-8af7-ee6b614de2e5 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:13.042052 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:13.052157 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e2fd9-8b5a-4a5b-8af7-ee6b614de2e5 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:13.090765 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8b7a9-2c98-4243-bb6b-3a9b56b0d4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:13.091603 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8b7a9-2c98-4243-bb6b-3a9b56b0d4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:13.091928 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8b7a9-2c98-4243-bb6b-3a9b56b0d4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:13.092226 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8b7a9-2c98-4243-bb6b-3a9b56b0d4c0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:13.100443 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8b7a9-2c98-4243-bb6b-3a9b56b0d4c0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:13.102542 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8b7a9-2c98-4243-bb6b-3a9b56b0d4c0 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:13.118397 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-d1e8b7a9-2c98-4243-bb6b-3a9b56b0d4c0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 14:55:13.118397 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:13.118397 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:13.118397 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:13.118397 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:13.118397 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:13.118397 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:13.118397 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:13.118397 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:13.118397 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:13.118397 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:13.118397 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:13.118397 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:55:13.118397 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:55:13.118397 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:55:13.118397 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:55:13.119724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:13.119724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:13.119724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:55:13.119724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:55:13.119724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:55:13.119724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:55:13.119724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:13.119724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:13.119724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:13.119724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:13.119724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:13.119724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:55:13.119724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:13.119724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:13.119724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:13.119724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:13.119724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:13.119724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:13.120681 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:13.120681 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:13.120681 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:55:13.120681 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:55:13.120681 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:55:13.120681 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:55:13.120681 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:55:13.120681 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:55:13.120681 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 14:55:13.120681 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:55:13.120681 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 619/1226] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:55:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:55:13.125649 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5192660-e41e-444c-ac9b-c13cddbdcbf9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:13.176739 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:13.239452 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5192660-e41e-444c-ac9b-c13cddbdcbf9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:13.275897 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd001155-276e-468a-8a8d-dfd4aede3eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:13.276575 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd001155-276e-468a-8a8d-dfd4aede3eae None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:13.276867 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd001155-276e-468a-8a8d-dfd4aede3eae None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:13.277150 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd001155-276e-468a-8a8d-dfd4aede3eae None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:13.277989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd001155-276e-468a-8a8d-dfd4aede3eae None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:13.278334 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd001155-276e-468a-8a8d-dfd4aede3eae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:13.279822 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd001155-276e-468a-8a8d-dfd4aede3eae None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:13.298171 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 608/1227] 10.222.0.24 () {56 vars in 1143 bytes} [Thu May 19 14:55:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:13.303780 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8b7a9-2c98-4243-bb6b-3a9b56b0d4c0 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:13.430180 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8b7a9-2c98-4243-bb6b-3a9b56b0d4c0 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:13.466091 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4060d-e0f7-46ca-9b0b-0e5e5a8e0d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:13.466924 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4060d-e0f7-46ca-9b0b-0e5e5a8e0d07 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:13.467321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4060d-e0f7-46ca-9b0b-0e5e5a8e0d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:13.467592 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4060d-e0f7-46ca-9b0b-0e5e5a8e0d07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:13.479249 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4060d-e0f7-46ca-9b0b-0e5e5a8e0d07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:13.480713 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4060d-e0f7-46ca-9b0b-0e5e5a8e0d07 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:13.500255 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-68b4060d-e0f7-46ca-9b0b-0e5e5a8e0d07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:55:13.500255 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:13.500255 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:13.500255 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:13.500255 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:13.500255 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:13.500255 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:13.500255 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:13.500255 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:13.500255 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:13.500255 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:13.500255 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:13.500255 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:55:13.500255 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:55:13.500255 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:55:13.501459 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:55:13.501459 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:13.501459 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:13.501459 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:13.501459 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:13.501459 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:13.501459 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:13.501459 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:13.501459 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:55:13.501459 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:13.501459 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:13.501459 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:13.501459 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:13.501459 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:13.501459 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:13.501459 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:13.501459 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:13.502525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:55:13.502525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:55:13.502525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:55:13.502525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:55:13.502525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 620/1228] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:55:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:55:13.507821 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd001155-276e-468a-8a8d-dfd4aede3eae None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:13.612057 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd001155-276e-468a-8a8d-dfd4aede3eae None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:13.614789 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:13.651063 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283208a-d8cb-4486-9be8-8a5aae01881c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:13.651791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283208a-d8cb-4486-9be8-8a5aae01881c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:13.652078 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283208a-d8cb-4486-9be8-8a5aae01881c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:13.652353 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283208a-d8cb-4486-9be8-8a5aae01881c None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:13.653120 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9283208a-d8cb-4486-9be8-8a5aae01881c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:13.653427 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9283208a-d8cb-4486-9be8-8a5aae01881c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:13.654843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9283208a-d8cb-4486-9be8-8a5aae01881c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:13.668067 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 609/1229] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:55:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:13.672607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4060d-e0f7-46ca-9b0b-0e5e5a8e0d07 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:13.682140 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:13.789461 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4060d-e0f7-46ca-9b0b-0e5e5a8e0d07 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:13.829366 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92137116-fca6-4f7f-969b-ebd064d43ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:13.830201 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92137116-fca6-4f7f-969b-ebd064d43ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:13.830465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92137116-fca6-4f7f-969b-ebd064d43ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:13.830739 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92137116-fca6-4f7f-969b-ebd064d43ae1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:13.839660 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92137116-fca6-4f7f-969b-ebd064d43ae1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:13.841247 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92137116-fca6-4f7f-969b-ebd064d43ae1 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:13.856419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-92137116-fca6-4f7f-969b-ebd064d43ae1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:55:13.856419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:13.856419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:13.856419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:13.856419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:13.856419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:13.856419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:13.856419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:13.856419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:13.856419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:13.856419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:13.856419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:13.856419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:55:13.856419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:55:13.856419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:55:13.857577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:55:13.857577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:13.857577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:13.857577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:13.857577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:13.857577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:13.857577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:13.857577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:13.857577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:55:13.857577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:13.857577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:13.857577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:13.857577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:13.857577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:13.857577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:13.857577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:13.857577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:13.863256 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:55:13.863256 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:55:13.863256 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:55:13.863256 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:55:13.863256 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:55:13.863256 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:55:13.863256 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:55:13.863256 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:55:13.863256 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 621/1230] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:55:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:55:13.863774 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283208a-d8cb-4486-9be8-8a5aae01881c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:13.977399 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283208a-d8cb-4486-9be8-8a5aae01881c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:14.021053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a91587-d1d5-492b-9b24-5509c762ab91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:14.022002 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a91587-d1d5-492b-9b24-5509c762ab91 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:14.022309 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a91587-d1d5-492b-9b24-5509c762ab91 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:14.022748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a91587-d1d5-492b-9b24-5509c762ab91 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:14.024267 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a91587-d1d5-492b-9b24-5509c762ab91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:14.024755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a91587-d1d5-492b-9b24-5509c762ab91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:14.026830 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a91587-d1d5-492b-9b24-5509c762ab91 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:14.048971 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 610/1231] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:55:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:14.050553 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92137116-fca6-4f7f-969b-ebd064d43ae1 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:14.134892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:14.173320 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92137116-fca6-4f7f-969b-ebd064d43ae1 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:14.208173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bae75a-0a3e-439c-983c-a9168d0091db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:14.209051 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bae75a-0a3e-439c-983c-a9168d0091db None admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:14.209327 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bae75a-0a3e-439c-983c-a9168d0091db None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:14.209596 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bae75a-0a3e-439c-983c-a9168d0091db None admin] PATH_INFO: `/v3/projects/2633b53c336145bba3d4744dbdfe99b7/users/adec680c4f5f4e6dbe5989d5d7acf620/roles/4d4ff927beb7409996558ecf7143d419` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:14.225219 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bae75a-0a3e-439c-983c-a9168d0091db None admin] RBAC: Authorizing `identity:create_grant(project_id=2633b53c336145bba3d4744dbdfe99b7, user_id=adec680c4f5f4e6dbe5989d5d7acf620, role_id=4d4ff927beb7409996558ecf7143d419)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:14.226839 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bae75a-0a3e-439c-983c-a9168d0091db None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:14.239541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 622/1232] 10.222.0.24 () {58 vars in 1439 bytes} [Thu May 19 14:55:14 2022] PUT /identity/v3/projects/2633b53c336145bba3d4744dbdfe99b7/users/adec680c4f5f4e6dbe5989d5d7acf620/roles/4d4ff927beb7409996558ecf7143d419 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:55:16.510285 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd0599-d964-4b04-a741-ebce167ce8b4 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:16.510833 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd0599-d964-4b04-a741-ebce167ce8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:16.510983 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd0599-d964-4b04-a741-ebce167ce8b4 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:16.512531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 611/1233] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:55:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:55:16.518330 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d8fbd-dd70-4be3-9499-4d62eaa38556 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:16.518804 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d8fbd-dd70-4be3-9499-4d62eaa38556 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:16.518900 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d8fbd-dd70-4be3-9499-4d62eaa38556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:16.535846 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-1d3d8fbd-dd70-4be3-9499-4d62eaa38556 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:55:16.537030 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1d3d8fbd-dd70-4be3-9499-4d62eaa38556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:55:16.611305 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 623/1234] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:55:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 19 14:55:16.637578 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd0599-d964-4b04-a741-ebce167ce8b4 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:16.666650 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:16.753009 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd0599-d964-4b04-a741-ebce167ce8b4 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:16.791933 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392f500-4900-4bbd-b266-7bd060323c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:16.792755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392f500-4900-4bbd-b266-7bd060323c95 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:16.793087 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392f500-4900-4bbd-b266-7bd060323c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:16.793323 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392f500-4900-4bbd-b266-7bd060323c95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:16.806933 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392f500-4900-4bbd-b266-7bd060323c95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:55:16.815068 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-5392f500-4900-4bbd-b266-7bd060323c95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 19 14:55:16.815068 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:16.815068 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:16.815068 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:16.815068 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:16.815068 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:16.815068 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:16.815068 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:16.815068 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:16.815068 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:16.815068 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:16.815068 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:16.815068 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:55:16.815068 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:55:16.815068 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:55:16.815068 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:55:16.816564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:55:16.816564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:55:16.816564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:55:16.816564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:55:16.816564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:16.816564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:16.816564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:16.816564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:16.816564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:16.816564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:16.816564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:16.816564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:55:16.816564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:16.816564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:16.816564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:16.816564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:16.818049 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:16.818049 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:16.818049 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:16.818049 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:16.818049 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:55:16.818049 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:55:16.818049 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:55:16.818049 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:55:16.818049 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:55:16.818049 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:55:16.818049 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 19 14:55:16.818049 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:55:16.818049 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 612/1235] 10.222.0.24 () {56 vars in 1102 bytes} [Thu May 19 14:55:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:55:16.823054 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d8fbd-dd70-4be3-9499-4d62eaa38556 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:16.877582 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:16.934621 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d8fbd-dd70-4be3-9499-4d62eaa38556 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:16.975468 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b695b-33bc-48f5-ac27-9134f3e9b198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:16.976148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b695b-33bc-48f5-ac27-9134f3e9b198 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:16.976433 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b695b-33bc-48f5-ac27-9134f3e9b198 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:16.976712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b695b-33bc-48f5-ac27-9134f3e9b198 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:16.977471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b695b-33bc-48f5-ac27-9134f3e9b198 None admin] RBAC: Adding query filter params (name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:16.977774 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b695b-33bc-48f5-ac27-9134f3e9b198 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:16.979140 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89b695b-33bc-48f5-ac27-9134f3e9b198 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:16.987601 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 624/1236] 10.222.0.24 () {56 vars in 1103 bytes} [Thu May 19 14:55:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:16.994300 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392f500-4900-4bbd-b266-7bd060323c95 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:17.084631 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:17.101460 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392f500-4900-4bbd-b266-7bd060323c95 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:17.141641 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22747b8-0a87-4ebe-947a-53fa11b57d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:17.142512 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22747b8-0a87-4ebe-947a-53fa11b57d94 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:17.142806 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22747b8-0a87-4ebe-947a-53fa11b57d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:17.143091 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22747b8-0a87-4ebe-947a-53fa11b57d94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:17.156804 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22747b8-0a87-4ebe-947a-53fa11b57d94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:17.158316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22747b8-0a87-4ebe-947a-53fa11b57d94 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:17.176273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-d22747b8-0a87-4ebe-947a-53fa11b57d94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:55:17.176273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:17.176273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:17.176273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:17.176273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:17.176273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:17.176273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:17.176273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:17.176273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:17.176273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:17.176273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:17.176273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:17.176273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:55:17.176273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:55:17.176273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:55:17.177434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:55:17.177434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:17.177434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:17.177434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:17.177434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:17.177434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:17.177434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:17.177434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:17.177434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:55:17.177434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:17.177434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:17.177434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:17.177434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:17.177434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:17.177434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:17.177434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:17.177434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:17.178392 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:55:17.178392 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:55:17.178392 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:55:17.178392 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:55:17.178392 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 613/1237] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:55:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 19 14:55:17.184287 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b695b-33bc-48f5-ac27-9134f3e9b198 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:17.287090 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b695b-33bc-48f5-ac27-9134f3e9b198 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:17.296415 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:17.323025 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb263e-b44d-42be-917e-8aad09ae3932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:17.323724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb263e-b44d-42be-917e-8aad09ae3932 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:17.324005 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb263e-b44d-42be-917e-8aad09ae3932 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:17.324279 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb263e-b44d-42be-917e-8aad09ae3932 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:17.325031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb263e-b44d-42be-917e-8aad09ae3932 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:17.325337 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb263e-b44d-42be-917e-8aad09ae3932 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:17.326875 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb263e-b44d-42be-917e-8aad09ae3932 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:17.340263 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 625/1238] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:17.346059 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22747b8-0a87-4ebe-947a-53fa11b57d94 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:17.463436 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22747b8-0a87-4ebe-947a-53fa11b57d94 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:17.502964 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fea76-7b71-4564-8a9a-04fd381844e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:17.504013 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fea76-7b71-4564-8a9a-04fd381844e9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:17.504475 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fea76-7b71-4564-8a9a-04fd381844e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:17.504745 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fea76-7b71-4564-8a9a-04fd381844e9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:17.508538 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:17.514129 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fea76-7b71-4564-8a9a-04fd381844e9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:17.515976 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fea76-7b71-4564-8a9a-04fd381844e9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:17.533108 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-322fea76-7b71-4564-8a9a-04fd381844e9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 14:55:17.533108 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:17.533108 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:17.533108 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:17.533108 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:17.533108 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:17.533108 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:17.533108 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:17.533108 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:17.533108 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:17.533108 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:17.533108 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:17.533108 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:55:17.533108 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:55:17.533108 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:55:17.533108 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:55:17.534530 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:17.534530 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:17.534530 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:55:17.534530 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:55:17.534530 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:55:17.534530 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:55:17.534530 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:17.534530 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:17.534530 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:17.534530 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:17.534530 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:17.534530 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:55:17.534530 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:17.534530 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:17.534530 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:17.534530 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:17.534530 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:17.534530 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:17.535587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:17.535587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:17.535587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:55:17.535587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:55:17.535587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:55:17.535587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:55:17.535587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:55:17.535587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:55:17.535587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 14:55:17.535587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:55:17.535587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 614/1239] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:55:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:55:17.540787 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb263e-b44d-42be-917e-8aad09ae3932 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:17.651884 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb263e-b44d-42be-917e-8aad09ae3932 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:17.689462 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab19f96-fffb-41e7-8521-07751e6cde00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:17.690347 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab19f96-fffb-41e7-8521-07751e6cde00 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:17.690703 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab19f96-fffb-41e7-8521-07751e6cde00 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:17.691017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab19f96-fffb-41e7-8521-07751e6cde00 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:17.692115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab19f96-fffb-41e7-8521-07751e6cde00 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:17.692510 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab19f96-fffb-41e7-8521-07751e6cde00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:17.694634 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab19f96-fffb-41e7-8521-07751e6cde00 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:17.714087 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 626/1240] 10.222.0.24 () {56 vars in 1143 bytes} [Thu May 19 14:55:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:17.720079 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fea76-7b71-4564-8a9a-04fd381844e9 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:17.836597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fea76-7b71-4564-8a9a-04fd381844e9 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:17.878240 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f74de-b349-4049-aedc-dd4abd5316ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:17.878896 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f74de-b349-4049-aedc-dd4abd5316ef None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:17.879187 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f74de-b349-4049-aedc-dd4abd5316ef None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:17.879501 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f74de-b349-4049-aedc-dd4abd5316ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:17.948160 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:17.955045 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f74de-b349-4049-aedc-dd4abd5316ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:17.956563 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f74de-b349-4049-aedc-dd4abd5316ef None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:18.066070 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 615/1241] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:55:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:55:18.071959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab19f96-fffb-41e7-8521-07751e6cde00 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:18.101157 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:18.179263 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab19f96-fffb-41e7-8521-07751e6cde00 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:18.217314 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19f668-5646-4076-960e-601325e34b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:18.218112 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19f668-5646-4076-960e-601325e34b98 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:18.218397 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19f668-5646-4076-960e-601325e34b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:18.218668 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19f668-5646-4076-960e-601325e34b98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:18.229604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19f668-5646-4076-960e-601325e34b98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:18.231293 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a19f668-5646-4076-960e-601325e34b98 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:18.249461 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-0a19f668-5646-4076-960e-601325e34b98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:55:18.249461 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:18.249461 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:18.249461 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:18.249461 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:18.249461 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:18.249461 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:18.249461 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:18.249461 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:18.249461 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:18.249461 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:18.249461 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:18.249461 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:55:18.249461 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:55:18.249461 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:55:18.250607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:55:18.250607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:18.250607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:18.250607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:18.250607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:18.250607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:18.250607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:18.250607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:18.250607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:55:18.250607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:18.250607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:18.250607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:18.250607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:18.250607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:18.250607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:18.250607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:18.250607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:18.251524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:55:18.251524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:55:18.251524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:55:18.251524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:55:18.251524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 627/1242] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:55:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:55:18.256480 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f74de-b349-4049-aedc-dd4abd5316ef None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:18.368229 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:18.375805 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f74de-b349-4049-aedc-dd4abd5316ef None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:18.414534 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d0b7b-f6db-4438-83c2-aa4beefe5edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:18.415314 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d0b7b-f6db-4438-83c2-aa4beefe5edf None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:18.415600 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d0b7b-f6db-4438-83c2-aa4beefe5edf None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:18.415883 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d0b7b-f6db-4438-83c2-aa4beefe5edf None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:18.416614 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d0b7b-f6db-4438-83c2-aa4beefe5edf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:18.416925 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d0b7b-f6db-4438-83c2-aa4beefe5edf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:18.418335 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d0b7b-f6db-4438-83c2-aa4beefe5edf None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:18.431098 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 616/1243] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:18.436917 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19f668-5646-4076-960e-601325e34b98 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:18.523684 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:18.551591 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19f668-5646-4076-960e-601325e34b98 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:18.590756 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f104ce2-c46f-4e09-b37e-4bde7dd3247f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:18.591585 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f104ce2-c46f-4e09-b37e-4bde7dd3247f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:18.591865 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f104ce2-c46f-4e09-b37e-4bde7dd3247f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:18.592160 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f104ce2-c46f-4e09-b37e-4bde7dd3247f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:18.601239 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f104ce2-c46f-4e09-b37e-4bde7dd3247f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:18.602693 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f104ce2-c46f-4e09-b37e-4bde7dd3247f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:18.619445 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-3f104ce2-c46f-4e09-b37e-4bde7dd3247f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:55:18.619445 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:18.619445 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:18.619445 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:18.619445 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:18.619445 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:18.619445 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:18.619445 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:18.619445 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:18.619445 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:18.619445 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:18.619445 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:18.619445 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:55:18.619445 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:55:18.619445 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:55:18.620711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:55:18.620711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:18.620711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:18.620711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:18.620711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:18.620711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:18.620711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:18.620711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:18.620711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:55:18.620711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:18.620711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:18.620711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:18.620711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:18.620711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:18.620711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:18.620711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:18.620711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:18.621811 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:55:18.621811 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:55:18.621811 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:55:18.621811 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:55:18.621811 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:55:18.621811 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:55:18.621811 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:55:18.621811 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:55:18.621811 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 628/1244] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:55:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:55:18.626133 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d0b7b-f6db-4438-83c2-aa4beefe5edf None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:18.728320 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d0b7b-f6db-4438-83c2-aa4beefe5edf None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:18.763604 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d4e5e-229c-481f-9972-e9b4d3f9b380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:18.764258 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d4e5e-229c-481f-9972-e9b4d3f9b380 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:18.764545 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d4e5e-229c-481f-9972-e9b4d3f9b380 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:18.764822 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d4e5e-229c-481f-9972-e9b4d3f9b380 None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:18.765682 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d4e5e-229c-481f-9972-e9b4d3f9b380 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:18.765999 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d4e5e-229c-481f-9972-e9b4d3f9b380 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:18.767457 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d4e5e-229c-481f-9972-e9b4d3f9b380 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:18.780524 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 617/1245] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:55:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:55:18.787802 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f104ce2-c46f-4e09-b37e-4bde7dd3247f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:18.902092 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f104ce2-c46f-4e09-b37e-4bde7dd3247f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:18.937831 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1e9d4-6690-44a6-bb8e-d0f698581480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:18.938518 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1e9d4-6690-44a6-bb8e-d0f698581480 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:18.938802 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1e9d4-6690-44a6-bb8e-d0f698581480 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:18.939076 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1e9d4-6690-44a6-bb8e-d0f698581480 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:18.939943 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf1e9d4-6690-44a6-bb8e-d0f698581480 None admin] RBAC: Adding query filter params (role.id=4d4ff927beb7409996558ecf7143d419, scope.project.id=2633b53c336145bba3d4744dbdfe99b7, user.id=adec680c4f5f4e6dbe5989d5d7acf620) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:18.940257 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf1e9d4-6690-44a6-bb8e-d0f698581480 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:18.941682 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf1e9d4-6690-44a6-bb8e-d0f698581480 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:18.948169 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 629/1246] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:55:18 2022] GET /identity/v3/role_assignments?user.id=adec680c4f5f4e6dbe5989d5d7acf620&scope.project.id=2633b53c336145bba3d4744dbdfe99b7&role.id=4d4ff927beb7409996558ecf7143d419 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:21.501563 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b907e9-4a12-47ee-b14c-add16fbb8f35 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:21.502148 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b907e9-4a12-47ee-b14c-add16fbb8f35 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:21.502148 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b907e9-4a12-47ee-b14c-add16fbb8f35 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:21.503660 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 618/1247] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:55:21.509053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743e372-9523-4a73-8936-8f8a1266c395 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:21.509487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743e372-9523-4a73-8936-8f8a1266c395 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:21.509639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743e372-9523-4a73-8936-8f8a1266c395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:21.515309 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:21.529919 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e743e372-9523-4a73-8936-8f8a1266c395 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:55:21.531089 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e743e372-9523-4a73-8936-8f8a1266c395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:55:21.607253 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 630/1248] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:55:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:55:21.631164 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b907e9-4a12-47ee-b14c-add16fbb8f35 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:21.650326 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:21.742407 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b907e9-4a12-47ee-b14c-add16fbb8f35 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:21.784261 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce78ef-a1e6-4917-8852-415e9279e174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:21.785387 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce78ef-a1e6-4917-8852-415e9279e174 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:21.785785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce78ef-a1e6-4917-8852-415e9279e174 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:21.786123 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce78ef-a1e6-4917-8852-415e9279e174 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:21.797874 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce78ef-a1e6-4917-8852-415e9279e174 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:55:21.806665 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-1bce78ef-a1e6-4917-8852-415e9279e174 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:55:21.806665 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:21.806665 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:21.806665 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:21.806665 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:21.806665 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:21.806665 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:21.806665 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:21.806665 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:21.806665 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:21.806665 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:21.806665 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:21.806665 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:55:21.806665 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:55:21.806665 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:55:21.806665 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:55:21.807872 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:55:21.807872 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:55:21.807872 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:55:21.807872 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:55:21.807872 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:21.807872 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:21.807872 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:21.807872 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:21.807872 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:21.807872 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:21.807872 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:21.807872 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:55:21.807872 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:21.807872 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:21.807872 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:21.807872 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:21.808890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:21.808890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:21.808890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:21.808890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:21.808890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:55:21.808890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:55:21.808890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:55:21.808890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:55:21.808890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:55:21.808890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:55:21.808890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:55:21.808890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:55:21.808890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 619/1249] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:55:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:55:21.813992 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743e372-9523-4a73-8936-8f8a1266c395 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:21.926665 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743e372-9523-4a73-8936-8f8a1266c395 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:21.963257 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:21.969707 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175801d-634d-4a9a-af52-6fe15e0352cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:21.970539 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175801d-634d-4a9a-af52-6fe15e0352cb None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:21.970826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175801d-634d-4a9a-af52-6fe15e0352cb None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:21.971189 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175801d-634d-4a9a-af52-6fe15e0352cb None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:21.972091 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175801d-634d-4a9a-af52-6fe15e0352cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:21.972433 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175801d-634d-4a9a-af52-6fe15e0352cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:21.974340 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175801d-634d-4a9a-af52-6fe15e0352cb None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:21.985054 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 631/1250] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:55:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:21.991776 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce78ef-a1e6-4917-8852-415e9279e174 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:22.097675 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:22.127612 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce78ef-a1e6-4917-8852-415e9279e174 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:22.163116 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d53e99-6750-439d-a8fe-cf189e8ed4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:22.163972 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d53e99-6750-439d-a8fe-cf189e8ed4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:22.164256 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d53e99-6750-439d-a8fe-cf189e8ed4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:22.164537 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d53e99-6750-439d-a8fe-cf189e8ed4e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:22.176521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d53e99-6750-439d-a8fe-cf189e8ed4e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:22.178631 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d53e99-6750-439d-a8fe-cf189e8ed4e7 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:22.197286 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-41d53e99-6750-439d-a8fe-cf189e8ed4e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:55:22.197286 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:22.197286 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:22.197286 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:22.197286 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:22.197286 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:22.197286 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:22.197286 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:22.197286 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:22.197286 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:22.197286 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:22.197286 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:22.197286 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:55:22.197286 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:55:22.197286 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:55:22.198436 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:55:22.198436 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:22.198436 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:22.198436 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:22.198436 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:22.198436 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:22.198436 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:22.198436 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:22.198436 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:55:22.198436 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:22.198436 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:22.198436 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:22.198436 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:22.198436 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:22.198436 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:22.198436 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:22.198436 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:22.199414 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:55:22.199414 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:55:22.199414 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:55:22.199414 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:55:22.199414 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 620/1251] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:55:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:55:22.204754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175801d-634d-4a9a-af52-6fe15e0352cb None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:22.308525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175801d-634d-4a9a-af52-6fe15e0352cb None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:22.344674 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dce15b-2841-4570-99ba-3075fb46643a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:22.345344 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dce15b-2841-4570-99ba-3075fb46643a None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:22.345623 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dce15b-2841-4570-99ba-3075fb46643a None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:22.345895 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dce15b-2841-4570-99ba-3075fb46643a None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:22.346618 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dce15b-2841-4570-99ba-3075fb46643a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:22.346919 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dce15b-2841-4570-99ba-3075fb46643a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:22.348322 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dce15b-2841-4570-99ba-3075fb46643a None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:22.366539 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 632/1252] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:55:22.368512 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d53e99-6750-439d-a8fe-cf189e8ed4e7 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:22.476512 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d53e99-6750-439d-a8fe-cf189e8ed4e7 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:22.502822 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:22.511285 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f763530-5eae-414b-ba30-4d2c13a77884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:22.512098 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f763530-5eae-414b-ba30-4d2c13a77884 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:22.512386 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f763530-5eae-414b-ba30-4d2c13a77884 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:22.512666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f763530-5eae-414b-ba30-4d2c13a77884 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:22.520223 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f763530-5eae-414b-ba30-4d2c13a77884 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:22.521677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f763530-5eae-414b-ba30-4d2c13a77884 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:22.536152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-9f763530-5eae-414b-ba30-4d2c13a77884 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 14:55:22.536152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:22.536152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:22.536152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:22.536152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:22.536152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:22.536152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:22.536152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:22.536152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:22.536152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:22.536152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:22.536152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:22.536152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:55:22.536152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:55:22.536152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:55:22.536152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:55:22.537672 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:22.537672 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:22.537672 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:55:22.537672 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:55:22.537672 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:55:22.537672 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:55:22.537672 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:22.537672 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:22.537672 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:22.537672 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:22.537672 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:22.537672 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:55:22.537672 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:22.537672 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:22.537672 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:22.537672 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:22.537672 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:22.537672 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:22.538617 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:22.538617 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:22.538617 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:55:22.538617 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:55:22.538617 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:55:22.538617 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:55:22.538617 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:55:22.538617 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:55:22.538617 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 14:55:22.538617 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:55:22.539481 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 621/1253] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:55:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:55:22.544117 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dce15b-2841-4570-99ba-3075fb46643a None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:22.600460 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:22.648284 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dce15b-2841-4570-99ba-3075fb46643a None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:22.682755 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca927a-e52e-4043-a9ac-c2383f2a601f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:22.683466 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca927a-e52e-4043-a9ac-c2383f2a601f None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:22.683750 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca927a-e52e-4043-a9ac-c2383f2a601f None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:22.684031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca927a-e52e-4043-a9ac-c2383f2a601f None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:22.684878 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca927a-e52e-4043-a9ac-c2383f2a601f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:22.685191 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca927a-e52e-4043-a9ac-c2383f2a601f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:22.686610 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca927a-e52e-4043-a9ac-c2383f2a601f None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:22.703814 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 633/1254] 10.222.0.24 () {56 vars in 1143 bytes} [Thu May 19 14:55:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:22.709675 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f763530-5eae-414b-ba30-4d2c13a77884 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:22.815023 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f763530-5eae-414b-ba30-4d2c13a77884 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:22.846777 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198eb0b2-a6af-4363-b630-890726798227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:22.847443 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198eb0b2-a6af-4363-b630-890726798227 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:22.847731 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198eb0b2-a6af-4363-b630-890726798227 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:22.848009 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198eb0b2-a6af-4363-b630-890726798227 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:22.900563 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:22.913036 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198eb0b2-a6af-4363-b630-890726798227 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:22.914478 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198eb0b2-a6af-4363-b630-890726798227 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:23.007510 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 622/1255] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:55:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 19 14:55:23.013356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca927a-e52e-4043-a9ac-c2383f2a601f None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:23.127241 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca927a-e52e-4043-a9ac-c2383f2a601f None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:23.140326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:23.161150 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a7f14-6e60-471d-8528-6f8146b731f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:23.162041 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a7f14-6e60-471d-8528-6f8146b731f7 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:23.162322 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a7f14-6e60-471d-8528-6f8146b731f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:23.162597 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a7f14-6e60-471d-8528-6f8146b731f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:23.172287 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a7f14-6e60-471d-8528-6f8146b731f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:23.173717 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a7f14-6e60-471d-8528-6f8146b731f7 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:23.190691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-110a7f14-6e60-471d-8528-6f8146b731f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:55:23.190691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:23.190691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:23.190691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:23.190691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:23.190691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:23.190691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:23.190691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:23.190691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:23.190691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:23.190691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:23.190691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:23.190691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:55:23.190691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:55:23.190691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:55:23.191754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:55:23.191754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:23.191754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:23.191754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:23.191754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:23.191754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:23.191754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:23.191754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:23.191754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:55:23.191754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:23.191754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:23.191754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:23.191754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:23.191754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:23.191754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:23.191754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:23.191754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:23.193438 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:55:23.193438 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:55:23.193438 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:55:23.193438 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:55:23.193438 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 634/1256] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:55:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:55:23.198038 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198eb0b2-a6af-4363-b630-890726798227 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:23.281287 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:23.293238 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198eb0b2-a6af-4363-b630-890726798227 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:23.328940 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ed89c-c8f7-478c-a432-d15ea1f71d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:23.329898 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ed89c-c8f7-478c-a432-d15ea1f71d5c None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:23.330316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ed89c-c8f7-478c-a432-d15ea1f71d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:23.330722 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ed89c-c8f7-478c-a432-d15ea1f71d5c None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:23.332000 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ed89c-c8f7-478c-a432-d15ea1f71d5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:23.332464 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ed89c-c8f7-478c-a432-d15ea1f71d5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:23.335282 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ed89c-c8f7-478c-a432-d15ea1f71d5c None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:23.350467 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 623/1257] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:23.357430 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a7f14-6e60-471d-8528-6f8146b731f7 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:23.455502 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a7f14-6e60-471d-8528-6f8146b731f7 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:23.488965 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37893fea-fb68-4c4a-aae3-119ac9f0d5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:23.489740 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37893fea-fb68-4c4a-aae3-119ac9f0d5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:23.490551 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37893fea-fb68-4c4a-aae3-119ac9f0d5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:23.490823 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37893fea-fb68-4c4a-aae3-119ac9f0d5f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:23.497598 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37893fea-fb68-4c4a-aae3-119ac9f0d5f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:23.499037 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37893fea-fb68-4c4a-aae3-119ac9f0d5f2 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:23.513984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-37893fea-fb68-4c4a-aae3-119ac9f0d5f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:55:23.513984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:23.513984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:23.513984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:23.513984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:23.513984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:23.513984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:23.513984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:23.513984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:23.513984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:23.513984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:23.513984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:23.513984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:55:23.513984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:55:23.513984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:55:23.515031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:55:23.515031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:23.515031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:23.515031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:23.515031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:23.515031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:23.515031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:23.515031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:23.515031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:55:23.515031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:23.515031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:23.515031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:23.515031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:23.515031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:23.515031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:23.515031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:23.515031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:23.516150 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:55:23.516150 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:55:23.516150 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:55:23.516150 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:55:23.516150 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:55:23.516150 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:55:23.516150 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:55:23.516150 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:55:23.516150 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 635/1258] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:55:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:55:23.520925 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ed89c-c8f7-478c-a432-d15ea1f71d5c None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:23.617100 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ed89c-c8f7-478c-a432-d15ea1f71d5c None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:23.655444 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a4f66-a429-482e-bd09-5d6963d5233b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:23.656107 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a4f66-a429-482e-bd09-5d6963d5233b None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:23.656432 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a4f66-a429-482e-bd09-5d6963d5233b None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:23.656682 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a4f66-a429-482e-bd09-5d6963d5233b None admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:23.657469 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a4f66-a429-482e-bd09-5d6963d5233b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:23.657785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a4f66-a429-482e-bd09-5d6963d5233b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:23.659258 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a4f66-a429-482e-bd09-5d6963d5233b None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:23.671098 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 624/1259] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:55:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:23.677189 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37893fea-fb68-4c4a-aae3-119ac9f0d5f2 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:23.703304 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:23.775102 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37893fea-fb68-4c4a-aae3-119ac9f0d5f2 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:23.807709 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3a083-f255-4560-8077-6cb58cfcfd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:23.808355 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3a083-f255-4560-8077-6cb58cfcfd63 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:23.808637 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3a083-f255-4560-8077-6cb58cfcfd63 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:23.808914 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3a083-f255-4560-8077-6cb58cfcfd63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:23.809734 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3a083-f255-4560-8077-6cb58cfcfd63 None admin] RBAC: Adding query filter params (role.id=ec4b73b709ca4cdc983e35e955aed57a, scope.project.id=2633b53c336145bba3d4744dbdfe99b7, user.id=adec680c4f5f4e6dbe5989d5d7acf620) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:23.810043 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3a083-f255-4560-8077-6cb58cfcfd63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:23.811485 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3a083-f255-4560-8077-6cb58cfcfd63 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:23.816712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 636/1260] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:55:23 2022] GET /identity/v3/role_assignments?user.id=adec680c4f5f4e6dbe5989d5d7acf620&scope.project.id=2633b53c336145bba3d4744dbdfe99b7&role.id=ec4b73b709ca4cdc983e35e955aed57a => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:26.047406 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303b514-4eb3-4573-a78d-9a61111d05df None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:26.047956 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303b514-4eb3-4573-a78d-9a61111d05df None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:26.048052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303b514-4eb3-4573-a78d-9a61111d05df None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:26.049528 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 625/1261] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:55:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:55:26.056197 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82ff1d-2b32-44aa-982f-c3c74ca59774 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:26.056602 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82ff1d-2b32-44aa-982f-c3c74ca59774 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:26.056747 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82ff1d-2b32-44aa-982f-c3c74ca59774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:26.078723 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-cf82ff1d-2b32-44aa-982f-c3c74ca59774 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:55:26.080377 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-cf82ff1d-2b32-44aa-982f-c3c74ca59774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:55:26.156327 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 637/1262] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:55:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:55:26.179771 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303b514-4eb3-4573-a78d-9a61111d05df None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:26.190286 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:26.277826 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303b514-4eb3-4573-a78d-9a61111d05df None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:26.310687 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651b771-1d0c-49ef-96fc-725dd8da9c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:26.311447 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651b771-1d0c-49ef-96fc-725dd8da9c17 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:26.311739 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651b771-1d0c-49ef-96fc-725dd8da9c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:26.312019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651b771-1d0c-49ef-96fc-725dd8da9c17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:26.322830 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651b771-1d0c-49ef-96fc-725dd8da9c17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:55:26.330469 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-8651b771-1d0c-49ef-96fc-725dd8da9c17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:55:26.330469 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:26.330469 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:26.330469 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:26.330469 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:26.330469 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:26.330469 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:26.330469 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:26.330469 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:26.330469 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:26.330469 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:26.330469 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:26.330469 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:55:26.330469 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:55:26.330469 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:55:26.330469 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:55:26.331616 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:55:26.331616 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:55:26.331616 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:55:26.331616 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:55:26.331616 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:26.331616 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:26.331616 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:26.331616 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:26.331616 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:26.331616 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:26.331616 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:26.331616 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:55:26.331616 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:26.331616 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:26.331616 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:26.331616 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:26.332762 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:26.332762 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:26.332762 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:26.332762 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:26.332762 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:55:26.332762 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:55:26.332762 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:55:26.332762 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:55:26.332762 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:55:26.332762 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:55:26.332762 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:55:26.332762 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:55:26.332762 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 626/1263] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:55:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:55:26.337604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82ff1d-2b32-44aa-982f-c3c74ca59774 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:26.355761 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:26.432731 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82ff1d-2b32-44aa-982f-c3c74ca59774 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:26.464183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591e408-b08e-4028-8b5d-005b3f426251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:26.464826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591e408-b08e-4028-8b5d-005b3f426251 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:26.465104 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591e408-b08e-4028-8b5d-005b3f426251 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:26.465373 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591e408-b08e-4028-8b5d-005b3f426251 None admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:26.466101 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591e408-b08e-4028-8b5d-005b3f426251 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:26.466400 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591e408-b08e-4028-8b5d-005b3f426251 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:26.467779 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591e408-b08e-4028-8b5d-005b3f426251 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:26.475999 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 638/1264] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:55:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:26.481773 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651b771-1d0c-49ef-96fc-725dd8da9c17 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:26.547353 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:26.580021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651b771-1d0c-49ef-96fc-725dd8da9c17 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:26.612854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531958c-3283-4fe3-bf4a-a8d74804fe65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:26.613667 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531958c-3283-4fe3-bf4a-a8d74804fe65 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:26.613954 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531958c-3283-4fe3-bf4a-a8d74804fe65 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:26.614235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531958c-3283-4fe3-bf4a-a8d74804fe65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:26.624699 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531958c-3283-4fe3-bf4a-a8d74804fe65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:26.626141 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531958c-3283-4fe3-bf4a-a8d74804fe65 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:26.642751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-6531958c-3283-4fe3-bf4a-a8d74804fe65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:55:26.642751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:26.642751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:26.642751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:26.642751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:26.642751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:26.642751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:26.642751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:26.642751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:26.642751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:26.642751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:26.642751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:26.642751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:55:26.642751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:55:26.642751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:55:26.643793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:55:26.643793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:26.643793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:26.643793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:26.643793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:26.643793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:26.643793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:26.643793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:26.643793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:55:26.643793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:26.643793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:26.643793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:26.643793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:26.643793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:26.643793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:26.643793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:26.643793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:26.645021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:55:26.645021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:55:26.645021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:55:26.645021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:55:26.645021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 627/1265] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:55:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:55:26.650191 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591e408-b08e-4028-8b5d-005b3f426251 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:26.727526 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:26.746462 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591e408-b08e-4028-8b5d-005b3f426251 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:26.778329 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb37cf-24c4-4664-9dc6-45e451a91bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:26.778971 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb37cf-24c4-4664-9dc6-45e451a91bab None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:26.779277 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb37cf-24c4-4664-9dc6-45e451a91bab None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:26.779554 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb37cf-24c4-4664-9dc6-45e451a91bab None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:26.780267 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb37cf-24c4-4664-9dc6-45e451a91bab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:26.780573 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb37cf-24c4-4664-9dc6-45e451a91bab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:26.781917 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb37cf-24c4-4664-9dc6-45e451a91bab None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:26.793836 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 639/1266] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:26.799259 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531958c-3283-4fe3-bf4a-a8d74804fe65 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:26.896817 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531958c-3283-4fe3-bf4a-a8d74804fe65 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:26.915365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:26.928995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd113cc-1c50-459c-9b13-2efcbc062e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:26.929785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd113cc-1c50-459c-9b13-2efcbc062e47 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:26.930067 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd113cc-1c50-459c-9b13-2efcbc062e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:26.930341 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd113cc-1c50-459c-9b13-2efcbc062e47 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:26.937822 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd113cc-1c50-459c-9b13-2efcbc062e47 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:26.939286 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd113cc-1c50-459c-9b13-2efcbc062e47 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:26.953632 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-7bd113cc-1c50-459c-9b13-2efcbc062e47 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 14:55:26.953632 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:26.953632 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:26.953632 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:26.953632 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:26.953632 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:26.953632 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:26.953632 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:26.953632 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:26.953632 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:26.953632 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:26.953632 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:26.953632 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:55:26.953632 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:55:26.953632 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:55:26.953632 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:55:26.954554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:26.954554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:26.954554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:55:26.954554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:55:26.954554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:55:26.954554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:55:26.954554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:26.954554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:26.954554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:26.954554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:26.954554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:26.954554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:55:26.954554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:26.954554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:26.954554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:26.954554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:26.954554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:26.954554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:26.955788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:26.955788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:26.955788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:55:26.955788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:55:26.955788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:55:26.955788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:55:26.955788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:55:26.955788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:55:26.955788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 14:55:26.955788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:55:26.955788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 628/1267] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:55:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:55:26.961057 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb37cf-24c4-4664-9dc6-45e451a91bab None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:27.064829 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb37cf-24c4-4664-9dc6-45e451a91bab None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:27.098236 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00b533-bf77-45fe-ac6a-ca52798c35e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:27.098896 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00b533-bf77-45fe-ac6a-ca52798c35e1 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:27.099237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00b533-bf77-45fe-ac6a-ca52798c35e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:27.099525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00b533-bf77-45fe-ac6a-ca52798c35e1 None admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:27.100357 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00b533-bf77-45fe-ac6a-ca52798c35e1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:27.100665 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00b533-bf77-45fe-ac6a-ca52798c35e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:27.102080 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00b533-bf77-45fe-ac6a-ca52798c35e1 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:27.110388 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:27.119969 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 640/1268] 10.222.0.24 () {56 vars in 1143 bytes} [Thu May 19 14:55:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:27.125693 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd113cc-1c50-459c-9b13-2efcbc062e47 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:27.223268 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd113cc-1c50-459c-9b13-2efcbc062e47 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:27.255168 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a126c1d-1383-4685-8012-139891032f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:27.256499 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a126c1d-1383-4685-8012-139891032f24 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:27.256781 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a126c1d-1383-4685-8012-139891032f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:27.257052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a126c1d-1383-4685-8012-139891032f24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:27.267047 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a126c1d-1383-4685-8012-139891032f24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:27.268505 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a126c1d-1383-4685-8012-139891032f24 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:27.284788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-5a126c1d-1383-4685-8012-139891032f24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:55:27.284788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:27.284788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:27.284788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:27.284788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:27.284788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:27.284788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:27.284788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:27.284788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:27.284788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:27.284788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:27.284788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:27.284788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:55:27.284788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:55:27.284788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:55:27.285814 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:55:27.285814 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:27.285814 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:27.285814 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:27.285814 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:27.285814 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:27.285814 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:27.285814 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:27.285814 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:55:27.285814 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:27.285814 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:27.285814 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:27.285814 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:27.285814 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:27.285814 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:27.285814 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:27.285814 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:27.286720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:55:27.286720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:55:27.286720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:55:27.286720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:55:27.286720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 629/1269] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:55:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:55:27.291605 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00b533-bf77-45fe-ac6a-ca52798c35e1 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:27.387804 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00b533-bf77-45fe-ac6a-ca52798c35e1 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:27.419284 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fab60-a426-4180-af0a-b6eda9e2db27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:27.419928 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fab60-a426-4180-af0a-b6eda9e2db27 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:27.420204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fab60-a426-4180-af0a-b6eda9e2db27 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:27.420471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fab60-a426-4180-af0a-b6eda9e2db27 None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:27.421179 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818fab60-a426-4180-af0a-b6eda9e2db27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:27.421478 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818fab60-a426-4180-af0a-b6eda9e2db27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:27.422820 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818fab60-a426-4180-af0a-b6eda9e2db27 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:27.433971 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 641/1270] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:55:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:27.439620 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a126c1d-1383-4685-8012-139891032f24 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:27.470309 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:27.538777 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a126c1d-1383-4685-8012-139891032f24 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:27.571046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5004ff-b74f-45f7-ae99-bae4538bd89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:27.571849 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5004ff-b74f-45f7-ae99-bae4538bd89e None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:27.572129 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5004ff-b74f-45f7-ae99-bae4538bd89e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:27.572401 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5004ff-b74f-45f7-ae99-bae4538bd89e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:27.578707 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5004ff-b74f-45f7-ae99-bae4538bd89e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:27.580166 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5004ff-b74f-45f7-ae99-bae4538bd89e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:27.593850 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-5c5004ff-b74f-45f7-ae99-bae4538bd89e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:55:27.593850 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:27.593850 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:27.593850 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:27.593850 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:27.593850 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:27.593850 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:27.593850 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:27.593850 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:27.593850 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:27.593850 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:27.593850 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:27.593850 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:55:27.593850 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:55:27.593850 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:55:27.594909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:55:27.594909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:27.594909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:27.594909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:27.594909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:27.594909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:27.594909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:27.594909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:27.594909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:55:27.594909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:27.594909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:27.594909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:27.594909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:27.594909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:27.594909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:27.594909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:27.594909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:27.596127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:55:27.596127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:55:27.596127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:55:27.596127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:55:27.596127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:55:27.596127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:55:27.596127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:55:27.596127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:55:27.596127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 630/1271] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:55:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:55:27.601265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fab60-a426-4180-af0a-b6eda9e2db27 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:27.657892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:27.703514 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fab60-a426-4180-af0a-b6eda9e2db27 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:27.736141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eae9e0-5152-45a6-bce9-9958917f1cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:27.736789 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eae9e0-5152-45a6-bce9-9958917f1cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:27.737069 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eae9e0-5152-45a6-bce9-9958917f1cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:27.737341 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eae9e0-5152-45a6-bce9-9958917f1cb9 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:27.738117 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eae9e0-5152-45a6-bce9-9958917f1cb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:27.738425 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eae9e0-5152-45a6-bce9-9958917f1cb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:27.740470 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eae9e0-5152-45a6-bce9-9958917f1cb9 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:27.752282 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 642/1272] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:55:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:27.758152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5004ff-b74f-45f7-ae99-bae4538bd89e None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:27.844375 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:27.853637 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5004ff-b74f-45f7-ae99-bae4538bd89e None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:27.886571 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf57b78-9f9c-480b-8b01-c666009162fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:27.887481 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf57b78-9f9c-480b-8b01-c666009162fc None admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:27.887769 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf57b78-9f9c-480b-8b01-c666009162fc None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:27.888047 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf57b78-9f9c-480b-8b01-c666009162fc None admin] PATH_INFO: `/v3/projects/2633b53c336145bba3d4744dbdfe99b7/users/adec680c4f5f4e6dbe5989d5d7acf620/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:27.889983 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf57b78-9f9c-480b-8b01-c666009162fc None admin] RBAC: Authorizing `identity:create_grant(project_id=2633b53c336145bba3d4744dbdfe99b7, user_id=adec680c4f5f4e6dbe5989d5d7acf620, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:27.891451 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf57b78-9f9c-480b-8b01-c666009162fc None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:27.903475 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 631/1273] 10.222.0.24 () {58 vars in 1439 bytes} [Thu May 19 14:55:27 2022] PUT /identity/v3/projects/2633b53c336145bba3d4744dbdfe99b7/users/adec680c4f5f4e6dbe5989d5d7acf620/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 14:55:30.108157 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ca70c-3726-4532-8209-4068f8c06c98 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:30.108714 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ca70c-3726-4532-8209-4068f8c06c98 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:30.108714 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ca70c-3726-4532-8209-4068f8c06c98 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:30.110063 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 643/1274] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:55:30.115247 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adb2c2-f01c-4611-a080-3e5388637fda None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:30.115633 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adb2c2-f01c-4611-a080-3e5388637fda None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:30.115821 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5adb2c2-f01c-4611-a080-3e5388637fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:30.133228 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e5adb2c2-f01c-4611-a080-3e5388637fda None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:55:30.135031 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e5adb2c2-f01c-4611-a080-3e5388637fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:55:30.203209 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 632/1275] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:55:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:55:30.226675 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ca70c-3726-4532-8209-4068f8c06c98 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:30.324722 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ca70c-3726-4532-8209-4068f8c06c98 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:30.341448 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:30.358528 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdcceb9-4d87-432a-930a-c8006927a9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:30.359282 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcceb9-4d87-432a-930a-c8006927a9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:30.359569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcceb9-4d87-432a-930a-c8006927a9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:30.359845 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcceb9-4d87-432a-930a-c8006927a9f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:30.370740 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdcceb9-4d87-432a-930a-c8006927a9f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 19 14:55:30.378334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-7fdcceb9-4d87-432a-930a-c8006927a9f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:55:30.378334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:30.378334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:30.378334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:30.378334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:30.378334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:30.378334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:30.378334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:30.378334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:30.378334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:30.378334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:30.378334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:30.378334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 19 14:55:30.378334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(role_id) May 19 14:55:30.378334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 19 14:55:30.378334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 19 14:55:30.379487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 19 14:55:30.379487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 19 14:55:30.379487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 19 14:55:30.379487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 19 14:55:30.379487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:30.379487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:30.379487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:30.379487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:30.379487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:30.379487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:30.379487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:30.379487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:55:30.379487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:30.379487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:30.379487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:30.379487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:30.381326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:30.381326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:30.381326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:30.381326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:30.381326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 19 14:55:30.381326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 19 14:55:30.381326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 19 14:55:30.381326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 19 14:55:30.381326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 19 14:55:30.381326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 19 14:55:30.381326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 19 14:55:30.381326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:55:30.381326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 644/1276] 10.222.0.24 () {56 vars in 1096 bytes} [Thu May 19 14:55:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:55:30.385973 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5adb2c2-f01c-4611-a080-3e5388637fda None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:30.463636 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:30.481239 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5adb2c2-f01c-4611-a080-3e5388637fda None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:30.514016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b27ef-72e6-4804-a2d8-a625329f083a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:30.514671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b27ef-72e6-4804-a2d8-a625329f083a None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:30.514955 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b27ef-72e6-4804-a2d8-a625329f083a None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:30.515249 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b27ef-72e6-4804-a2d8-a625329f083a None admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:30.515986 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b27ef-72e6-4804-a2d8-a625329f083a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:30.516289 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b27ef-72e6-4804-a2d8-a625329f083a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:30.517655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b27ef-72e6-4804-a2d8-a625329f083a None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:30.525349 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 633/1277] 10.222.0.24 () {56 vars in 1099 bytes} [Thu May 19 14:55:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:30.530861 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdcceb9-4d87-432a-930a-c8006927a9f1 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:30.628072 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdcceb9-4d87-432a-930a-c8006927a9f1 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:30.659781 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75234835-8da8-425e-9fc1-e7e3bf074d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:30.660554 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75234835-8da8-425e-9fc1-e7e3bf074d9c None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:30.660833 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75234835-8da8-425e-9fc1-e7e3bf074d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:30.661106 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75234835-8da8-425e-9fc1-e7e3bf074d9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:30.671963 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75234835-8da8-425e-9fc1-e7e3bf074d9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:30.673394 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75234835-8da8-425e-9fc1-e7e3bf074d9c None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:30.690432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-75234835-8da8-425e-9fc1-e7e3bf074d9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:55:30.690432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:30.690432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:30.690432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:30.690432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:30.690432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:30.690432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:30.690432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:30.690432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:30.690432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:30.690432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:30.690432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:30.690432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:55:30.690432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:55:30.690432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:55:30.691524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:55:30.691524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:30.691524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:30.691524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:30.691524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:30.691524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:30.691524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:30.691524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:30.691524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:55:30.691524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:30.691524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:30.691524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:30.691524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:30.691524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:30.691524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:30.691524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:30.691524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:30.692800 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:55:30.692800 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:55:30.692800 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:55:30.692800 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:55:30.692800 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 645/1278] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:55:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:55:30.697242 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b27ef-72e6-4804-a2d8-a625329f083a None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:30.791247 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b27ef-72e6-4804-a2d8-a625329f083a None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:30.822674 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee99a1-2317-4abb-8f84-f8cf8d683af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:30.823345 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee99a1-2317-4abb-8f84-f8cf8d683af0 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:30.823630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee99a1-2317-4abb-8f84-f8cf8d683af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:30.823906 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee99a1-2317-4abb-8f84-f8cf8d683af0 None admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:30.824610 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee99a1-2317-4abb-8f84-f8cf8d683af0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:30.824918 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee99a1-2317-4abb-8f84-f8cf8d683af0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:30.826265 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee99a1-2317-4abb-8f84-f8cf8d683af0 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:30.837318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 634/1279] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:55:30.842525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75234835-8da8-425e-9fc1-e7e3bf074d9c None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:30.873166 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:30.939968 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75234835-8da8-425e-9fc1-e7e3bf074d9c None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:30.971038 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2bce6f-efb5-4fa3-894a-346dcb835906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:30.971840 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bce6f-efb5-4fa3-894a-346dcb835906 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:30.972122 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bce6f-efb5-4fa3-894a-346dcb835906 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:30.972393 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bce6f-efb5-4fa3-894a-346dcb835906 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:30.980014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2bce6f-efb5-4fa3-894a-346dcb835906 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:30.981446 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2bce6f-efb5-4fa3-894a-346dcb835906 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:30.996207 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-ab2bce6f-efb5-4fa3-894a-346dcb835906 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 19 14:55:30.996207 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:30.996207 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:30.996207 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:30.996207 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:30.996207 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:30.996207 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:30.996207 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:30.996207 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:30.996207 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:30.996207 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:30.996207 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:30.996207 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 19 14:55:30.996207 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_user(user_id) May 19 14:55:30.996207 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 19 14:55:30.996207 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 19 14:55:30.997290 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:30.997290 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:30.997290 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 19 14:55:30.997290 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:55:30.997290 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 19 14:55:30.997290 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 19 14:55:30.997290 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:30.997290 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:30.997290 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:30.997290 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:30.997290 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:30.997290 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:55:30.997290 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:30.997290 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:30.997290 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:30.997290 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:30.997290 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:30.997290 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:30.998476 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:30.998476 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:30.998476 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 19 14:55:30.998476 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 19 14:55:30.998476 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 19 14:55:30.998476 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 19 14:55:30.998476 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 19 14:55:30.998476 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 19 14:55:30.998476 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 19 14:55:30.998476 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:55:30.998476 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 646/1280] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:55:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:55:31.003097 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee99a1-2317-4abb-8f84-f8cf8d683af0 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:31.006807 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:31.115316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee99a1-2317-4abb-8f84-f8cf8d683af0 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:31.147871 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a08dd-9e1e-49ae-a17d-b2eed92ab951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:31.148527 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a08dd-9e1e-49ae-a17d-b2eed92ab951 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:31.148808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a08dd-9e1e-49ae-a17d-b2eed92ab951 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:31.149079 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a08dd-9e1e-49ae-a17d-b2eed92ab951 None admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:31.149903 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a08dd-9e1e-49ae-a17d-b2eed92ab951 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:31.150211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a08dd-9e1e-49ae-a17d-b2eed92ab951 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:31.151654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a08dd-9e1e-49ae-a17d-b2eed92ab951 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:31.168458 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 635/1281] 10.222.0.24 () {56 vars in 1143 bytes} [Thu May 19 14:55:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:31.174172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2bce6f-efb5-4fa3-894a-346dcb835906 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:31.261155 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:31.270542 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2bce6f-efb5-4fa3-894a-346dcb835906 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:31.302995 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46629eb2-8d86-472b-bdb2-0d67c72f685e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:31.303649 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46629eb2-8d86-472b-bdb2-0d67c72f685e None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:31.303930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46629eb2-8d86-472b-bdb2-0d67c72f685e None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:31.304203 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46629eb2-8d86-472b-bdb2-0d67c72f685e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:31.368750 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46629eb2-8d86-472b-bdb2-0d67c72f685e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:31.370184 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46629eb2-8d86-472b-bdb2-0d67c72f685e None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:31.464535 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:31.474860 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 647/1282] 10.222.0.24 () {58 vars in 1282 bytes} [Thu May 19 14:55:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 19 14:55:31.480589 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a08dd-9e1e-49ae-a17d-b2eed92ab951 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:31.539872 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:31.578421 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a08dd-9e1e-49ae-a17d-b2eed92ab951 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:31.610894 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68173078-900a-4364-b867-15e77bbc53bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:31.611710 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68173078-900a-4364-b867-15e77bbc53bb None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:31.611998 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68173078-900a-4364-b867-15e77bbc53bb None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:31.612279 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68173078-900a-4364-b867-15e77bbc53bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:31.622232 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68173078-900a-4364-b867-15e77bbc53bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:31.623716 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68173078-900a-4364-b867-15e77bbc53bb None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:31.640996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-68173078-900a-4364-b867-15e77bbc53bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:55:31.640996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:31.640996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:31.640996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:31.640996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:31.640996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:31.640996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:31.640996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:31.640996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:31.640996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:31.640996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:31.640996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:31.640996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 19 14:55:31.640996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 19 14:55:31.640996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 19 14:55:31.642033 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 19 14:55:31.642033 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:31.642033 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:31.642033 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:31.642033 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:31.642033 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:31.642033 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:31.642033 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:31.642033 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:55:31.642033 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:31.642033 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:31.642033 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:31.642033 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:31.642033 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:31.642033 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:31.642033 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:31.642033 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:31.643137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 19 14:55:31.643137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 19 14:55:31.643137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 19 14:55:31.643137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:55:31.643137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 636/1283] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:55:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:55:31.648364 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46629eb2-8d86-472b-bdb2-0d67c72f685e None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:31.745303 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46629eb2-8d86-472b-bdb2-0d67c72f685e None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:31.778456 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddb160-41a6-4899-97b1-7c57d6a28b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:31.779109 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddb160-41a6-4899-97b1-7c57d6a28b7b None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:31.779416 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddb160-41a6-4899-97b1-7c57d6a28b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:31.779692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddb160-41a6-4899-97b1-7c57d6a28b7b None admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:31.780408 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ddb160-41a6-4899-97b1-7c57d6a28b7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:31.780712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ddb160-41a6-4899-97b1-7c57d6a28b7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:31.782072 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ddb160-41a6-4899-97b1-7c57d6a28b7b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:31.792863 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 648/1284] 10.222.0.24 () {56 vars in 1109 bytes} [Thu May 19 14:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:31.798524 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68173078-900a-4364-b867-15e77bbc53bb None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:31.894673 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68173078-900a-4364-b867-15e77bbc53bb None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:31.908735 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:31.928782 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36add593-efe0-4e4e-ba5a-141619a8d5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:31.929556 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36add593-efe0-4e4e-ba5a-141619a8d5a3 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:31.929841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36add593-efe0-4e4e-ba5a-141619a8d5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:31.930117 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36add593-efe0-4e4e-ba5a-141619a8d5a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:31.936507 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36add593-efe0-4e4e-ba5a-141619a8d5a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:31.938041 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36add593-efe0-4e4e-ba5a-141619a8d5a3 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:31.952426 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application [None req-36add593-efe0-4e4e-ba5a-141619a8d5a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:55:31.952426 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:31.952426 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:31.952426 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:31.952426 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:31.952426 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:31.952426 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:31.952426 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:31.952426 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:31.952426 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:31.952426 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:31.952426 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:31.952426 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 19 14:55:31.952426 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(project_id) May 19 14:55:31.952426 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 19 14:55:31.953457 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 19 14:55:31.953457 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:31.953457 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:31.953457 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:31.953457 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:31.953457 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:31.953457 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:31.953457 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:31.953457 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application with Lock( May 19 14:55:31.953457 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:31.953457 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:31.953457 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:31.953457 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:31.953457 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:31.953457 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:31.953457 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:31.953457 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:31.954725 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 19 14:55:31.954725 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 19 14:55:31.954725 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 19 14:55:31.954725 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 19 14:55:31.954725 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 19 14:55:31.954725 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 19 14:55:31.954725 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 19 14:55:31.954725 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: ERROR keystone.server.flask.application May 19 14:55:31.954725 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 637/1285] 10.222.0.24 () {56 vars in 1111 bytes} [Thu May 19 14:55:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:55:31.959260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddb160-41a6-4899-97b1-7c57d6a28b7b None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:32.008213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:32.060964 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddb160-41a6-4899-97b1-7c57d6a28b7b None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:32.093722 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee38887-fa14-4226-baef-c38455926bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:32.094376 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee38887-fa14-4226-baef-c38455926bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:32.094658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee38887-fa14-4226-baef-c38455926bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:32.094932 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee38887-fa14-4226-baef-c38455926bd3 None admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:32.095738 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee38887-fa14-4226-baef-c38455926bd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:32.096048 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee38887-fa14-4226-baef-c38455926bd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:32.097497 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee38887-fa14-4226-baef-c38455926bd3 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:32.109522 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 649/1286] 10.222.0.24 () {56 vars in 1148 bytes} [Thu May 19 14:55:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 14:55:32.117331 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36add593-efe0-4e4e-ba5a-141619a8d5a3 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:32.218031 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36add593-efe0-4e4e-ba5a-141619a8d5a3 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:32.251148 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c59e2-e5b2-4a6b-9437-7e2205f5c9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:32.251821 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c59e2-e5b2-4a6b-9437-7e2205f5c9e9 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:32.252106 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c59e2-e5b2-4a6b-9437-7e2205f5c9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:32.252378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c59e2-e5b2-4a6b-9437-7e2205f5c9e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:32.253189 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c59e2-e5b2-4a6b-9437-7e2205f5c9e9 None admin] RBAC: Adding query filter params (role.id=ec4b73b709ca4cdc983e35e955aed57a, scope.project.id=2633b53c336145bba3d4744dbdfe99b7, user.id=adec680c4f5f4e6dbe5989d5d7acf620) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:32.253499 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c59e2-e5b2-4a6b-9437-7e2205f5c9e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:32.254907 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c59e2-e5b2-4a6b-9437-7e2205f5c9e9 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:32.260590 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 638/1287] 10.222.0.24 () {56 vars in 1374 bytes} [Thu May 19 14:55:32 2022] GET /identity/v3/role_assignments?user.id=adec680c4f5f4e6dbe5989d5d7acf620&scope.project.id=2633b53c336145bba3d4744dbdfe99b7&role.id=ec4b73b709ca4cdc983e35e955aed57a => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:34.483792 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34515543-d6f8-4d63-8186-71a1ae6cddc9 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:34.484339 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34515543-d6f8-4d63-8186-71a1ae6cddc9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:34.484339 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34515543-d6f8-4d63-8186-71a1ae6cddc9 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:34.485696 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 650/1288] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:55:34.490891 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1d3da-88b6-4fc7-89d5-25a4bc975049 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:34.491342 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1d3da-88b6-4fc7-89d5-25a4bc975049 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:34.491477 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1d3da-88b6-4fc7-89d5-25a4bc975049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:34.508508 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-68e1d3da-88b6-4fc7-89d5-25a4bc975049 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:55:34.509685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-68e1d3da-88b6-4fc7-89d5-25a4bc975049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:55:34.538085 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:34.573854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 639/1289] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:55:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:55:34.596116 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34515543-d6f8-4d63-8186-71a1ae6cddc9 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:34.693055 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34515543-d6f8-4d63-8186-71a1ae6cddc9 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:34.703120 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:34.726171 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f67cd2-739f-4520-97fa-3edb5b8ff407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:34.726950 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f67cd2-739f-4520-97fa-3edb5b8ff407 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:34.727258 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f67cd2-739f-4520-97fa-3edb5b8ff407 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:34.727531 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f67cd2-739f-4520-97fa-3edb5b8ff407 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:34.728171 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f67cd2-739f-4520-97fa-3edb5b8ff407 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:34.729518 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f67cd2-739f-4520-97fa-3edb5b8ff407 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:34.741490 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-e1f67cd2-739f-4520-97fa-3edb5b8ff407 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:55:34.741490 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:34.741490 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:55:34.741490 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:55:34.741490 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:55:34.741490 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:55:34.741490 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:55:34.741490 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:55:34.741490 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:55:34.741490 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:55:34.741490 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:55:34.741490 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:55:34.741490 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:34.741490 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:34.741490 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:34.741490 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:34.741490 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:34.742676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:34.742676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:34.742676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:34.742676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:34.742676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:34.742676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:34.742676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:55:34.742676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:55:34.742676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:55:34.742676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:55:34.742676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:34.742676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:34.742676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:34.742676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:34.742676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:34.742676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:34.743865 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:34.743865 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:55:34.743865 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:34.743865 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:34.743865 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:34.743865 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:34.743865 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:34.743865 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:34.743865 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:34.743865 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:34.743865 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:55:34.743865 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:55:34.743865 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:55:34.743865 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:55:34.743865 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 651/1290] 10.222.0.24 () {56 vars in 1117 bytes} [Thu May 19 14:55:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:55:34.749091 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1d3da-88b6-4fc7-89d5-25a4bc975049 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:34.844435 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1d3da-88b6-4fc7-89d5-25a4bc975049 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:34.877590 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37f3e4-21df-47cf-8c92-63e7f894f4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:34.878245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37f3e4-21df-47cf-8c92-63e7f894f4f5 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:34.878530 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37f3e4-21df-47cf-8c92-63e7f894f4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:34.878808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37f3e4-21df-47cf-8c92-63e7f894f4f5 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:34.879539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37f3e4-21df-47cf-8c92-63e7f894f4f5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:34.879850 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37f3e4-21df-47cf-8c92-63e7f894f4f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:34.881226 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37f3e4-21df-47cf-8c92-63e7f894f4f5 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:34.885925 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 640/1291] 10.222.0.24 () {56 vars in 1116 bytes} [Thu May 19 14:55:34 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:34.891407 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f67cd2-739f-4520-97fa-3edb5b8ff407 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:34.986038 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f67cd2-739f-4520-97fa-3edb5b8ff407 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:35.017803 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14c76d-9bda-4183-a871-d35f6111dac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:35.018448 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14c76d-9bda-4183-a871-d35f6111dac4 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:35.018753 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14c76d-9bda-4183-a871-d35f6111dac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:35.018967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14c76d-9bda-4183-a871-d35f6111dac4 None admin] PATH_INFO: `/v3/services` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:35.019865 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee14c76d-9bda-4183-a871-d35f6111dac4 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:35.020324 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee14c76d-9bda-4183-a871-d35f6111dac4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:35.022359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee14c76d-9bda-4183-a871-d35f6111dac4 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:35.028171 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 652/1292] 10.222.0.24 () {56 vars in 1116 bytes} [Thu May 19 14:55:34 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:37.230976 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533b88b-271f-413b-8464-d0d3f102cdc2 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:37.231545 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533b88b-271f-413b-8464-d0d3f102cdc2 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:37.231545 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533b88b-271f-413b-8464-d0d3f102cdc2 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:37.232943 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 641/1293] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:55:37.238229 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12500fb-1426-42ed-b773-f78ff62644b5 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:37.238629 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12500fb-1426-42ed-b773-f78ff62644b5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:37.238792 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12500fb-1426-42ed-b773-f78ff62644b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:37.256525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e12500fb-1426-42ed-b773-f78ff62644b5 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:55:37.257701 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e12500fb-1426-42ed-b773-f78ff62644b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:55:37.287003 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:37.323284 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 653/1294] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:55:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:55:37.347726 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533b88b-271f-413b-8464-d0d3f102cdc2 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:37.378550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:37.447509 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533b88b-271f-413b-8464-d0d3f102cdc2 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:37.480089 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a4a0e-286f-4897-91b3-deb74f4f028e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:37.480744 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a4a0e-286f-4897-91b3-deb74f4f028e None admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:37.481078 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a4a0e-286f-4897-91b3-deb74f4f028e None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:37.481310 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a4a0e-286f-4897-91b3-deb74f4f028e None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:37.482045 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a4a0e-286f-4897-91b3-deb74f4f028e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:37.483437 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a4a0e-286f-4897-91b3-deb74f4f028e None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:37.496119 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 642/1295] 10.222.0.24 () {60 vars in 1141 bytes} [Thu May 19 14:55:37 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:55:39.754264 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e025dd-6982-40c8-be47-c53a4c239328 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:39.754832 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e025dd-6982-40c8-be47-c53a4c239328 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:39.754832 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e025dd-6982-40c8-be47-c53a4c239328 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:39.756271 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 654/1296] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:55:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:55:39.761556 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41375387-a0d9-44b7-819c-56982f4b8a90 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:39.761985 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41375387-a0d9-44b7-819c-56982f4b8a90 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:39.762133 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41375387-a0d9-44b7-819c-56982f4b8a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:39.778370 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-41375387-a0d9-44b7-819c-56982f4b8a90 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:55:39.779589 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-41375387-a0d9-44b7-819c-56982f4b8a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:55:39.849671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 643/1297] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:55:39 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:55:39.872617 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e025dd-6982-40c8-be47-c53a4c239328 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:39.967752 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e025dd-6982-40c8-be47-c53a4c239328 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:40.000659 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330d646-2574-4b2a-b560-ef45f3e621bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:40.001436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330d646-2574-4b2a-b560-ef45f3e621bd None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:40.001719 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330d646-2574-4b2a-b560-ef45f3e621bd None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:40.001992 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330d646-2574-4b2a-b560-ef45f3e621bd None admin] PATH_INFO: `/v3/services/placement` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:40.002637 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f330d646-2574-4b2a-b560-ef45f3e621bd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:40.004008 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f330d646-2574-4b2a-b560-ef45f3e621bd None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:40.015606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-f330d646-2574-4b2a-b560-ef45f3e621bd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:55:40.015606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:40.015606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:55:40.015606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:55:40.015606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:55:40.015606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:55:40.015606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:55:40.015606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:55:40.015606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:55:40.015606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:55:40.015606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:55:40.015606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:55:40.015606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:40.015606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:40.015606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:40.015606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:40.015606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:40.021908 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:40.021908 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:40.021908 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:40.021908 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:40.021908 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:40.021908 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:40.021908 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:55:40.021908 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:55:40.021908 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:55:40.021908 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:55:40.021908 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:40.021908 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:40.021908 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:40.021908 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:40.021908 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:40.021908 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:40.023027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:40.023027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:55:40.023027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:40.023027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:40.023027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:40.023027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:40.023027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:40.023027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:40.023027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:40.023027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:40.023027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:55:40.023027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:55:40.023027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:55:40.023027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:55:40.023027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 655/1298] 10.222.0.24 () {56 vars in 1117 bytes} [Thu May 19 14:55:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:55:40.024054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41375387-a0d9-44b7-819c-56982f4b8a90 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:40.041281 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:40.120611 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41375387-a0d9-44b7-819c-56982f4b8a90 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:40.153294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77bfa3-5af6-46f3-bc82-19b4bcd81700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:40.153944 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77bfa3-5af6-46f3-bc82-19b4bcd81700 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:40.154224 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77bfa3-5af6-46f3-bc82-19b4bcd81700 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:40.154496 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77bfa3-5af6-46f3-bc82-19b4bcd81700 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:40.155192 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77bfa3-5af6-46f3-bc82-19b4bcd81700 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:40.155523 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77bfa3-5af6-46f3-bc82-19b4bcd81700 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:40.156889 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77bfa3-5af6-46f3-bc82-19b4bcd81700 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:40.162459 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 644/1299] 10.222.0.24 () {56 vars in 1116 bytes} [Thu May 19 14:55:40 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:40.168222 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330d646-2574-4b2a-b560-ef45f3e621bd None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:40.202514 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:40.268926 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330d646-2574-4b2a-b560-ef45f3e621bd None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:40.301329 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b58e8f-35aa-4476-b875-123a1745a6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:40.302000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b58e8f-35aa-4476-b875-123a1745a6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:40.302281 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b58e8f-35aa-4476-b875-123a1745a6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:40.302556 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b58e8f-35aa-4476-b875-123a1745a6b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:40.303369 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b58e8f-35aa-4476-b875-123a1745a6b0 None admin] RBAC: Adding query filter params (interface=public, service_id=37ae54a335e74d45a248f952f32b8cf6, region_id=RegionOne) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:40.303681 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b58e8f-35aa-4476-b875-123a1745a6b0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:40.305033 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b58e8f-35aa-4476-b875-123a1745a6b0 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:40.309887 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 656/1300] 10.222.0.24 () {56 vars in 1251 bytes} [Thu May 19 14:55:40 2022] GET /identity/v3/endpoints?service_id=37ae54a335e74d45a248f952f32b8cf6&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:40.315634 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77bfa3-5af6-46f3-bc82-19b4bcd81700 None admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:40.394472 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:40.412878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77bfa3-5af6-46f3-bc82-19b4bcd81700 None admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:40.446437 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59123ee1-1d64-4bf0-aab4-f478d5ccc3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:40.447095 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59123ee1-1d64-4bf0-aab4-f478d5ccc3ea None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:40.447414 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59123ee1-1d64-4bf0-aab4-f478d5ccc3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:40.447697 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59123ee1-1d64-4bf0-aab4-f478d5ccc3ea None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:40.448374 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59123ee1-1d64-4bf0-aab4-f478d5ccc3ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:40.449894 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59123ee1-1d64-4bf0-aab4-f478d5ccc3ea None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:40.457296 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 645/1301] 10.222.0.24 () {56 vars in 1087 bytes} [Thu May 19 14:55:40 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 14:55:42.640098 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082974d-36f5-4d77-b8b2-1a59b84e596a None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:42.640615 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082974d-36f5-4d77-b8b2-1a59b84e596a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:42.640615 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082974d-36f5-4d77-b8b2-1a59b84e596a None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:42.641937 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 657/1302] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:55:42.647248 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf49f8-468a-4346-a45d-6601bb58600e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:42.647624 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf49f8-468a-4346-a45d-6601bb58600e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:42.647823 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf49f8-468a-4346-a45d-6601bb58600e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:42.664580 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7daf49f8-468a-4346-a45d-6601bb58600e None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:55:42.665762 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7daf49f8-468a-4346-a45d-6601bb58600e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:55:42.730082 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 646/1303] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:55:42 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 19 14:55:42.753515 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082974d-36f5-4d77-b8b2-1a59b84e596a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:42.844794 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:42.852624 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082974d-36f5-4d77-b8b2-1a59b84e596a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:42.886016 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02fbfcb-c265-4aaa-b5a7-806f94254a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:42.886795 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fbfcb-c265-4aaa-b5a7-806f94254a08 None admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:42.887078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fbfcb-c265-4aaa-b5a7-806f94254a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:42.887380 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02fbfcb-c265-4aaa-b5a7-806f94254a08 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:42.888028 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02fbfcb-c265-4aaa-b5a7-806f94254a08 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:42.889381 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02fbfcb-c265-4aaa-b5a7-806f94254a08 None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:42.900965 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application [None req-f02fbfcb-c265-4aaa-b5a7-806f94254a08 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:55:42.900965 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:42.900965 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 19 14:55:42.900965 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 19 14:55:42.900965 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 19 14:55:42.900965 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 19 14:55:42.900965 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 19 14:55:42.900965 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:55:42.900965 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:55:42.900965 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:55:42.900965 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 19 14:55:42.900965 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:55:42.900965 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application Traceback (most recent call last): May 19 14:55:42.900965 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 19 14:55:42.900965 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 19 14:55:42.900965 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 19 14:55:42.900965 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 19 14:55:42.902112 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 19 14:55:42.902112 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 19 14:55:42.902112 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 19 14:55:42.902112 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 19 14:55:42.902112 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 19 14:55:42.902112 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 19 14:55:42.902112 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 19 14:55:42.902112 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._get_service(service_id) May 19 14:55:42.902112 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 19 14:55:42.902112 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 19 14:55:42.902112 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 19 14:55:42.902112 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 19 14:55:42.902112 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 19 14:55:42.902112 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 19 14:55:42.902112 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 19 14:55:42.902112 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.get_or_create( May 19 14:55:42.902967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 19 14:55:42.902967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application with Lock( May 19 14:55:42.902967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 19 14:55:42.902967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self._enter() May 19 14:55:42.902967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 19 14:55:42.902967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 19 14:55:42.902967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 19 14:55:42.902967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application return self.creator() May 19 14:55:42.902967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 19 14:55:42.902967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application created_value = creator( May 19 14:55:42.902967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 19 14:55:42.902967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 19 14:55:42.902967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 19 14:55:42.902967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: ERROR keystone.server.flask.application May 19 14:55:42.902967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 658/1304] 10.222.0.24 () {56 vars in 1117 bytes} [Thu May 19 14:55:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 19 14:55:42.908082 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf49f8-468a-4346-a45d-6601bb58600e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:42.980348 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:43.003707 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf49f8-468a-4346-a45d-6601bb58600e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:43.036686 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e6bf8-d907-4647-a803-f58373b21541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:43.037324 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e6bf8-d907-4647-a803-f58373b21541 None admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:43.037607 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e6bf8-d907-4647-a803-f58373b21541 None admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:43.037878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e6bf8-d907-4647-a803-f58373b21541 None admin] PATH_INFO: `/v3/services` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:43.038575 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e6bf8-d907-4647-a803-f58373b21541 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 14:55:43.038878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e6bf8-d907-4647-a803-f58373b21541 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:43.040260 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e6bf8-d907-4647-a803-f58373b21541 None admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:43.045269 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 647/1305] 10.222.0.24 () {56 vars in 1116 bytes} [Thu May 19 14:55:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 14:55:43.050815 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02fbfcb-c265-4aaa-b5a7-806f94254a08 None admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:55:43.145873 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02fbfcb-c265-4aaa-b5a7-806f94254a08 None admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:55:43.177378 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda9a5c-f7a8-4915-a1a9-d07ff269a42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:55:43.178006 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda9a5c-f7a8-4915-a1a9-d07ff269a42b None admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:55:43.178283 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda9a5c-f7a8-4915-a1a9-d07ff269a42b None admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:55:43.178552 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda9a5c-f7a8-4915-a1a9-d07ff269a42b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:55:43.179359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda9a5c-f7a8-4915-a1a9-d07ff269a42b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:55:43.180700 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda9a5c-f7a8-4915-a1a9-d07ff269a42b None admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:55:43.197859 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 659/1306] 10.222.0.24 () {60 vars in 1144 bytes} [Thu May 19 14:55:43 2022] POST /identity/v3/endpoints => generated 331 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 14:55:53.042344 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=30 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:55:53.193726 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:56:46.770043 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571caefd-c78c-45a3-a7dc-e104b921fa37 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:46.771703 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571caefd-c78c-45a3-a7dc-e104b921fa37 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:46.772229 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571caefd-c78c-45a3-a7dc-e104b921fa37 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:46.777964 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 648/1307] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:56:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:56:46.779611 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e710f-1076-4d8b-a61b-7b5ec13ffbe1 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:46.780031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e710f-1076-4d8b-a61b-7b5ec13ffbe1 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:46.780260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e710f-1076-4d8b-a61b-7b5ec13ffbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:46.874125 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-368e710f-1076-4d8b-a61b-7b5ec13ffbe1 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:56:46.875587 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-368e710f-1076-4d8b-a61b-7b5ec13ffbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:47.008364 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 660/1308] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 14:56:47.053806 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d91559-2862-4153-bc97-c3f0458fbaef None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:47.054063 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d91559-2862-4153-bc97-c3f0458fbaef None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:47.054352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d91559-2862-4153-bc97-c3f0458fbaef None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:47.056279 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 649/1309] 10.222.0.24 () {54 vars in 964 bytes} [Thu May 19 14:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:56:47.068792 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccce38-a1b1-4309-b056-50b8927eec84 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:47.069082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccce38-a1b1-4309-b056-50b8927eec84 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:47.069395 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccce38-a1b1-4309-b056-50b8927eec84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:47.182364 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f8ccce38-a1b1-4309-b056-50b8927eec84 None None] MFA Rules not processed for user `2d089b5ee94e441ebbd084c2581a42df`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:56:47.183607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f8ccce38-a1b1-4309-b056-50b8927eec84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:47.204479 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:56:47.263819 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 661/1310] 10.222.0.24 () {58 vars in 1061 bytes} [Thu May 19 14:56:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:56:47.272974 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d91559-2862-4153-bc97-c3f0458fbaef None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:56:47.274708 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b5d91559-2862-4153-bc97-c3f0458fbaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:47.453753 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d91559-2862-4153-bc97-c3f0458fbaef None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:56:47.534928 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac7291-4751-4b88-a677-d7207aafddc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:56:47.535879 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac7291-4751-4b88-a677-d7207aafddc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:47.536316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac7291-4751-4b88-a677-d7207aafddc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:47.536869 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac7291-4751-4b88-a677-d7207aafddc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:47.538857 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-feac7291-4751-4b88-a677-d7207aafddc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:47.602598 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:56:47.666294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac7291-4751-4b88-a677-d7207aafddc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:56:47.667954 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac7291-4751-4b88-a677-d7207aafddc0 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:56:47.688138 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 650/1311] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:56:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:56:50.263234 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423c6ca-fb0b-459c-8336-da95add58487 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:50.263234 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423c6ca-fb0b-459c-8336-da95add58487 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:50.263890 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423c6ca-fb0b-459c-8336-da95add58487 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:50.268032 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 662/1312] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:56:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:56:50.270089 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a00b3-6d6d-4ebf-8c53-9486e53d9b55 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:50.270544 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a00b3-6d6d-4ebf-8c53-9486e53d9b55 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:50.270844 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a00b3-6d6d-4ebf-8c53-9486e53d9b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:50.393803 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-617a00b3-6d6d-4ebf-8c53-9486e53d9b55 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:56:50.395105 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-617a00b3-6d6d-4ebf-8c53-9486e53d9b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:50.498165 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 651/1313] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:56:50.536098 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423c6ca-fb0b-459c-8336-da95add58487 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:56:50.537883 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e423c6ca-fb0b-459c-8336-da95add58487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:50.653121 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423c6ca-fb0b-459c-8336-da95add58487 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:56:50.732105 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:56:50.734732 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3be80-4ad1-4588-ae65-518535e65078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:56:50.735823 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3be80-4ad1-4588-ae65-518535e65078 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:50.736217 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3be80-4ad1-4588-ae65-518535e65078 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:50.736971 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3be80-4ad1-4588-ae65-518535e65078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:50.739221 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-bca3be80-4ad1-4588-ae65-518535e65078 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:50.850292 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3be80-4ad1-4588-ae65-518535e65078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:56:50.851770 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3be80-4ad1-4588-ae65-518535e65078 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:56:50.870261 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 663/1314] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:56:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:56:53.435928 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4ff4a-d015-4e3b-bc4d-8743364a8ab9 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:53.436491 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4ff4a-d015-4e3b-bc4d-8743364a8ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:53.436491 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4ff4a-d015-4e3b-bc4d-8743364a8ab9 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:53.437910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 652/1315] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:56:53.443144 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca6057-7fac-4451-a251-c2a530149a9c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:53.443579 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca6057-7fac-4451-a251-c2a530149a9c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:53.443723 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca6057-7fac-4451-a251-c2a530149a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:53.507173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-20ca6057-7fac-4451-a251-c2a530149a9c None None] MFA Rules not processed for user `c1ed4d1479484c11a4d2682af24a7155`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:56:53.508404 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-20ca6057-7fac-4451-a251-c2a530149a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:53.559480 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:56:53.605240 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 664/1316] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:56:53 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:56:53.643603 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4ff4a-d015-4e3b-bc4d-8743364a8ab9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:56:53.645735 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8cf4ff4a-d015-4e3b-bc4d-8743364a8ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:53.655429 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:56:53.747876 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4ff4a-d015-4e3b-bc4d-8743364a8ab9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:56:53.818801 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726f1c8-2dc0-4d25-ba96-c7a9e46cbfcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:56:53.819479 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726f1c8-2dc0-4d25-ba96-c7a9e46cbfcf service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:53.819769 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726f1c8-2dc0-4d25-ba96-c7a9e46cbfcf service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:53.820047 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726f1c8-2dc0-4d25-ba96-c7a9e46cbfcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:53.821715 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e726f1c8-2dc0-4d25-ba96-c7a9e46cbfcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:53.883362 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:56:53.928906 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726f1c8-2dc0-4d25-ba96-c7a9e46cbfcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:56:53.930355 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726f1c8-2dc0-4d25-ba96-c7a9e46cbfcf service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:56:53.950539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 653/1317] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:56:53 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:56:56.747683 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e1e0f-f0bf-41ba-9b2e-0cc67da61e51 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:56.748244 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e1e0f-f0bf-41ba-9b2e-0cc67da61e51 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:56.748244 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e1e0f-f0bf-41ba-9b2e-0cc67da61e51 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:56.749608 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 665/1318] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:56:56.755462 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c601964-292d-44f2-bdb2-ffcbb00a7ab8 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:56.755857 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c601964-292d-44f2-bdb2-ffcbb00a7ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:56.756022 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c601964-292d-44f2-bdb2-ffcbb00a7ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:56.817847 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-6c601964-292d-44f2-bdb2-ffcbb00a7ab8 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:56:56.819025 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6c601964-292d-44f2-bdb2-ffcbb00a7ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:56.911768 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 654/1319] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:56:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:56:56.949474 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e1e0f-f0bf-41ba-9b2e-0cc67da61e51 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:56:56.950993 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-599e1e0f-f0bf-41ba-9b2e-0cc67da61e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:57.062594 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e1e0f-f0bf-41ba-9b2e-0cc67da61e51 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:56:57.132949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bccf5-95bd-4734-884e-3703f1aa922b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:56:57.133590 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bccf5-95bd-4734-884e-3703f1aa922b service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:56:57.133874 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bccf5-95bd-4734-884e-3703f1aa922b service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:56:57.134149 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bccf5-95bd-4734-884e-3703f1aa922b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:56:57.135805 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-af4bccf5-95bd-4734-884e-3703f1aa922b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:56:57.142912 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:56:57.241385 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4bccf5-95bd-4734-884e-3703f1aa922b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:56:57.242805 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4bccf5-95bd-4734-884e-3703f1aa922b service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:56:57.260273 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 666/1320] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:56:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:57:00.167111 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a40d1-9acb-4629-adf0-3ba54d9d3a33 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:00.167677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a40d1-9acb-4629-adf0-3ba54d9d3a33 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:00.167769 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a40d1-9acb-4629-adf0-3ba54d9d3a33 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:00.169094 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 655/1321] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:57:00.174260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fdd5d-b692-453e-a5c0-b239300f8a2a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:00.174688 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fdd5d-b692-453e-a5c0-b239300f8a2a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:00.174792 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fdd5d-b692-453e-a5c0-b239300f8a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:00.238581 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-893fdd5d-b692-453e-a5c0-b239300f8a2a None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:00.239801 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-893fdd5d-b692-453e-a5c0-b239300f8a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:00.298187 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:57:00.338875 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 667/1322] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:57:00.374646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a40d1-9acb-4629-adf0-3ba54d9d3a33 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:57:00.376321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ed5a40d1-9acb-4629-adf0-3ba54d9d3a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:00.398628 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:57:00.482535 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a40d1-9acb-4629-adf0-3ba54d9d3a33 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:57:00.555298 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff6ef5-4258-48ee-ae48-a684bdc20325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:57:00.555952 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff6ef5-4258-48ee-ae48-a684bdc20325 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:00.556236 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff6ef5-4258-48ee-ae48-a684bdc20325 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:00.556512 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff6ef5-4258-48ee-ae48-a684bdc20325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:00.558144 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c1ff6ef5-4258-48ee-ae48-a684bdc20325 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:00.628204 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:57:00.665889 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff6ef5-4258-48ee-ae48-a684bdc20325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:57:00.667375 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff6ef5-4258-48ee-ae48-a684bdc20325 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:57:00.686818 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 656/1323] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:57:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:57:02.974570 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32516936-0b81-4a0a-92ea-406b9939f16a None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:02.975086 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32516936-0b81-4a0a-92ea-406b9939f16a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:02.975231 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32516936-0b81-4a0a-92ea-406b9939f16a None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:02.976518 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 668/1324] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:57:02.981791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd1b40-454b-4b2c-8540-b8890f3f98aa None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:02.982195 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd1b40-454b-4b2c-8540-b8890f3f98aa None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:02.982475 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd1b40-454b-4b2c-8540-b8890f3f98aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:03.047759 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a6fd1b40-454b-4b2c-8540-b8890f3f98aa None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:03.048969 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a6fd1b40-454b-4b2c-8540-b8890f3f98aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:03.143474 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 657/1325] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:57:03.179672 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32516936-0b81-4a0a-92ea-406b9939f16a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:57:03.181294 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-32516936-0b81-4a0a-92ea-406b9939f16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:03.284128 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32516936-0b81-4a0a-92ea-406b9939f16a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:57:03.358913 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b64cb-5ce2-423f-b205-a5a2de931ead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:57:03.359593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b64cb-5ce2-423f-b205-a5a2de931ead service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:03.359875 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b64cb-5ce2-423f-b205-a5a2de931ead service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:03.360148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b64cb-5ce2-423f-b205-a5a2de931ead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:03.361786 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-507b64cb-5ce2-423f-b205-a5a2de931ead service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:03.378357 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:57:03.468653 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b64cb-5ce2-423f-b205-a5a2de931ead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:57:03.470021 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b64cb-5ce2-423f-b205-a5a2de931ead service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:57:03.488212 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 669/1326] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:57:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:57:05.757978 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d71d18-0011-449e-a6d3-8a6f539f42b7 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:05.758555 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d71d18-0011-449e-a6d3-8a6f539f42b7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:05.758555 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d71d18-0011-449e-a6d3-8a6f539f42b7 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:05.759969 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 658/1327] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:57:05.765416 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc02f18-293c-47cf-a8fe-d39a014ff368 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:05.765843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc02f18-293c-47cf-a8fe-d39a014ff368 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:05.765949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc02f18-293c-47cf-a8fe-d39a014ff368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:05.834459 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-8cc02f18-293c-47cf-a8fe-d39a014ff368 None None] MFA Rules not processed for user `c1ed4d1479484c11a4d2682af24a7155`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:05.835831 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8cc02f18-293c-47cf-a8fe-d39a014ff368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:05.900061 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:57:05.932602 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 670/1328] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:57:05 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:57:05.969744 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d71d18-0011-449e-a6d3-8a6f539f42b7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:57:05.971402 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-63d71d18-0011-449e-a6d3-8a6f539f42b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:06.003936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:57:06.075355 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d71d18-0011-449e-a6d3-8a6f539f42b7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:57:06.150853 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a94d75-07c1-4217-9d0b-3d11a0a84418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:57:06.151527 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a94d75-07c1-4217-9d0b-3d11a0a84418 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:06.151807 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a94d75-07c1-4217-9d0b-3d11a0a84418 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:06.152080 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a94d75-07c1-4217-9d0b-3d11a0a84418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:06.153695 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-01a94d75-07c1-4217-9d0b-3d11a0a84418 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:06.228935 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:57:06.261865 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a94d75-07c1-4217-9d0b-3d11a0a84418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:57:06.263348 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a94d75-07c1-4217-9d0b-3d11a0a84418 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:57:06.280868 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 659/1329] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:57:05 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:57:08.745457 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4d360-cde8-469c-8a8d-8a6b77a4aeb5 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:08.745983 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4d360-cde8-469c-8a8d-8a6b77a4aeb5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:08.746147 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4d360-cde8-469c-8a8d-8a6b77a4aeb5 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:08.747629 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 671/1330] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:57:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:57:08.753047 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d066d5-bb29-47a3-a762-7d913992c0eb None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:08.753539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d066d5-bb29-47a3-a762-7d913992c0eb None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:08.753626 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d066d5-bb29-47a3-a762-7d913992c0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:08.822393 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-27d066d5-bb29-47a3-a762-7d913992c0eb None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:08.823637 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-27d066d5-bb29-47a3-a762-7d913992c0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:08.919311 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 660/1331] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:57:08.955441 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4d360-cde8-469c-8a8d-8a6b77a4aeb5 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:57:08.957565 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-07c4d360-cde8-469c-8a8d-8a6b77a4aeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:09.070320 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4d360-cde8-469c-8a8d-8a6b77a4aeb5 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:57:09.146599 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27129977-2f0e-4e0f-92c6-7f62c75085b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:57:09.147310 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27129977-2f0e-4e0f-92c6-7f62c75085b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:09.147593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27129977-2f0e-4e0f-92c6-7f62c75085b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:09.147863 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27129977-2f0e-4e0f-92c6-7f62c75085b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:09.149519 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-27129977-2f0e-4e0f-92c6-7f62c75085b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:09.178156 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:57:09.267240 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27129977-2f0e-4e0f-92c6-7f62c75085b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:57:09.268749 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27129977-2f0e-4e0f-92c6-7f62c75085b7 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:57:09.286230 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 672/1332] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:57:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:57:11.575184 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f2ea4-0b2c-4756-8197-4c66b26dfa51 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:11.575763 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f2ea4-0b2c-4756-8197-4c66b26dfa51 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:11.575763 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f2ea4-0b2c-4756-8197-4c66b26dfa51 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:11.577079 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 661/1333] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:57:11.582379 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ede95c-d53e-49df-b89c-edbf08684a4b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:11.582784 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ede95c-d53e-49df-b89c-edbf08684a4b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:11.582940 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ede95c-d53e-49df-b89c-edbf08684a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:11.646104 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-50ede95c-d53e-49df-b89c-edbf08684a4b None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:11.647316 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-50ede95c-d53e-49df-b89c-edbf08684a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:11.719281 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:57:11.741457 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 673/1334] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:57:11.781384 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f2ea4-0b2c-4756-8197-4c66b26dfa51 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:57:11.782947 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-cb5f2ea4-0b2c-4756-8197-4c66b26dfa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:11.824115 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:57:11.888719 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f2ea4-0b2c-4756-8197-4c66b26dfa51 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:57:11.958791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129ca43-f09c-4939-ab43-a6ee495aa953 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:57:11.959463 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129ca43-f09c-4939-ab43-a6ee495aa953 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:11.959752 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129ca43-f09c-4939-ab43-a6ee495aa953 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:11.960029 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129ca43-f09c-4939-ab43-a6ee495aa953 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:11.961659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0129ca43-f09c-4939-ab43-a6ee495aa953 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:12.041939 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:57:12.067394 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129ca43-f09c-4939-ab43-a6ee495aa953 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:57:12.068843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129ca43-f09c-4939-ab43-a6ee495aa953 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:57:12.085923 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 662/1335] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:57:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 14:57:14.742994 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7d8ca-ca21-4100-b017-c1c00e950ae3 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:14.743549 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7d8ca-ca21-4100-b017-c1c00e950ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:14.743669 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7d8ca-ca21-4100-b017-c1c00e950ae3 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:14.745202 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 674/1336] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:57:14.750229 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db12fd3-f8a6-4c2b-88f4-c85fcd02a187 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:14.750648 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db12fd3-f8a6-4c2b-88f4-c85fcd02a187 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:14.750800 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db12fd3-f8a6-4c2b-88f4-c85fcd02a187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:14.829464 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4db12fd3-f8a6-4c2b-88f4-c85fcd02a187 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:14.830688 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4db12fd3-f8a6-4c2b-88f4-c85fcd02a187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:14.925620 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 663/1337] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:57:14 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:57:14.960114 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7d8ca-ca21-4100-b017-c1c00e950ae3 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:57:14.961674 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d7f7d8ca-ca21-4100-b017-c1c00e950ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:15.065457 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7d8ca-ca21-4100-b017-c1c00e950ae3 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:57:15.136835 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197765b9-1020-400e-8c3a-21bd7219dd3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:57:15.137509 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197765b9-1020-400e-8c3a-21bd7219dd3c service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:15.137795 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197765b9-1020-400e-8c3a-21bd7219dd3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:15.138074 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197765b9-1020-400e-8c3a-21bd7219dd3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:15.139734 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-197765b9-1020-400e-8c3a-21bd7219dd3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:15.174587 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:57:15.251436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197765b9-1020-400e-8c3a-21bd7219dd3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:57:15.252887 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197765b9-1020-400e-8c3a-21bd7219dd3c service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:57:15.271281 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 675/1338] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:57:14 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:57:19.379788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48fb9d-2077-4baf-ae57-270acff4479b None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:19.380290 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48fb9d-2077-4baf-ae57-270acff4479b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:19.380290 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48fb9d-2077-4baf-ae57-270acff4479b None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:19.381681 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 664/1339] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:57:19.386765 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b41f5b-13f8-4c2d-bbe9-49dbb4d6c7a2 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:19.387248 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b41f5b-13f8-4c2d-bbe9-49dbb4d6c7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:19.387348 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b41f5b-13f8-4c2d-bbe9-49dbb4d6c7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:19.460444 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f9b41f5b-13f8-4c2d-bbe9-49dbb4d6c7a2 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:19.461658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f9b41f5b-13f8-4c2d-bbe9-49dbb4d6c7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:19.556796 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:57:19.569701 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 676/1340] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 14:57:19.607759 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48fb9d-2077-4baf-ae57-270acff4479b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:57:19.609875 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5e48fb9d-2077-4baf-ae57-270acff4479b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:19.658580 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:57:19.704911 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48fb9d-2077-4baf-ae57-270acff4479b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:57:19.708437 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b7d2a-395e-4c8f-9076-e6ee91352df7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:57:19.709080 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b7d2a-395e-4c8f-9076-e6ee91352df7 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:19.709368 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b7d2a-395e-4c8f-9076-e6ee91352df7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:19.709645 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b7d2a-395e-4c8f-9076-e6ee91352df7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:19.718526 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b7d2a-395e-4c8f-9076-e6ee91352df7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:57:19.719978 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b7d2a-395e-4c8f-9076-e6ee91352df7 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:57:19.729755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 665/1341] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:57:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:57:22.558114 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f0516-4831-4389-b183-66e632784db5 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:22.558640 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f0516-4831-4389-b183-66e632784db5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:22.558640 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f0516-4831-4389-b183-66e632784db5 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:22.559998 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 677/1342] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:57:22.565223 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b6771-015e-4968-a71c-de0c70386951 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:22.566158 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b6771-015e-4968-a71c-de0c70386951 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:22.566292 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b6771-015e-4968-a71c-de0c70386951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:22.594037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d30b6771-015e-4968-a71c-de0c70386951 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:22.595155 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d30b6771-015e-4968-a71c-de0c70386951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:22.675555 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 666/1343] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:57:22 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:57:22.728372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f594d-dd7b-4784-b548-998eebda2acf None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:22.728665 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f594d-dd7b-4784-b548-998eebda2acf None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:22.728945 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f594d-dd7b-4784-b548-998eebda2acf None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:22.730357 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 678/1344] 10.222.0.24 () {54 vars in 964 bytes} [Thu May 19 14:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:57:22.736422 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f03750-c28b-4941-8c1d-4cd80eb1af42 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:22.736720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f03750-c28b-4941-8c1d-4cd80eb1af42 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:22.737030 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f03750-c28b-4941-8c1d-4cd80eb1af42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:22.793348 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-95f03750-c28b-4941-8c1d-4cd80eb1af42 None None] MFA Rules not processed for user `2d089b5ee94e441ebbd084c2581a42df`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:22.794547 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-95f03750-c28b-4941-8c1d-4cd80eb1af42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:22.801634 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 667/1345] 10.222.0.24 () {58 vars in 1061 bytes} [Thu May 19 14:57:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 14:57:22.810575 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f594d-dd7b-4784-b548-998eebda2acf None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:57:22.821530 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f594d-dd7b-4784-b548-998eebda2acf None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:57:22.824969 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de4ca2-ba43-4c2a-8bb5-b5f0f33bedaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:57:22.825592 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de4ca2-ba43-4c2a-8bb5-b5f0f33bedaa service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:22.825869 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de4ca2-ba43-4c2a-8bb5-b5f0f33bedaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:22.826138 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de4ca2-ba43-4c2a-8bb5-b5f0f33bedaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:22.834930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de4ca2-ba43-4c2a-8bb5-b5f0f33bedaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:57:22.836388 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de4ca2-ba43-4c2a-8bb5-b5f0f33bedaa service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:57:22.845639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 679/1346] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:57:22 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:57:27.837981 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a728249-621f-476c-aafc-a1db1da0685c None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:27.838526 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a728249-621f-476c-aafc-a1db1da0685c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:27.838649 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a728249-621f-476c-aafc-a1db1da0685c None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:27.840014 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 668/1347] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:57:27.845452 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e328e-7e26-4850-8700-2dc0c8a0c6bc None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:27.845859 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e328e-7e26-4850-8700-2dc0c8a0c6bc None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:27.846011 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e328e-7e26-4850-8700-2dc0c8a0c6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:27.863788 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-aa4e328e-7e26-4850-8700-2dc0c8a0c6bc None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:27.865010 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-aa4e328e-7e26-4850-8700-2dc0c8a0c6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:27.873374 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 680/1348] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:57:27.914544 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a728249-621f-476c-aafc-a1db1da0685c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:57:27.926684 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a728249-621f-476c-aafc-a1db1da0685c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:57:27.931367 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056c5c7-2281-4d1f-b112-fac84508be7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:57:27.932023 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056c5c7-2281-4d1f-b112-fac84508be7d service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:27.932314 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056c5c7-2281-4d1f-b112-fac84508be7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:27.932595 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056c5c7-2281-4d1f-b112-fac84508be7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:27.944135 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056c5c7-2281-4d1f-b112-fac84508be7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:57:27.945581 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056c5c7-2281-4d1f-b112-fac84508be7d service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:57:27.955299 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 669/1349] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:57:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:57:33.249842 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9556f-b136-4118-b0c5-1b894856989a None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:33.250295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9556f-b136-4118-b0c5-1b894856989a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:33.250402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9556f-b136-4118-b0c5-1b894856989a None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:33.252227 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 681/1350] 10.222.0.24 () {54 vars in 921 bytes} [Thu May 19 14:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:57:33.257675 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b663ed-753c-40f4-8ae3-366fa6ee561d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:33.258454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b663ed-753c-40f4-8ae3-366fa6ee561d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:33.258880 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b663ed-753c-40f4-8ae3-366fa6ee561d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:33.311781 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a5b663ed-753c-40f4-8ae3-366fa6ee561d None None] MFA Rules not processed for user `adec680c4f5f4e6dbe5989d5d7acf620`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:33.316365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a5b663ed-753c-40f4-8ae3-366fa6ee561d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:33.322410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:57:33.418691 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 670/1351] 10.222.0.24 () {58 vars in 1018 bytes} [Thu May 19 14:57:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 14:57:37.740799 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1d95f-b7e5-4cb9-8d79-2e14a26709a2 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:37.741351 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1d95f-b7e5-4cb9-8d79-2e14a26709a2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:37.741351 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1d95f-b7e5-4cb9-8d79-2e14a26709a2 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:37.742705 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 682/1352] 10.222.0.24 () {54 vars in 921 bytes} [Thu May 19 14:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:57:37.748024 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d903355-7f5a-441b-a531-393a4c1e1591 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:37.749007 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d903355-7f5a-441b-a531-393a4c1e1591 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:37.749531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d903355-7f5a-441b-a531-393a4c1e1591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:37.767770 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0d903355-7f5a-441b-a531-393a4c1e1591 None None] MFA Rules not processed for user `adec680c4f5f4e6dbe5989d5d7acf620`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:37.769475 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0d903355-7f5a-441b-a531-393a4c1e1591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:37.778091 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 671/1353] 10.222.0.24 () {58 vars in 1018 bytes} [Thu May 19 14:57:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:57:37.858587 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=13 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:57:39.358717 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294faf6-61ad-4258-ae41-247e64da36b8 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:39.359377 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294faf6-61ad-4258-ae41-247e64da36b8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:39.359377 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294faf6-61ad-4258-ae41-247e64da36b8 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:39.360928 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 683/1354] 10.222.0.24 () {54 vars in 921 bytes} [Thu May 19 14:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:57:39.366168 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfea9bd-f48c-4769-97fa-eed8d088cac8 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:39.366613 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfea9bd-f48c-4769-97fa-eed8d088cac8 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:39.366777 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfea9bd-f48c-4769-97fa-eed8d088cac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:39.387018 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9cfea9bd-f48c-4769-97fa-eed8d088cac8 None None] MFA Rules not processed for user `adec680c4f5f4e6dbe5989d5d7acf620`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:39.388221 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9cfea9bd-f48c-4769-97fa-eed8d088cac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:39.397624 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 672/1355] 10.222.0.24 () {58 vars in 1018 bytes} [Thu May 19 14:57:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 14:57:43.256668 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfbaa6-703b-473d-b59a-093146ff678d None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:43.257165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfbaa6-703b-473d-b59a-093146ff678d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:43.257288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bfbaa6-703b-473d-b59a-093146ff678d None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:43.258553 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 684/1356] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:57:43.263857 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df142ec-bc41-4d95-b453-254d8bf7fbe3 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:43.264272 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df142ec-bc41-4d95-b453-254d8bf7fbe3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:43.264552 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df142ec-bc41-4d95-b453-254d8bf7fbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:43.282619 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2df142ec-bc41-4d95-b453-254d8bf7fbe3 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:43.284551 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2df142ec-bc41-4d95-b453-254d8bf7fbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:43.295541 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 673/1357] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:57:43.346234 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26b812-60ec-4e7d-a242-9ce2ca77beb9 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:43.348112 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26b812-60ec-4e7d-a242-9ce2ca77beb9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:43.356639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26b812-60ec-4e7d-a242-9ce2ca77beb9 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:43.359363 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 685/1358] 10.222.0.24 () {54 vars in 961 bytes} [Thu May 19 14:57:43 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:57:43.379324 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e8def-c30b-4cf8-8c2f-83dd6639caf6 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:43.380558 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e8def-c30b-4cf8-8c2f-83dd6639caf6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:43.381280 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e8def-c30b-4cf8-8c2f-83dd6639caf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:43.449629 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d83e8def-c30b-4cf8-8c2f-83dd6639caf6 None None] MFA Rules not processed for user `06fb8bb5aeb143ad95f33c3b43dbd346`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:43.451056 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d83e8def-c30b-4cf8-8c2f-83dd6639caf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:43.535336 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 674/1359] 10.222.0.24 () {58 vars in 1058 bytes} [Thu May 19 14:57:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:57:43.542761 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26b812-60ec-4e7d-a242-9ce2ca77beb9 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:57:43.558068 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26b812-60ec-4e7d-a242-9ce2ca77beb9 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:57:43.563921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56129352-dfca-4d96-a0a2-ac3f0201b16c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:57:43.564641 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56129352-dfca-4d96-a0a2-ac3f0201b16c service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:43.565518 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56129352-dfca-4d96-a0a2-ac3f0201b16c service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:43.565863 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56129352-dfca-4d96-a0a2-ac3f0201b16c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:43.574757 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56129352-dfca-4d96-a0a2-ac3f0201b16c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:57:43.576582 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56129352-dfca-4d96-a0a2-ac3f0201b16c service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:57:43.587296 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 686/1360] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:57:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:57:46.028815 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d387e1-91ac-4d7f-8a1a-73f7e0f79b46 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:46.029330 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d387e1-91ac-4d7f-8a1a-73f7e0f79b46 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:46.029330 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d387e1-91ac-4d7f-8a1a-73f7e0f79b46 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:46.030804 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 675/1361] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:57:46.035865 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd0b18-ba3a-4316-a9f7-7af2553cb6ee None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:46.036622 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd0b18-ba3a-4316-a9f7-7af2553cb6ee None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:46.036901 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd0b18-ba3a-4316-a9f7-7af2553cb6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:46.054867 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-06bd0b18-ba3a-4316-a9f7-7af2553cb6ee None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:46.056095 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-06bd0b18-ba3a-4316-a9f7-7af2553cb6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:46.063930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 687/1362] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:57:46.107538 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d387e1-91ac-4d7f-8a1a-73f7e0f79b46 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:57:46.126246 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d387e1-91ac-4d7f-8a1a-73f7e0f79b46 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:57:46.132431 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a9cb4-3ba4-42a4-8c6d-ec70e1719036 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:57:46.133086 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a9cb4-3ba4-42a4-8c6d-ec70e1719036 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:46.133378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a9cb4-3ba4-42a4-8c6d-ec70e1719036 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:46.133665 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a9cb4-3ba4-42a4-8c6d-ec70e1719036 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:46.143643 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0a9cb4-3ba4-42a4-8c6d-ec70e1719036 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:57:46.145299 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0a9cb4-3ba4-42a4-8c6d-ec70e1719036 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:57:46.155583 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 676/1363] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:57:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:57:48.707500 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdc7f5-b150-4bd6-8712-db0878f46a51 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:48.708066 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdc7f5-b150-4bd6-8712-db0878f46a51 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:48.708164 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdc7f5-b150-4bd6-8712-db0878f46a51 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:48.709500 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 688/1364] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:57:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:57:48.714750 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369aa1a5-7e22-476f-8840-dbc15f803598 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:48.715161 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369aa1a5-7e22-476f-8840-dbc15f803598 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:48.715372 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369aa1a5-7e22-476f-8840-dbc15f803598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:48.737814 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-369aa1a5-7e22-476f-8840-dbc15f803598 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:48.739031 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-369aa1a5-7e22-476f-8840-dbc15f803598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:48.747230 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 677/1365] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:57:48.792394 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58691ab0-5cbc-4e21-9f4a-102184415ceb None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:48.792683 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58691ab0-5cbc-4e21-9f4a-102184415ceb None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:48.792959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58691ab0-5cbc-4e21-9f4a-102184415ceb None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:48.794302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 689/1366] 10.222.0.24 () {54 vars in 961 bytes} [Thu May 19 14:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:57:48.799490 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269d756-14df-41ce-bbef-d25a54c623de None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:48.799983 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269d756-14df-41ce-bbef-d25a54c623de None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:48.800454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269d756-14df-41ce-bbef-d25a54c623de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:48.827989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-6269d756-14df-41ce-bbef-d25a54c623de None None] MFA Rules not processed for user `06fb8bb5aeb143ad95f33c3b43dbd346`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:48.830032 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6269d756-14df-41ce-bbef-d25a54c623de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:48.842530 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 678/1367] 10.222.0.24 () {58 vars in 1058 bytes} [Thu May 19 14:57:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:57:48.851240 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58691ab0-5cbc-4e21-9f4a-102184415ceb None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:57:48.867564 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58691ab0-5cbc-4e21-9f4a-102184415ceb None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:57:48.873153 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77391545-52b6-4ccc-adf6-068968089c75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:57:48.873799 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77391545-52b6-4ccc-adf6-068968089c75 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:48.874079 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77391545-52b6-4ccc-adf6-068968089c75 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:48.874354 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77391545-52b6-4ccc-adf6-068968089c75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:48.883405 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77391545-52b6-4ccc-adf6-068968089c75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:57:48.884980 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77391545-52b6-4ccc-adf6-068968089c75 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:57:48.895061 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 690/1368] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:57:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:57:51.196639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385c645-bbda-4db7-9433-7a9380725cba None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:51.197222 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385c645-bbda-4db7-9433-7a9380725cba None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:51.197222 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385c645-bbda-4db7-9433-7a9380725cba None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:51.198514 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 679/1369] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:57:51.204711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739453d8-09c8-4e7f-909b-b13438e0c094 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:51.205270 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739453d8-09c8-4e7f-909b-b13438e0c094 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:51.205270 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739453d8-09c8-4e7f-909b-b13438e0c094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:51.225823 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-739453d8-09c8-4e7f-909b-b13438e0c094 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:51.227387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-739453d8-09c8-4e7f-909b-b13438e0c094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:51.236377 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 691/1370] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:57:51.281637 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385c645-bbda-4db7-9433-7a9380725cba None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:57:51.291989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:57:51.298111 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385c645-bbda-4db7-9433-7a9380725cba None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:57:51.304022 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ceae08-8f51-4baa-9dc5-4db0b465d63e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:57:51.304681 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ceae08-8f51-4baa-9dc5-4db0b465d63e service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:51.304966 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ceae08-8f51-4baa-9dc5-4db0b465d63e service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:51.305250 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ceae08-8f51-4baa-9dc5-4db0b465d63e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:51.313768 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ceae08-8f51-4baa-9dc5-4db0b465d63e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:57:51.315524 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ceae08-8f51-4baa-9dc5-4db0b465d63e service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:57:51.328869 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 680/1371] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:57:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:57:51.565363 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a1976-c717-4e68-b30f-574c602dbcb1 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:51.565565 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a1976-c717-4e68-b30f-574c602dbcb1 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:51.565838 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a1976-c717-4e68-b30f-574c602dbcb1 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:51.567470 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 692/1372] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:57:51.573185 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e7ad6-0287-419a-bd7e-ee46185d7ad2 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:51.573662 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e7ad6-0287-419a-bd7e-ee46185d7ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:51.574028 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e7ad6-0287-419a-bd7e-ee46185d7ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:51.594981 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-403e7ad6-0287-419a-bd7e-ee46185d7ad2 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:51.596878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-403e7ad6-0287-419a-bd7e-ee46185d7ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:51.605654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 681/1373] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:57:51.913129 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04003264-5cdb-4b34-9e52-bd17e8ce28cc None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:51.913129 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04003264-5cdb-4b34-9e52-bd17e8ce28cc None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:51.913129 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04003264-5cdb-4b34-9e52-bd17e8ce28cc None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:51.915148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 693/1374] 10.222.0.24 () {54 vars in 963 bytes} [Thu May 19 14:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:57:51.918984 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6ebeb-9d66-404c-95b4-1b7d7fb35ef4 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:51.919542 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6ebeb-9d66-404c-95b4-1b7d7fb35ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:51.919938 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6ebeb-9d66-404c-95b4-1b7d7fb35ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:51.971021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-59d6ebeb-9d66-404c-95b4-1b7d7fb35ef4 None None] MFA Rules not processed for user `ed3a61154a444a9cb925839f693208c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:51.972499 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-59d6ebeb-9d66-404c-95b4-1b7d7fb35ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:52.035773 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 682/1375] 10.222.0.24 () {58 vars in 1060 bytes} [Thu May 19 14:57:51 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:57:52.043538 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04003264-5cdb-4b34-9e52-bd17e8ce28cc None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:57:52.055870 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04003264-5cdb-4b34-9e52-bd17e8ce28cc None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:57:52.059536 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4658ba2-f9e5-4411-8944-1d5882163db8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:57:52.060296 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4658ba2-f9e5-4411-8944-1d5882163db8 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:52.060692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4658ba2-f9e5-4411-8944-1d5882163db8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:52.061101 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4658ba2-f9e5-4411-8944-1d5882163db8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:52.071134 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4658ba2-f9e5-4411-8944-1d5882163db8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:57:52.072786 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4658ba2-f9e5-4411-8944-1d5882163db8 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:57:52.082658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 694/1376] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:57:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:57:53.621926 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e0b30-cb88-493c-8a92-f27f564ac777 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:53.622467 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e0b30-cb88-493c-8a92-f27f564ac777 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:53.622467 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e0b30-cb88-493c-8a92-f27f564ac777 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:53.624151 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 683/1377] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:57:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:57:53.630823 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9e437-9d07-442c-9259-4c59a8177186 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:53.631407 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9e437-9d07-442c-9259-4c59a8177186 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:53.631511 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9e437-9d07-442c-9259-4c59a8177186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:53.650279 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-46a9e437-9d07-442c-9259-4c59a8177186 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:53.651645 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-46a9e437-9d07-442c-9259-4c59a8177186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:53.659902 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 695/1378] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:57:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:57:53.704508 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e0b30-cb88-493c-8a92-f27f564ac777 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:57:53.719784 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e0b30-cb88-493c-8a92-f27f564ac777 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:57:53.725549 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911abc0-9e0e-43a1-8df7-7173bdb739e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:57:53.726222 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911abc0-9e0e-43a1-8df7-7173bdb739e2 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:53.726508 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911abc0-9e0e-43a1-8df7-7173bdb739e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:53.726783 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911abc0-9e0e-43a1-8df7-7173bdb739e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:53.735998 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911abc0-9e0e-43a1-8df7-7173bdb739e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:57:53.738206 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911abc0-9e0e-43a1-8df7-7173bdb739e2 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:57:53.749536 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 684/1379] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:57:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:57:56.025571 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bff2a1-d5f0-49d0-ab19-1beb6825ea90 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:56.026107 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bff2a1-d5f0-49d0-ab19-1beb6825ea90 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:56.026107 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bff2a1-d5f0-49d0-ab19-1beb6825ea90 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:56.027428 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 696/1380] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:57:56.033266 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf2f48-511e-4e2a-afac-c259a3c3098c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:56.034191 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf2f48-511e-4e2a-afac-c259a3c3098c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:56.034631 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf2f48-511e-4e2a-afac-c259a3c3098c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:56.053436 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7baf2f48-511e-4e2a-afac-c259a3c3098c None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:56.054769 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7baf2f48-511e-4e2a-afac-c259a3c3098c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:56.063012 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 685/1381] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:57:56.108310 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bff2a1-d5f0-49d0-ab19-1beb6825ea90 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:57:56.124168 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bff2a1-d5f0-49d0-ab19-1beb6825ea90 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:57:56.129910 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc51b8f-595d-410d-b767-ff60f81c13cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:57:56.130683 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc51b8f-595d-410d-b767-ff60f81c13cb service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:56.131070 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc51b8f-595d-410d-b767-ff60f81c13cb service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:56.131491 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc51b8f-595d-410d-b767-ff60f81c13cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:56.141089 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc51b8f-595d-410d-b767-ff60f81c13cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:57:56.142769 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc51b8f-595d-410d-b767-ff60f81c13cb service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:57:56.152912 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 697/1382] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:57:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:57:58.436019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da525c6-243d-44bd-ae10-778084136017 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:58.436544 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da525c6-243d-44bd-ae10-778084136017 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:58.436658 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da525c6-243d-44bd-ae10-778084136017 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:58.437939 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 686/1383] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:57:58.444099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4be707-1c15-467c-a494-18a6ac86d059 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:58.444521 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4be707-1c15-467c-a494-18a6ac86d059 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:58.444705 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4be707-1c15-467c-a494-18a6ac86d059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:58.463089 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-0e4be707-1c15-467c-a494-18a6ac86d059 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:57:58.464522 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0e4be707-1c15-467c-a494-18a6ac86d059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:57:58.472507 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 698/1384] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:57:58.513355 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da525c6-243d-44bd-ae10-778084136017 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:57:58.528274 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da525c6-243d-44bd-ae10-778084136017 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:57:58.533922 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf2a6b-1960-4f39-b3bc-e530f99505f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:57:58.534744 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf2a6b-1960-4f39-b3bc-e530f99505f5 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:57:58.535189 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf2a6b-1960-4f39-b3bc-e530f99505f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:57:58.535653 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf2a6b-1960-4f39-b3bc-e530f99505f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:57:58.544049 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf2a6b-1960-4f39-b3bc-e530f99505f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:57:58.545767 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf2a6b-1960-4f39-b3bc-e530f99505f5 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:57:58.560812 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 687/1385] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:57:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:58:00.829604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13319b3d-9218-45d2-aca7-76ccfc257b5b None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:00.830422 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13319b3d-9218-45d2-aca7-76ccfc257b5b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:00.830422 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13319b3d-9218-45d2-aca7-76ccfc257b5b None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:00.831587 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 699/1386] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:58:00.836866 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb0e68-8011-4fce-987a-7ef44e69b452 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:00.837436 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb0e68-8011-4fce-987a-7ef44e69b452 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:00.837436 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb0e68-8011-4fce-987a-7ef44e69b452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:00.856593 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ccbb0e68-8011-4fce-987a-7ef44e69b452 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:58:00.857740 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ccbb0e68-8011-4fce-987a-7ef44e69b452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:58:00.866877 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 688/1387] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:58:00.912059 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13319b3d-9218-45d2-aca7-76ccfc257b5b None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:58:00.927980 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13319b3d-9218-45d2-aca7-76ccfc257b5b None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:58:00.937991 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fcbef-6e1b-42e6-b518-6aadcd88336e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:58:00.938638 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fcbef-6e1b-42e6-b518-6aadcd88336e service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:00.938918 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fcbef-6e1b-42e6-b518-6aadcd88336e service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:00.939193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fcbef-6e1b-42e6-b518-6aadcd88336e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:00.948790 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fcbef-6e1b-42e6-b518-6aadcd88336e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:58:00.951021 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fcbef-6e1b-42e6-b518-6aadcd88336e service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:58:00.962626 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 700/1388] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:58:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:58:03.510679 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13dc657-a768-4449-9b97-4bd46a0bafbe None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:03.511247 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13dc657-a768-4449-9b97-4bd46a0bafbe None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:03.511340 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13dc657-a768-4449-9b97-4bd46a0bafbe None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:03.512738 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 689/1389] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:58:03.518144 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850fc0c-29f4-4b01-9dcb-bc90c01017b2 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:03.518570 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850fc0c-29f4-4b01-9dcb-bc90c01017b2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:03.518723 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850fc0c-29f4-4b01-9dcb-bc90c01017b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:03.537123 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b850fc0c-29f4-4b01-9dcb-bc90c01017b2 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:58:03.538365 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b850fc0c-29f4-4b01-9dcb-bc90c01017b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:58:03.546506 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 701/1390] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:58:03.591879 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13dc657-a768-4449-9b97-4bd46a0bafbe None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:58:03.609134 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13dc657-a768-4449-9b97-4bd46a0bafbe None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:58:03.616748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e9083-c894-4b1c-ba85-688c976e84b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:58:03.617602 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e9083-c894-4b1c-ba85-688c976e84b1 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:03.617969 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e9083-c894-4b1c-ba85-688c976e84b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:03.618343 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e9083-c894-4b1c-ba85-688c976e84b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:03.629137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e9083-c894-4b1c-ba85-688c976e84b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:58:03.630809 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e9083-c894-4b1c-ba85-688c976e84b1 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:58:03.640979 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 690/1391] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:58:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:58:05.914132 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460a0f7-632c-41f9-9621-3f572cd56f79 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:05.914846 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460a0f7-632c-41f9-9621-3f572cd56f79 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:05.914846 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460a0f7-632c-41f9-9621-3f572cd56f79 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:05.916226 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 702/1392] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:58:05.921973 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7f7de-a9ca-4baa-b899-3d1898a213f5 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:05.922424 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7f7de-a9ca-4baa-b899-3d1898a213f5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:05.922573 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7f7de-a9ca-4baa-b899-3d1898a213f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:05.941100 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-5dd7f7de-a9ca-4baa-b899-3d1898a213f5 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:58:05.942294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5dd7f7de-a9ca-4baa-b899-3d1898a213f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:58:05.950147 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 691/1393] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:58:05.994335 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460a0f7-632c-41f9-9621-3f572cd56f79 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:58:06.008893 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460a0f7-632c-41f9-9621-3f572cd56f79 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:58:06.014223 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e8d6b-7bc6-4f37-890f-6c6cacd87c43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:58:06.014859 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e8d6b-7bc6-4f37-890f-6c6cacd87c43 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:06.015261 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e8d6b-7bc6-4f37-890f-6c6cacd87c43 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:06.015543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e8d6b-7bc6-4f37-890f-6c6cacd87c43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:06.023716 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e8d6b-7bc6-4f37-890f-6c6cacd87c43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:58:06.025285 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e8d6b-7bc6-4f37-890f-6c6cacd87c43 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:58:06.036133 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 703/1394] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:58:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:58:07.848178 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce0d41-0be4-471e-a4ec-c16839b04579 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:07.848748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce0d41-0be4-471e-a4ec-c16839b04579 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:07.849209 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce0d41-0be4-471e-a4ec-c16839b04579 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:07.851728 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 692/1395] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:58:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:58:07.857270 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae5915-8189-4922-acab-2ddf7139ac3e None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:07.857756 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae5915-8189-4922-acab-2ddf7139ac3e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:07.857903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae5915-8189-4922-acab-2ddf7139ac3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:07.864148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=52 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:58:07.878113 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e3ae5915-8189-4922-acab-2ddf7139ac3e None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:58:07.879321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e3ae5915-8189-4922-acab-2ddf7139ac3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:58:07.886941 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 704/1396] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:58:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 14:58:07.942897 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee1deb-8d7d-4695-a0e4-d9f8a20c0261 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:07.943192 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee1deb-8d7d-4695-a0e4-d9f8a20c0261 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:07.943511 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee1deb-8d7d-4695-a0e4-d9f8a20c0261 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:07.945002 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 693/1397] 10.222.0.24 () {54 vars in 962 bytes} [Thu May 19 14:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:58:07.949732 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d66f0-41c2-4870-b2a2-40d31cb8df15 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:07.950018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d66f0-41c2-4870-b2a2-40d31cb8df15 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:07.950295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d66f0-41c2-4870-b2a2-40d31cb8df15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:07.999681 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-252d66f0-41c2-4870-b2a2-40d31cb8df15 None None] MFA Rules not processed for user `b1dc1d74631b4d69a3094e4e1e2a0ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:58:08.000886 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-252d66f0-41c2-4870-b2a2-40d31cb8df15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:58:08.061239 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 705/1398] 10.222.0.24 () {58 vars in 1059 bytes} [Thu May 19 14:58:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:58:08.068736 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee1deb-8d7d-4695-a0e4-d9f8a20c0261 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:58:08.079540 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee1deb-8d7d-4695-a0e4-d9f8a20c0261 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:58:08.083641 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ba14d-d56a-4219-baf5-f11a924c4b78 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1dc1d74631b4d69a3094e4e1e2a0ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:58:08.084351 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ba14d-d56a-4219-baf5-f11a924c4b78 service glance] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:08.084711 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ba14d-d56a-4219-baf5-f11a924c4b78 service glance] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:08.085061 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ba14d-d56a-4219-baf5-f11a924c4b78 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:08.094095 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ba14d-d56a-4219-baf5-f11a924c4b78 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:58:08.095651 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ba14d-d56a-4219-baf5-f11a924c4b78 service glance] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:58:08.105955 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 694/1399] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:58:08.305713 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef14fc-b1bd-4eae-962d-6da2396c3694 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:08.306031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef14fc-b1bd-4eae-962d-6da2396c3694 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:08.306315 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef14fc-b1bd-4eae-962d-6da2396c3694 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:08.307865 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 706/1400] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:58:08.317804 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330351e9-687e-4a49-b9a0-c5e18063c589 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:08.319111 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330351e9-687e-4a49-b9a0-c5e18063c589 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:08.319271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330351e9-687e-4a49-b9a0-c5e18063c589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:08.346429 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-330351e9-687e-4a49-b9a0-c5e18063c589 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:58:08.347695 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-330351e9-687e-4a49-b9a0-c5e18063c589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:58:08.355631 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 695/1401] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:58:08.401958 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef14fc-b1bd-4eae-962d-6da2396c3694 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:58:08.416471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef14fc-b1bd-4eae-962d-6da2396c3694 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:58:08.421871 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc40d5b-c407-467c-9ff7-20751e8e183d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:58:08.422534 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc40d5b-c407-467c-9ff7-20751e8e183d service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:08.422816 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc40d5b-c407-467c-9ff7-20751e8e183d service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:08.423093 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc40d5b-c407-467c-9ff7-20751e8e183d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:08.435352 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc40d5b-c407-467c-9ff7-20751e8e183d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:58:08.437171 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc40d5b-c407-467c-9ff7-20751e8e183d service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:58:08.447139 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 707/1402] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:58:08.668415 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b38d2e-0223-4c41-bbca-19ad94177692 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:08.668714 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b38d2e-0223-4c41-bbca-19ad94177692 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:08.668990 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b38d2e-0223-4c41-bbca-19ad94177692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:08.716973 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-76b38d2e-0223-4c41-bbca-19ad94177692 None None] MFA Rules not processed for user `fcd1725924134616b903b3e374d45817`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:58:08.718183 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-76b38d2e-0223-4c41-bbca-19ad94177692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:58:08.730297 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:58:08.780642 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 696/1403] 10.222.0.24 () {58 vars in 1009 bytes} [Thu May 19 14:58:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:58:08.824623 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59d789-6580-470b-a9ee-2f3f2df82a41 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:08.824964 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59d789-6580-470b-a9ee-2f3f2df82a41 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:08.825243 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59d789-6580-470b-a9ee-2f3f2df82a41 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:08.826739 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 708/1404] 10.222.0.24 () {54 vars in 942 bytes} [Thu May 19 14:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:58:08.835415 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34928dcb-6a9c-4274-ac63-5edff5d2c7a8 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:08.835775 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34928dcb-6a9c-4274-ac63-5edff5d2c7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:08.836122 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34928dcb-6a9c-4274-ac63-5edff5d2c7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:08.886391 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-34928dcb-6a9c-4274-ac63-5edff5d2c7a8 None None] MFA Rules not processed for user `8ecbeee0c1cf4c58be6c22aa11d7ff5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:58:08.887723 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-34928dcb-6a9c-4274-ac63-5edff5d2c7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:58:08.958238 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 697/1405] 10.222.0.24 () {58 vars in 1039 bytes} [Thu May 19 14:58:08 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:58:08.967386 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e59d789-6580-470b-a9ee-2f3f2df82a41 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:58:08.980739 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e59d789-6580-470b-a9ee-2f3f2df82a41 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:58:08.985637 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556f0a2-afdf-40e6-a318-b174c7c9b02e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecbeee0c1cf4c58be6c22aa11d7ff5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:58:08.986538 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556f0a2-afdf-40e6-a318-b174c7c9b02e service swift] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:08.986984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556f0a2-afdf-40e6-a318-b174c7c9b02e service swift] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:08.987292 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556f0a2-afdf-40e6-a318-b174c7c9b02e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:08.995596 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556f0a2-afdf-40e6-a318-b174c7c9b02e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:58:08.997181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556f0a2-afdf-40e6-a318-b174c7c9b02e service swift] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:58:09.005848 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 709/1406] 10.222.0.24 () {60 vars in 1384 bytes} [Thu May 19 14:58:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 14:58:10.704086 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71af01-2371-44ff-bce3-d9ff34558b34 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:10.704654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71af01-2371-44ff-bce3-d9ff34558b34 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:10.704654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71af01-2371-44ff-bce3-d9ff34558b34 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:10.706044 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 698/1407] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:58:10.711298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c656ae2-0953-4b60-8c31-79ca02a53f3e None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:10.711702 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c656ae2-0953-4b60-8c31-79ca02a53f3e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:10.711967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c656ae2-0953-4b60-8c31-79ca02a53f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:10.730819 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-6c656ae2-0953-4b60-8c31-79ca02a53f3e None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:58:10.732157 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6c656ae2-0953-4b60-8c31-79ca02a53f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:58:10.750807 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 710/1408] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 14:58:10.797068 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71af01-2371-44ff-bce3-d9ff34558b34 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:58:10.814487 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e71af01-2371-44ff-bce3-d9ff34558b34 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:58:10.828904 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdaeaa-b65e-4cde-8a57-c01e8bf84b20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:58:10.829324 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdaeaa-b65e-4cde-8a57-c01e8bf84b20 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:10.829649 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdaeaa-b65e-4cde-8a57-c01e8bf84b20 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:10.829934 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdaeaa-b65e-4cde-8a57-c01e8bf84b20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:10.861824 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cdaeaa-b65e-4cde-8a57-c01e8bf84b20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:58:10.863903 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cdaeaa-b65e-4cde-8a57-c01e8bf84b20 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:58:10.877086 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 699/1409] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:58:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:58:20.725673 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=55 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:58:20.871094 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=71 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:58:32.799065 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634ed81-4802-4565-83cb-1a44e8337a5d None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:32.799767 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634ed81-4802-4565-83cb-1a44e8337a5d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:32.799767 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634ed81-4802-4565-83cb-1a44e8337a5d None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:32.801015 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 711/1410] 10.222.0.24 () {54 vars in 918 bytes} [Thu May 19 14:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:58:32.806101 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68a0ad-58e3-44bd-8445-9cbe8e266737 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:32.806544 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68a0ad-58e3-44bd-8445-9cbe8e266737 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:32.806652 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68a0ad-58e3-44bd-8445-9cbe8e266737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:32.824150 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8b68a0ad-58e3-44bd-8445-9cbe8e266737 None None] MFA Rules not processed for user `adec680c4f5f4e6dbe5989d5d7acf620`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:58:32.825335 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8b68a0ad-58e3-44bd-8445-9cbe8e266737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:58:32.834259 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 700/1411] 10.222.0.24 () {58 vars in 1015 bytes} [Thu May 19 14:58:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:58:32.848651 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787b2eb-b602-4227-97b7-8b07c0104e9d None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:32.848939 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787b2eb-b602-4227-97b7-8b07c0104e9d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:32.849214 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787b2eb-b602-4227-97b7-8b07c0104e9d None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:32.850545 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 712/1412] 10.222.0.24 () {54 vars in 918 bytes} [Thu May 19 14:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:58:32.854912 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a3322-4753-46e8-ab21-33fcfdec9141 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:32.855230 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a3322-4753-46e8-ab21-33fcfdec9141 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:32.855518 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a3322-4753-46e8-ab21-33fcfdec9141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:32.873289 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-cc3a3322-4753-46e8-ab21-33fcfdec9141 None None] MFA Rules not processed for user `06fb8bb5aeb143ad95f33c3b43dbd346`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:58:32.874461 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-cc3a3322-4753-46e8-ab21-33fcfdec9141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:58:32.883893 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 701/1413] 10.222.0.24 () {58 vars in 1015 bytes} [Thu May 19 14:58:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:58:35.562498 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856ad52-0ab0-4c11-8b53-d60120459146 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:35.563057 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856ad52-0ab0-4c11-8b53-d60120459146 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:35.563057 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856ad52-0ab0-4c11-8b53-d60120459146 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:35.565146 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 14:58:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 14:58:35.570410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349ff90-1d7a-4b76-bd18-dfef5374e3a3 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:35.570841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349ff90-1d7a-4b76-bd18-dfef5374e3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:35.570948 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349ff90-1d7a-4b76-bd18-dfef5374e3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:35.588288 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9349ff90-1d7a-4b76-bd18-dfef5374e3a3 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:58:35.589516 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9349ff90-1d7a-4b76-bd18-dfef5374e3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:58:35.597210 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 14:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:58:35.640720 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856ad52-0ab0-4c11-8b53-d60120459146 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:58:35.654363 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856ad52-0ab0-4c11-8b53-d60120459146 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:58:35.659667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e406f9-bd03-4d75-a749-f5cd5202a95b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:58:35.660286 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e406f9-bd03-4d75-a749-f5cd5202a95b service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:35.660562 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e406f9-bd03-4d75-a749-f5cd5202a95b service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:35.660831 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e406f9-bd03-4d75-a749-f5cd5202a95b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:35.668677 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e406f9-bd03-4d75-a749-f5cd5202a95b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:58:35.670232 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e406f9-bd03-4d75-a749-f5cd5202a95b service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:58:35.679816 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 714/1416] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:58:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:58:36.664413 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fe743-3df8-42f0-8b98-d92cbb9ce164 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:36.664958 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fe743-3df8-42f0-8b98-d92cbb9ce164 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:36.664958 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fe743-3df8-42f0-8b98-d92cbb9ce164 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:36.666393 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 14:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:58:36.671137 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e93b7-0251-432b-9d7b-b68d71672832 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:36.671606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e93b7-0251-432b-9d7b-b68d71672832 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:36.671713 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e93b7-0251-432b-9d7b-b68d71672832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:36.689804 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b08e93b7-0251-432b-9d7b-b68d71672832 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:58:36.690976 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b08e93b7-0251-432b-9d7b-b68d71672832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:58:36.698571 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 14:58:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 14:58:36.871173 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fe743-3df8-42f0-8b98-d92cbb9ce164 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:58:36.885633 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fe743-3df8-42f0-8b98-d92cbb9ce164 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:58:36.890974 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59242cd1-4959-4611-9652-a7a3b8cc52c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:58:36.891656 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59242cd1-4959-4611-9652-a7a3b8cc52c2 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:36.891950 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59242cd1-4959-4611-9652-a7a3b8cc52c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:36.892233 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59242cd1-4959-4611-9652-a7a3b8cc52c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:36.900201 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59242cd1-4959-4611-9652-a7a3b8cc52c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:58:36.901796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59242cd1-4959-4611-9652-a7a3b8cc52c2 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:58:36.911624 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 704/1419] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:58:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:58:37.859521 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58373e37-8c22-456d-8d87-3ac3e7097b79 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:37.860105 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58373e37-8c22-456d-8d87-3ac3e7097b79 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:37.860105 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58373e37-8c22-456d-8d87-3ac3e7097b79 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:37.861933 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 14:58:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:58:37.866666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93affe2b-5b5b-42ad-a7f7-91b36a937cad None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:37.867111 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93affe2b-5b5b-42ad-a7f7-91b36a937cad None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:37.867272 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93affe2b-5b5b-42ad-a7f7-91b36a937cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:37.885789 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-93affe2b-5b5b-42ad-a7f7-91b36a937cad None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:58:37.886993 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-93affe2b-5b5b-42ad-a7f7-91b36a937cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:58:37.894782 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 14:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:58:38.042181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58373e37-8c22-456d-8d87-3ac3e7097b79 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:58:38.057492 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58373e37-8c22-456d-8d87-3ac3e7097b79 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:58:38.062902 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b7182-4522-4254-a321-fe1ac498dbfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:58:38.063567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b7182-4522-4254-a321-fe1ac498dbfb service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:38.064465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b7182-4522-4254-a321-fe1ac498dbfb service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:38.064745 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b7182-4522-4254-a321-fe1ac498dbfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:38.072979 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b7182-4522-4254-a321-fe1ac498dbfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:58:38.074554 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b7182-4522-4254-a321-fe1ac498dbfb service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:58:38.083911 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 717/1422] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:58:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:58:39.008844 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a99d64-b316-4e4f-82d8-80062608f58e None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:39.009294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a99d64-b316-4e4f-82d8-80062608f58e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:39.009419 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a99d64-b316-4e4f-82d8-80062608f58e None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:39.010842 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 14:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:58:39.015734 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d21447-bb3d-4bc0-8978-dc260b8a5fb4 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:39.016169 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d21447-bb3d-4bc0-8978-dc260b8a5fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:39.016326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d21447-bb3d-4bc0-8978-dc260b8a5fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:39.040633 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-55d21447-bb3d-4bc0-8978-dc260b8a5fb4 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:58:39.041849 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-55d21447-bb3d-4bc0-8978-dc260b8a5fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:58:39.051637 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 14:58:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:58:39.199997 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a99d64-b316-4e4f-82d8-80062608f58e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:58:39.214704 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a99d64-b316-4e4f-82d8-80062608f58e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:58:39.220070 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16608d-5b64-47fe-b548-71c68648c3fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:58:39.220717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16608d-5b64-47fe-b548-71c68648c3fb service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:39.221005 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16608d-5b64-47fe-b548-71c68648c3fb service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:39.221289 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16608d-5b64-47fe-b548-71c68648c3fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:39.229342 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16608d-5b64-47fe-b548-71c68648c3fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:58:39.230868 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16608d-5b64-47fe-b548-71c68648c3fb service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:58:39.240583 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 707/1425] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:58:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:58:40.181856 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67485bf-f14a-46e5-a2c6-3c534bce73bb None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:40.182397 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67485bf-f14a-46e5-a2c6-3c534bce73bb None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:40.182397 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67485bf-f14a-46e5-a2c6-3c534bce73bb None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:40.183816 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 14:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:58:40.188708 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0754c2f-ee16-486b-b162-c4a7c9f22b5c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:40.189140 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0754c2f-ee16-486b-b162-c4a7c9f22b5c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:40.189285 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0754c2f-ee16-486b-b162-c4a7c9f22b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:40.207374 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e0754c2f-ee16-486b-b162-c4a7c9f22b5c None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:58:40.208573 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e0754c2f-ee16-486b-b162-c4a7c9f22b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:58:40.216270 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 14:58:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:58:40.366772 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67485bf-f14a-46e5-a2c6-3c534bce73bb None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:58:40.381644 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67485bf-f14a-46e5-a2c6-3c534bce73bb None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:58:40.387542 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3adad-8d73-45f7-9c64-e732e0f05983 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:58:40.388210 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3adad-8d73-45f7-9c64-e732e0f05983 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:40.388496 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3adad-8d73-45f7-9c64-e732e0f05983 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:40.388780 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3adad-8d73-45f7-9c64-e732e0f05983 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:40.397552 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3adad-8d73-45f7-9c64-e732e0f05983 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:58:40.399124 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3adad-8d73-45f7-9c64-e732e0f05983 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:58:40.408416 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 720/1428] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:58:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:58:41.274160 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574954a5-c3d0-42f7-891e-2f74e7fb8ccd None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:41.274682 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574954a5-c3d0-42f7-891e-2f74e7fb8ccd None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:41.274682 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574954a5-c3d0-42f7-891e-2f74e7fb8ccd None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:41.276084 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 14:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:58:41.280957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d50d2b-bb42-4c4b-a8c3-ce52562487b4 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:41.281424 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d50d2b-bb42-4c4b-a8c3-ce52562487b4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:41.281549 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d50d2b-bb42-4c4b-a8c3-ce52562487b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:41.300591 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f0d50d2b-bb42-4c4b-a8c3-ce52562487b4 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:58:41.301790 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f0d50d2b-bb42-4c4b-a8c3-ce52562487b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:58:41.309442 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 14:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:58:41.464685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574954a5-c3d0-42f7-891e-2f74e7fb8ccd None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:58:41.479546 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574954a5-c3d0-42f7-891e-2f74e7fb8ccd None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:58:41.484914 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924fc5f-3a35-4899-b4b8-424aecbd1eb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:58:41.486139 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924fc5f-3a35-4899-b4b8-424aecbd1eb8 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:41.486438 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924fc5f-3a35-4899-b4b8-424aecbd1eb8 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:41.486725 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924fc5f-3a35-4899-b4b8-424aecbd1eb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:41.494709 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924fc5f-3a35-4899-b4b8-424aecbd1eb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:58:41.496593 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924fc5f-3a35-4899-b4b8-424aecbd1eb8 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:58:41.505708 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 710/1431] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:58:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:58:42.377222 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f371a9-882f-411a-b9eb-da8bf585c21a None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:42.377762 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f371a9-882f-411a-b9eb-da8bf585c21a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:42.377762 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f371a9-882f-411a-b9eb-da8bf585c21a None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:42.379138 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 14:58:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:58:42.383976 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fab7c-4ee4-4c56-b0e4-496f9096ea4e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:42.384419 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fab7c-4ee4-4c56-b0e4-496f9096ea4e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:42.384534 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fab7c-4ee4-4c56-b0e4-496f9096ea4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:42.402211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-da4fab7c-4ee4-4c56-b0e4-496f9096ea4e None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:58:42.403442 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-da4fab7c-4ee4-4c56-b0e4-496f9096ea4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:58:42.411282 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 14:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:58:42.560392 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f371a9-882f-411a-b9eb-da8bf585c21a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:58:42.575125 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f371a9-882f-411a-b9eb-da8bf585c21a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:58:42.580462 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c684c-9154-43cc-856f-09974cf51c5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:58:42.581090 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c684c-9154-43cc-856f-09974cf51c5f service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:42.581371 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c684c-9154-43cc-856f-09974cf51c5f service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:42.581649 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c684c-9154-43cc-856f-09974cf51c5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:42.589550 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c684c-9154-43cc-856f-09974cf51c5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:58:42.591157 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c684c-9154-43cc-856f-09974cf51c5f service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:58:42.600798 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 723/1434] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:58:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:58:43.468364 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce92fa-cc40-4c66-9140-b347272298c3 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:43.468932 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce92fa-cc40-4c66-9140-b347272298c3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:43.468932 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce92fa-cc40-4c66-9140-b347272298c3 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:43.470352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 14:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:58:43.475253 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11867de-b997-4f8c-9cd4-ecd8f6f88683 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:43.475669 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11867de-b997-4f8c-9cd4-ecd8f6f88683 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:43.475821 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11867de-b997-4f8c-9cd4-ecd8f6f88683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:43.493630 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b11867de-b997-4f8c-9cd4-ecd8f6f88683 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:58:43.494806 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b11867de-b997-4f8c-9cd4-ecd8f6f88683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:58:43.503454 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 14:58:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:58:43.650053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce92fa-cc40-4c66-9140-b347272298c3 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:58:43.664056 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce92fa-cc40-4c66-9140-b347272298c3 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:58:43.669399 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318193f1-b7d8-40d8-b960-6f20813c2891 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:58:43.670030 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318193f1-b7d8-40d8-b960-6f20813c2891 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:43.670318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318193f1-b7d8-40d8-b960-6f20813c2891 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:43.670598 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318193f1-b7d8-40d8-b960-6f20813c2891 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:43.678403 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318193f1-b7d8-40d8-b960-6f20813c2891 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:58:43.680021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318193f1-b7d8-40d8-b960-6f20813c2891 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:58:43.689596 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 713/1437] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:58:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:58:44.568025 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e760dc-e3ee-4217-a905-eeb3758f82ac None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:44.568577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e760dc-e3ee-4217-a905-eeb3758f82ac None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:44.568577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e760dc-e3ee-4217-a905-eeb3758f82ac None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:44.569867 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 14:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:58:44.574649 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92245fc1-a77c-4f41-a7a0-d3085da643d9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:44.575020 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92245fc1-a77c-4f41-a7a0-d3085da643d9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:44.575255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92245fc1-a77c-4f41-a7a0-d3085da643d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:44.594235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-92245fc1-a77c-4f41-a7a0-d3085da643d9 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:58:44.595465 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-92245fc1-a77c-4f41-a7a0-d3085da643d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:58:44.603825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 14:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:58:44.757593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e760dc-e3ee-4217-a905-eeb3758f82ac None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:58:44.772646 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e760dc-e3ee-4217-a905-eeb3758f82ac None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:58:44.777961 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eba761-8c2b-49b7-908a-16cc12298b4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:58:44.778591 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eba761-8c2b-49b7-908a-16cc12298b4e service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:44.778874 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eba761-8c2b-49b7-908a-16cc12298b4e service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:44.779149 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eba761-8c2b-49b7-908a-16cc12298b4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:44.787754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eba761-8c2b-49b7-908a-16cc12298b4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:58:44.789319 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eba761-8c2b-49b7-908a-16cc12298b4e service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:58:44.798467 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 726/1440] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:58:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:58:46.884173 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127de06-5918-44e7-a0ea-2362333847fe None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:46.884772 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127de06-5918-44e7-a0ea-2362333847fe None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:46.884772 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127de06-5918-44e7-a0ea-2362333847fe None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:46.886117 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 14:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:58:46.891328 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb97343-b632-4a69-8b77-0612284374ab None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:46.891766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb97343-b632-4a69-8b77-0612284374ab None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:46.891872 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb97343-b632-4a69-8b77-0612284374ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:46.909138 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9cb97343-b632-4a69-8b77-0612284374ab None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:58:46.910351 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9cb97343-b632-4a69-8b77-0612284374ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:58:46.918035 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 14:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:58:46.956243 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127de06-5918-44e7-a0ea-2362333847fe None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:58:46.966774 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127de06-5918-44e7-a0ea-2362333847fe None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:58:46.970263 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3758b-c79b-4e21-be97-fccb7f9652fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:58:46.970886 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3758b-c79b-4e21-be97-fccb7f9652fa service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:46.971210 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3758b-c79b-4e21-be97-fccb7f9652fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:46.971499 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3758b-c79b-4e21-be97-fccb7f9652fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:46.988221 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3758b-c79b-4e21-be97-fccb7f9652fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:58:46.989872 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3758b-c79b-4e21-be97-fccb7f9652fa service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:58:47.000599 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 716/1443] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:58:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:58:49.410541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f6c98-c823-4b50-8052-7d274acfb77a None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:49.411074 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f6c98-c823-4b50-8052-7d274acfb77a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:49.411074 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f6c98-c823-4b50-8052-7d274acfb77a None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:49.412496 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 14:58:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:58:49.417952 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4686672-e1c4-441a-a050-9222127c8948 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:49.418391 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4686672-e1c4-441a-a050-9222127c8948 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:49.418519 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4686672-e1c4-441a-a050-9222127c8948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:49.435848 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c4686672-e1c4-441a-a050-9222127c8948 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:58:49.437065 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c4686672-e1c4-441a-a050-9222127c8948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:58:49.444791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 14:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:58:49.482596 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f6c98-c823-4b50-8052-7d274acfb77a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:58:49.493087 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f6c98-c823-4b50-8052-7d274acfb77a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:58:49.496852 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7936e7-0b0c-4456-87bb-c14362c88b53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:58:49.497479 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7936e7-0b0c-4456-87bb-c14362c88b53 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:49.497764 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7936e7-0b0c-4456-87bb-c14362c88b53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:49.498039 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7936e7-0b0c-4456-87bb-c14362c88b53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:49.506766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7936e7-0b0c-4456-87bb-c14362c88b53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:58:49.508221 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7936e7-0b0c-4456-87bb-c14362c88b53 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:58:49.517425 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 729/1446] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:58:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 14:58:52.067606 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca987f-d8e1-44c7-8281-f28ab17d1ae6 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:52.068174 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca987f-d8e1-44c7-8281-f28ab17d1ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:52.068174 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca987f-d8e1-44c7-8281-f28ab17d1ae6 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:52.069574 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 14:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:58:52.074807 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e1c8f-5ea3-4b47-837b-4fbd339ea194 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:52.075228 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e1c8f-5ea3-4b47-837b-4fbd339ea194 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:52.075413 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e1c8f-5ea3-4b47-837b-4fbd339ea194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:52.093306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7e2e1c8f-5ea3-4b47-837b-4fbd339ea194 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:58:52.094507 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7e2e1c8f-5ea3-4b47-837b-4fbd339ea194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:58:52.102757 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 14:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:58:52.141276 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca987f-d8e1-44c7-8281-f28ab17d1ae6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:58:52.151959 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca987f-d8e1-44c7-8281-f28ab17d1ae6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:58:52.155474 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371c863-bbc2-4b28-b76b-56b2c4a9b249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:58:52.156112 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371c863-bbc2-4b28-b76b-56b2c4a9b249 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:52.156397 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371c863-bbc2-4b28-b76b-56b2c4a9b249 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:52.156676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371c863-bbc2-4b28-b76b-56b2c4a9b249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:52.166034 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371c863-bbc2-4b28-b76b-56b2c4a9b249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:58:52.167486 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371c863-bbc2-4b28-b76b-56b2c4a9b249 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:58:52.177336 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 719/1449] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:58:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:58:54.490517 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69854355-92d1-4d18-8c7e-5a14da5dc815 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:54.491108 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69854355-92d1-4d18-8c7e-5a14da5dc815 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:54.491108 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69854355-92d1-4d18-8c7e-5a14da5dc815 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:54.492473 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 14:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:58:54.498122 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe42408-1fb4-454f-bcde-82afd307c858 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:54.498549 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe42408-1fb4-454f-bcde-82afd307c858 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:54.498690 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe42408-1fb4-454f-bcde-82afd307c858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:54.516156 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-3fe42408-1fb4-454f-bcde-82afd307c858 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:58:54.517347 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3fe42408-1fb4-454f-bcde-82afd307c858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:58:54.525233 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 14:58:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:58:54.563857 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69854355-92d1-4d18-8c7e-5a14da5dc815 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:58:54.574527 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69854355-92d1-4d18-8c7e-5a14da5dc815 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:58:54.578058 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486d7b8-0237-43cd-b8f0-9a40548a7ecd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:58:54.578691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486d7b8-0237-43cd-b8f0-9a40548a7ecd service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:54.578977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486d7b8-0237-43cd-b8f0-9a40548a7ecd service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:54.579282 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486d7b8-0237-43cd-b8f0-9a40548a7ecd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:54.588523 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486d7b8-0237-43cd-b8f0-9a40548a7ecd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:58:54.589952 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486d7b8-0237-43cd-b8f0-9a40548a7ecd service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:58:54.601195 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 732/1452] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:58:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:58:56.897164 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e1f3d-4289-4aaa-92f5-f5d09de61bfb None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:56.897753 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e1f3d-4289-4aaa-92f5-f5d09de61bfb None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:56.897753 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e1f3d-4289-4aaa-92f5-f5d09de61bfb None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:56.899094 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 14:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:58:56.904487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973e221-f380-4964-a7f5-6b51d4b5d955 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:56.904927 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973e221-f380-4964-a7f5-6b51d4b5d955 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:56.905055 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973e221-f380-4964-a7f5-6b51d4b5d955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:56.922689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-3973e221-f380-4964-a7f5-6b51d4b5d955 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:58:56.924035 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3973e221-f380-4964-a7f5-6b51d4b5d955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:58:56.932280 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 14:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:58:56.970594 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e1f3d-4289-4aaa-92f5-f5d09de61bfb None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:58:56.981273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e1f3d-4289-4aaa-92f5-f5d09de61bfb None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:58:56.984768 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63ac15-bd64-421d-9068-9b0e4858391b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:58:56.985442 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63ac15-bd64-421d-9068-9b0e4858391b service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:56.985727 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63ac15-bd64-421d-9068-9b0e4858391b service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:56.986006 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63ac15-bd64-421d-9068-9b0e4858391b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:56.995439 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba63ac15-bd64-421d-9068-9b0e4858391b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:58:56.997124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba63ac15-bd64-421d-9068-9b0e4858391b service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:58:57.006853 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 722/1455] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:58:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:58:59.290591 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52d412-b7c7-454d-9e7c-4dbf6c6af9ca None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:59.291111 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52d412-b7c7-454d-9e7c-4dbf6c6af9ca None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:59.291111 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52d412-b7c7-454d-9e7c-4dbf6c6af9ca None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:59.292457 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 14:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:58:59.297659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453cbb4a-c1ef-4bea-a3a0-b058361cb99c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:59.298053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453cbb4a-c1ef-4bea-a3a0-b058361cb99c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:59.298225 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453cbb4a-c1ef-4bea-a3a0-b058361cb99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:59.315963 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-453cbb4a-c1ef-4bea-a3a0-b058361cb99c None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:58:59.317004 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-453cbb4a-c1ef-4bea-a3a0-b058361cb99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:58:59.325328 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 14:58:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:58:59.363997 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52d412-b7c7-454d-9e7c-4dbf6c6af9ca None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:58:59.374920 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52d412-b7c7-454d-9e7c-4dbf6c6af9ca None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:58:59.378428 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde618a-7727-4e50-9ee7-ae6522bc82f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:58:59.379051 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde618a-7727-4e50-9ee7-ae6522bc82f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:58:59.379366 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde618a-7727-4e50-9ee7-ae6522bc82f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:58:59.379639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde618a-7727-4e50-9ee7-ae6522bc82f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:58:59.388296 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cde618a-7727-4e50-9ee7-ae6522bc82f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:58:59.389700 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cde618a-7727-4e50-9ee7-ae6522bc82f2 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:58:59.400195 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 735/1458] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:58:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:59:01.662904 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297c25c-4f61-4dff-99b6-8a3342980a6b None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:01.663467 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297c25c-4f61-4dff-99b6-8a3342980a6b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:01.663581 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297c25c-4f61-4dff-99b6-8a3342980a6b None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:01.664890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 14:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:59:01.670237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b68e5f-1938-40ff-9f0b-44d10c2e9446 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:01.670659 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b68e5f-1938-40ff-9f0b-44d10c2e9446 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:01.670795 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b68e5f-1938-40ff-9f0b-44d10c2e9446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:01.677287 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=70 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:59:01.691029 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-82b68e5f-1938-40ff-9f0b-44d10c2e9446 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:59:01.692246 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-82b68e5f-1938-40ff-9f0b-44d10c2e9446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:59:01.699940 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 14:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:59:01.736498 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297c25c-4f61-4dff-99b6-8a3342980a6b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:59:01.742418 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=73 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:59:01.749147 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297c25c-4f61-4dff-99b6-8a3342980a6b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:59:01.752757 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee3219-5f72-47f4-964d-4b75dfc6449e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:59:01.753404 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee3219-5f72-47f4-964d-4b75dfc6449e service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:01.753692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee3219-5f72-47f4-964d-4b75dfc6449e service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:01.753970 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee3219-5f72-47f4-964d-4b75dfc6449e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:01.762784 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee3219-5f72-47f4-964d-4b75dfc6449e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:59:01.764267 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee3219-5f72-47f4-964d-4b75dfc6449e service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:59:01.773492 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 725/1461] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:59:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:59:04.040409 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93393707-f7f0-4836-ab6f-30527f7a455c None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:04.040979 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93393707-f7f0-4836-ab6f-30527f7a455c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:04.041146 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93393707-f7f0-4836-ab6f-30527f7a455c None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:04.043034 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 14:59:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:59:04.048588 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b134b2f-534d-4b2a-892b-d3ce88891d65 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:04.049052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b134b2f-534d-4b2a-892b-d3ce88891d65 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:04.050077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b134b2f-534d-4b2a-892b-d3ce88891d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:04.067475 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8b134b2f-534d-4b2a-892b-d3ce88891d65 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:59:04.068674 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8b134b2f-534d-4b2a-892b-d3ce88891d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:59:04.076756 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 14:59:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:59:04.114784 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93393707-f7f0-4836-ab6f-30527f7a455c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:59:04.125429 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93393707-f7f0-4836-ab6f-30527f7a455c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:59:04.128916 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0e90c-f337-435d-bda7-ce348209679d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:59:04.129541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0e90c-f337-435d-bda7-ce348209679d service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:04.129823 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0e90c-f337-435d-bda7-ce348209679d service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:04.130095 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0e90c-f337-435d-bda7-ce348209679d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:04.138711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0e90c-f337-435d-bda7-ce348209679d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:59:04.140230 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0e90c-f337-435d-bda7-ce348209679d service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:59:04.149461 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 738/1464] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:59:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:59:06.351349 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f307be9-5d32-4ac5-a0e3-98aa62a1621f None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:06.351848 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f307be9-5d32-4ac5-a0e3-98aa62a1621f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:06.351946 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f307be9-5d32-4ac5-a0e3-98aa62a1621f None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:06.353321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 14:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:59:06.358769 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27083484-6e23-4fa5-a6e5-2abe5bba91f0 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:06.359241 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27083484-6e23-4fa5-a6e5-2abe5bba91f0 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:06.359357 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27083484-6e23-4fa5-a6e5-2abe5bba91f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:06.377571 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-27083484-6e23-4fa5-a6e5-2abe5bba91f0 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:59:06.378762 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-27083484-6e23-4fa5-a6e5-2abe5bba91f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:59:06.386561 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 14:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:59:06.422050 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f307be9-5d32-4ac5-a0e3-98aa62a1621f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:59:06.432662 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f307be9-5d32-4ac5-a0e3-98aa62a1621f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:59:06.436182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de485615-68c0-4896-8661-3fdd78580e0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:59:06.436816 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de485615-68c0-4896-8661-3fdd78580e0e service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:06.437104 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de485615-68c0-4896-8661-3fdd78580e0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:06.437381 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de485615-68c0-4896-8661-3fdd78580e0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:06.446562 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de485615-68c0-4896-8661-3fdd78580e0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:59:06.448037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de485615-68c0-4896-8661-3fdd78580e0e service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:59:06.457860 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 728/1467] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:59:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:59:08.646501 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00c4be-73b0-4971-b8be-27f329d98ffd None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:08.647042 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00c4be-73b0-4971-b8be-27f329d98ffd None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:08.647042 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00c4be-73b0-4971-b8be-27f329d98ffd None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:08.648377 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 14:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:59:08.653580 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc0882-b103-4e07-970c-f827addf95cb None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:08.653964 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc0882-b103-4e07-970c-f827addf95cb None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:08.654141 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc0882-b103-4e07-970c-f827addf95cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:08.671296 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-14dc0882-b103-4e07-970c-f827addf95cb None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:59:08.672474 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-14dc0882-b103-4e07-970c-f827addf95cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:59:08.680139 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 14:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:59:08.715831 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00c4be-73b0-4971-b8be-27f329d98ffd None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:59:08.728849 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00c4be-73b0-4971-b8be-27f329d98ffd None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:59:08.732608 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ef03b-fd7d-4187-bd81-f6bd63cf94a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:59:08.733235 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ef03b-fd7d-4187-bd81-f6bd63cf94a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:08.733518 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ef03b-fd7d-4187-bd81-f6bd63cf94a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:08.733793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ef03b-fd7d-4187-bd81-f6bd63cf94a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:08.742433 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ef03b-fd7d-4187-bd81-f6bd63cf94a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:59:08.743891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ef03b-fd7d-4187-bd81-f6bd63cf94a0 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:59:08.754013 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 741/1470] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:59:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:59:18.666248 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=17 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:59:18.749164 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=17 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:59:41.999228 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e688a-2605-486e-bedc-43a6b01136d0 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:41.999862 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e688a-2605-486e-bedc-43a6b01136d0 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:41.999862 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e688a-2605-486e-bedc-43a6b01136d0 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:42.001890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 730/1471] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:59:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:59:42.007227 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7043fca-1439-458f-85bd-31be720ac38b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:42.007672 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7043fca-1439-458f-85bd-31be720ac38b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:42.007794 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7043fca-1439-458f-85bd-31be720ac38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:42.025478 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-c7043fca-1439-458f-85bd-31be720ac38b None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:59:42.026665 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c7043fca-1439-458f-85bd-31be720ac38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:59:42.034886 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 742/1472] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:59:42.083028 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436b992-a858-4f06-b486-0f977520ba63 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:42.083352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436b992-a858-4f06-b486-0f977520ba63 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:42.083637 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436b992-a858-4f06-b486-0f977520ba63 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:42.084995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 731/1473] 10.222.0.24 () {54 vars in 962 bytes} [Thu May 19 14:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:59:42.089766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3044cb-2258-4d5b-b44d-b241c8b31507 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:42.090061 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3044cb-2258-4d5b-b44d-b241c8b31507 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:42.090340 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3044cb-2258-4d5b-b44d-b241c8b31507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:42.107998 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-fb3044cb-2258-4d5b-b44d-b241c8b31507 None None] MFA Rules not processed for user `b1dc1d74631b4d69a3094e4e1e2a0ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:59:42.109543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-fb3044cb-2258-4d5b-b44d-b241c8b31507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:59:42.116485 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 743/1474] 10.222.0.24 () {58 vars in 1059 bytes} [Thu May 19 14:59:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:59:42.124015 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436b992-a858-4f06-b486-0f977520ba63 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:59:42.135032 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436b992-a858-4f06-b486-0f977520ba63 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:59:42.138493 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840dab1e-c6d9-40cf-8c78-46fa17e8afa1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1dc1d74631b4d69a3094e4e1e2a0ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:59:42.139113 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dab1e-c6d9-40cf-8c78-46fa17e8afa1 service glance] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:42.139424 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dab1e-c6d9-40cf-8c78-46fa17e8afa1 service glance] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:42.139696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840dab1e-c6d9-40cf-8c78-46fa17e8afa1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:42.148219 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840dab1e-c6d9-40cf-8c78-46fa17e8afa1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:59:42.149634 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840dab1e-c6d9-40cf-8c78-46fa17e8afa1 service glance] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:59:42.158666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 732/1475] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:59:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:59:44.437716 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf806e-e12e-4bbb-9d70-920dd3c31e5d None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:44.438262 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf806e-e12e-4bbb-9d70-920dd3c31e5d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:44.438262 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf806e-e12e-4bbb-9d70-920dd3c31e5d None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:44.440332 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 744/1476] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:59:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:59:44.446874 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a311f-e5d8-457f-adf2-fa119fd19912 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:44.447361 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a311f-e5d8-457f-adf2-fa119fd19912 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:44.447485 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a311f-e5d8-457f-adf2-fa119fd19912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:44.467918 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b60a311f-e5d8-457f-adf2-fa119fd19912 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:59:44.469104 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b60a311f-e5d8-457f-adf2-fa119fd19912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:59:44.477275 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 733/1477] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:59:44.500605 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf806e-e12e-4bbb-9d70-920dd3c31e5d None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:59:44.512805 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf806e-e12e-4bbb-9d70-920dd3c31e5d None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:59:44.517291 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e08673-aa0d-4cd8-bb45-ee469848dc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:59:44.517939 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e08673-aa0d-4cd8-bb45-ee469848dc50 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:44.518225 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e08673-aa0d-4cd8-bb45-ee469848dc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:44.518534 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e08673-aa0d-4cd8-bb45-ee469848dc50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:44.519324 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e08673-aa0d-4cd8-bb45-ee469848dc50 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:59:44.521121 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: WARNING py.warnings [None req-95e08673-aa0d-4cd8-bb45-ee469848dc50 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 14:59:44.521121 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: warnings.warn(msg) May 19 14:59:44.521121 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: May 19 14:59:44.522258 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e08673-aa0d-4cd8-bb45-ee469848dc50 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:59:44.541344 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 745/1478] 10.222.0.24 () {56 vars in 1108 bytes} [Thu May 19 14:59:44 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 14:59:46.811048 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62324b1-ddd0-4b9f-8a5a-b9c577d33020 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:46.811658 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62324b1-ddd0-4b9f-8a5a-b9c577d33020 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:46.811658 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62324b1-ddd0-4b9f-8a5a-b9c577d33020 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:46.813027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 734/1479] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:59:46.818749 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abeadb-a1ec-4c72-b2bf-f64bbed7f154 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:46.819125 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abeadb-a1ec-4c72-b2bf-f64bbed7f154 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:46.819359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abeadb-a1ec-4c72-b2bf-f64bbed7f154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:46.837736 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-89abeadb-a1ec-4c72-b2bf-f64bbed7f154 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:59:46.838920 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-89abeadb-a1ec-4c72-b2bf-f64bbed7f154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:59:46.846634 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 746/1480] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:59:46.888815 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62324b1-ddd0-4b9f-8a5a-b9c577d33020 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:59:46.903415 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62324b1-ddd0-4b9f-8a5a-b9c577d33020 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:59:46.908708 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b19ec-80f4-4d34-869b-0b8020794073 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:59:46.909335 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b19ec-80f4-4d34-869b-0b8020794073 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:46.909619 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b19ec-80f4-4d34-869b-0b8020794073 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:46.909891 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b19ec-80f4-4d34-869b-0b8020794073 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:46.917752 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b19ec-80f4-4d34-869b-0b8020794073 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:59:46.919354 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b19ec-80f4-4d34-869b-0b8020794073 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:59:46.928398 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 735/1481] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:59:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:59:49.312202 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e255164-023e-47a9-a074-5118a95b7a3b None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:49.312747 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e255164-023e-47a9-a074-5118a95b7a3b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:49.312747 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e255164-023e-47a9-a074-5118a95b7a3b None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:49.314273 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 747/1482] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:59:49.319715 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92840809-3e67-4d86-9201-bac71a997bfc None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:49.320184 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92840809-3e67-4d86-9201-bac71a997bfc None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:49.320322 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92840809-3e67-4d86-9201-bac71a997bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:49.340473 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-92840809-3e67-4d86-9201-bac71a997bfc None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:59:49.341700 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-92840809-3e67-4d86-9201-bac71a997bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:59:49.350281 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 736/1483] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:59:49.385506 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e255164-023e-47a9-a074-5118a95b7a3b None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:59:49.396459 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e255164-023e-47a9-a074-5118a95b7a3b None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:59:49.399947 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c30ebe-6b90-4683-823d-fb0b42f4c414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:59:49.400577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c30ebe-6b90-4683-823d-fb0b42f4c414 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:49.400857 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c30ebe-6b90-4683-823d-fb0b42f4c414 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:49.401126 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c30ebe-6b90-4683-823d-fb0b42f4c414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:49.410413 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c30ebe-6b90-4683-823d-fb0b42f4c414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:59:49.411870 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c30ebe-6b90-4683-823d-fb0b42f4c414 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:59:49.421034 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 748/1484] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:59:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:59:51.661667 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590338cc-3d92-4b5e-9748-e1d4f900872a None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:51.662205 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590338cc-3d92-4b5e-9748-e1d4f900872a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:51.662205 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590338cc-3d92-4b5e-9748-e1d4f900872a None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:51.663635 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 737/1485] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:59:51.668944 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d7a72-c9e8-4785-80c7-cbf949368948 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:51.669384 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d7a72-c9e8-4785-80c7-cbf949368948 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:51.669557 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d7a72-c9e8-4785-80c7-cbf949368948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:51.687437 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-c19d7a72-c9e8-4785-80c7-cbf949368948 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:59:51.689284 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c19d7a72-c9e8-4785-80c7-cbf949368948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:59:51.697043 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 749/1486] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:59:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:59:51.732922 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590338cc-3d92-4b5e-9748-e1d4f900872a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:59:51.743857 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590338cc-3d92-4b5e-9748-e1d4f900872a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:59:51.747572 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d3fe9-029e-4743-a538-c19ede1eb739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:59:51.748195 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d3fe9-029e-4743-a538-c19ede1eb739 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:51.748476 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d3fe9-029e-4743-a538-c19ede1eb739 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:51.748749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d3fe9-029e-4743-a538-c19ede1eb739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:51.758063 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d3fe9-029e-4743-a538-c19ede1eb739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:59:51.759509 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d3fe9-029e-4743-a538-c19ede1eb739 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:59:51.768652 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 738/1487] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:59:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:59:54.133490 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb6220-3162-44db-97bd-418cf0563bcb None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:54.134031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb6220-3162-44db-97bd-418cf0563bcb None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:54.134031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb6220-3162-44db-97bd-418cf0563bcb None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:54.135455 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 750/1488] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:59:54.140814 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a01bb-7fe1-4bbd-bd55-df2c5fc6d4d5 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:54.141212 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a01bb-7fe1-4bbd-bd55-df2c5fc6d4d5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:54.142158 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a01bb-7fe1-4bbd-bd55-df2c5fc6d4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:54.160101 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f67a01bb-7fe1-4bbd-bd55-df2c5fc6d4d5 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:59:54.161294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f67a01bb-7fe1-4bbd-bd55-df2c5fc6d4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:59:54.169030 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 739/1489] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:59:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:59:54.208858 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb6220-3162-44db-97bd-418cf0563bcb None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:59:54.219540 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb6220-3162-44db-97bd-418cf0563bcb None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:59:54.223048 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020a814-23bc-42d1-87ab-896caff0bf65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:59:54.223705 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020a814-23bc-42d1-87ab-896caff0bf65 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:54.223991 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020a814-23bc-42d1-87ab-896caff0bf65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:54.224268 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020a814-23bc-42d1-87ab-896caff0bf65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:54.233010 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020a814-23bc-42d1-87ab-896caff0bf65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:59:54.234436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020a814-23bc-42d1-87ab-896caff0bf65 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:59:54.243707 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 751/1490] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:59:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 14:59:56.717101 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41586228-13dc-4509-8263-7a11ffac7e9c None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:56.717705 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41586228-13dc-4509-8263-7a11ffac7e9c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:56.717705 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41586228-13dc-4509-8263-7a11ffac7e9c None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:56.719061 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 740/1491] 10.222.0.24 () {54 vars in 926 bytes} [Thu May 19 14:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 14:59:56.724424 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524e207-2c0b-4cda-a471-d7ddd8b544bb None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:56.724862 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524e207-2c0b-4cda-a471-d7ddd8b544bb None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:56.724971 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524e207-2c0b-4cda-a471-d7ddd8b544bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:56.742399 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f524e207-2c0b-4cda-a471-d7ddd8b544bb None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 14:59:56.743626 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f524e207-2c0b-4cda-a471-d7ddd8b544bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 14:59:56.752069 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 752/1492] 10.222.0.24 () {58 vars in 1023 bytes} [Thu May 19 14:59:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 14:59:56.790145 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41586228-13dc-4509-8263-7a11ffac7e9c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 14:59:56.800699 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41586228-13dc-4509-8263-7a11ffac7e9c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 14:59:56.804232 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c9789-da1b-4652-b69a-70a0b623230f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 14:59:56.804866 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c9789-da1b-4652-b69a-70a0b623230f service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 14:59:56.805156 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c9789-da1b-4652-b69a-70a0b623230f service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 14:59:56.805435 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c9789-da1b-4652-b69a-70a0b623230f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 14:59:56.814770 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c9789-da1b-4652-b69a-70a0b623230f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 14:59:56.816226 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c9789-da1b-4652-b69a-70a0b623230f service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 14:59:56.825474 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 741/1493] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 14:59:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:00:06.737332 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=33 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:00:06.821347 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=33 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:01:43.170136 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165df94-96bf-4754-97c8-61c0d211acb8 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:01:43.170655 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165df94-96bf-4754-97c8-61c0d211acb8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:01:43.170765 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165df94-96bf-4754-97c8-61c0d211acb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:01:43.188940 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-3165df94-96bf-4754-97c8-61c0d211acb8 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:01:43.190125 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3165df94-96bf-4754-97c8-61c0d211acb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:01:43.198773 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 753/1494] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:01:43.208597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc4d5d-4260-4932-ad83-77c6ed58f050 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:01:43.209102 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc4d5d-4260-4932-ad83-77c6ed58f050 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:01:43.209207 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc4d5d-4260-4932-ad83-77c6ed58f050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:01:43.227328 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-30cc4d5d-4260-4932-ad83-77c6ed58f050 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:01:43.228653 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-30cc4d5d-4260-4932-ad83-77c6ed58f050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:01:43.237105 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 742/1495] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:01:43.241794 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165df94-96bf-4754-97c8-61c0d211acb8 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:01:43.252050 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165df94-96bf-4754-97c8-61c0d211acb8 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:01:43.256442 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7030df-7edf-45cd-b28b-a5e3fc4a35c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:01:43.257089 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7030df-7edf-45cd-b28b-a5e3fc4a35c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:01:43.257370 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7030df-7edf-45cd-b28b-a5e3fc4a35c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:01:43.257647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7030df-7edf-45cd-b28b-a5e3fc4a35c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:01:43.258372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7030df-7edf-45cd-b28b-a5e3fc4a35c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:01:43.258675 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7030df-7edf-45cd-b28b-a5e3fc4a35c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:01:43.259721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: WARNING py.warnings [None req-be7030df-7edf-45cd-b28b-a5e3fc4a35c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 15:01:43.259721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: warnings.warn(msg) May 19 15:01:43.259721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: May 19 15:01:43.260609 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7030df-7edf-45cd-b28b-a5e3fc4a35c1 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:01:43.272607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 754/1496] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 15:01:43.281198 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc4d5d-4260-4932-ad83-77c6ed58f050 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:01:43.290285 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc4d5d-4260-4932-ad83-77c6ed58f050 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:01:43.294831 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b824c-6a30-4dbf-a2fc-9888c2fc5cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:01:43.295519 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b824c-6a30-4dbf-a2fc-9888c2fc5cd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:01:43.295810 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b824c-6a30-4dbf-a2fc-9888c2fc5cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:01:43.296090 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b824c-6a30-4dbf-a2fc-9888c2fc5cd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:01:43.296771 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b824c-6a30-4dbf-a2fc-9888c2fc5cd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:01:43.298565 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: WARNING py.warnings [None req-395b824c-6a30-4dbf-a2fc-9888c2fc5cd3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 15:01:43.298565 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: warnings.warn(msg) May 19 15:01:43.298565 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: May 19 15:01:43.299843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b824c-6a30-4dbf-a2fc-9888c2fc5cd3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:01:43.337890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 743/1497] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:01:43 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:01:43.341789 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7030df-7edf-45cd-b28b-a5e3fc4a35c1 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:01:43.351592 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7030df-7edf-45cd-b28b-a5e3fc4a35c1 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:01:43.407726 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b592191-aec3-4736-8c4c-d704d92aa204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:01:43.408393 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b592191-aec3-4736-8c4c-d704d92aa204 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:01:43.408678 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b592191-aec3-4736-8c4c-d704d92aa204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:01:43.408956 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b592191-aec3-4736-8c4c-d704d92aa204 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:01:43.409651 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b592191-aec3-4736-8c4c-d704d92aa204 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:01:43.410656 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: WARNING py.warnings [None req-9b592191-aec3-4736-8c4c-d704d92aa204 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 15:01:43.410656 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: warnings.warn(msg) May 19 15:01:43.410656 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: May 19 15:01:43.411895 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b592191-aec3-4736-8c4c-d704d92aa204 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:01:43.432948 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 755/1498] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:01:43 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:01:43.437624 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b824c-6a30-4dbf-a2fc-9888c2fc5cd3 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:01:43.447633 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b824c-6a30-4dbf-a2fc-9888c2fc5cd3 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:01:43.452191 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e711c-bbdb-4f6f-a0b7-07012816f14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:01:43.452847 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e711c-bbdb-4f6f-a0b7-07012816f14f admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:01:43.453137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e711c-bbdb-4f6f-a0b7-07012816f14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:01:43.453418 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e711c-bbdb-4f6f-a0b7-07012816f14f admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:01:43.454148 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e711c-bbdb-4f6f-a0b7-07012816f14f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:01:43.455167 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: WARNING py.warnings [None req-7d2e711c-bbdb-4f6f-a0b7-07012816f14f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 15:01:43.455167 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: warnings.warn(msg) May 19 15:01:43.455167 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: May 19 15:01:43.456082 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e711c-bbdb-4f6f-a0b7-07012816f14f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:01:43.468586 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 744/1499] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:01:43.472484 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b592191-aec3-4736-8c4c-d704d92aa204 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:01:43.482587 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b592191-aec3-4736-8c4c-d704d92aa204 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:01:43.487244 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e951e-2956-4ff3-a205-7b0dbc218ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:01:43.487897 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e951e-2956-4ff3-a205-7b0dbc218ffa admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:01:43.488182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e951e-2956-4ff3-a205-7b0dbc218ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:01:43.488461 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e951e-2956-4ff3-a205-7b0dbc218ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:01:43.489185 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e951e-2956-4ff3-a205-7b0dbc218ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:01:43.490184 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: WARNING py.warnings [None req-3a1e951e-2956-4ff3-a205-7b0dbc218ffa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 15:01:43.490184 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: warnings.warn(msg) May 19 15:01:43.490184 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: May 19 15:01:43.491061 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e951e-2956-4ff3-a205-7b0dbc218ffa admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:01:43.505162 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 756/1500] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:01:43.509190 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e711c-bbdb-4f6f-a0b7-07012816f14f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:01:43.518763 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e711c-bbdb-4f6f-a0b7-07012816f14f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:01:43.523303 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd78514-c6ff-4521-b670-05d13f82e8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:01:43.524172 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd78514-c6ff-4521-b670-05d13f82e8b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:01:43.524457 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd78514-c6ff-4521-b670-05d13f82e8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:01:43.524731 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd78514-c6ff-4521-b670-05d13f82e8b6 admin admin] PATH_INFO: `/v3/projects/17edee93fea9434eb76897f922ff6574/users/c9954fe714cf4868bdda9000825174a3/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:01:43.538776 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd78514-c6ff-4521-b670-05d13f82e8b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17edee93fea9434eb76897f922ff6574, user_id=c9954fe714cf4868bdda9000825174a3, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:01:43.539848 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: WARNING py.warnings [None req-ccd78514-c6ff-4521-b670-05d13f82e8b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 15:01:43.539848 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: warnings.warn(msg) May 19 15:01:43.539848 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: May 19 15:01:43.541770 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd78514-c6ff-4521-b670-05d13f82e8b6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:01:43.554736 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 745/1501] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:01:43 2022] PUT /identity/v3/projects/17edee93fea9434eb76897f922ff6574/users/c9954fe714cf4868bdda9000825174a3/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:01:43.566429 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ecb1b-2363-4ea2-8b68-a8b3c10b3315 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:01:43.566724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ecb1b-2363-4ea2-8b68-a8b3c10b3315 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:01:43.567008 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ecb1b-2363-4ea2-8b68-a8b3c10b3315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:01:43.592436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ac5ecb1b-2363-4ea2-8b68-a8b3c10b3315 None None] MFA Rules not processed for user `c9954fe714cf4868bdda9000825174a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:01:43.593589 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ac5ecb1b-2363-4ea2-8b68-a8b3c10b3315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:01:43.657340 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 757/1502] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:01:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:01:43.670836 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde71f6a-c51e-4f7f-8596-2a49fcb39125 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:01:43.671137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde71f6a-c51e-4f7f-8596-2a49fcb39125 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:01:43.671453 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde71f6a-c51e-4f7f-8596-2a49fcb39125 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:01:43.672824 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 746/1503] 10.222.0.24 () {54 vars in 963 bytes} [Thu May 19 15:01:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 15:01:43.677689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db8baf-3ee1-41f7-a6db-7a2d0241d231 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:01:43.678026 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db8baf-3ee1-41f7-a6db-7a2d0241d231 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:01:43.678307 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db8baf-3ee1-41f7-a6db-7a2d0241d231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:01:43.696113 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-04db8baf-3ee1-41f7-a6db-7a2d0241d231 None None] MFA Rules not processed for user `ed3a61154a444a9cb925839f693208c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:01:43.697278 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-04db8baf-3ee1-41f7-a6db-7a2d0241d231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:01:43.740144 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:01:43.750353 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 758/1504] 10.222.0.24 () {58 vars in 1060 bytes} [Thu May 19 15:01:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:01:43.758262 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde71f6a-c51e-4f7f-8596-2a49fcb39125 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:01:43.768876 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde71f6a-c51e-4f7f-8596-2a49fcb39125 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:01:43.772376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b63141-8feb-41ae-9530-de627ccd9fa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:01:43.773002 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b63141-8feb-41ae-9530-de627ccd9fa8 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:01:43.773287 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b63141-8feb-41ae-9530-de627ccd9fa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:01:43.773563 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b63141-8feb-41ae-9530-de627ccd9fa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:01:43.782133 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b63141-8feb-41ae-9530-de627ccd9fa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:01:43.783679 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b63141-8feb-41ae-9530-de627ccd9fa8 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:01:43.792145 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 747/1505] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:01:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:01:43.833827 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad05fac-8bc9-44fb-93d0-8def0baa6326 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:01:43.834115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad05fac-8bc9-44fb-93d0-8def0baa6326 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:01:43.834392 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad05fac-8bc9-44fb-93d0-8def0baa6326 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:01:43.835704 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 759/1506] 10.222.0.24 () {52 vars in 829 bytes} [Thu May 19 15:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 15:01:43.839538 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b63141-8feb-41ae-9530-de627ccd9fa8 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:01:43.901087 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b63141-8feb-41ae-9530-de627ccd9fa8 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:01:43.906019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3a936-f17e-4a0e-8ce7-de9c9db1ecd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:01:43.906886 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3a936-f17e-4a0e-8ce7-de9c9db1ecd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:01:43.907176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3a936-f17e-4a0e-8ce7-de9c9db1ecd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:01:43.907490 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3a936-f17e-4a0e-8ce7-de9c9db1ecd6 admin admin] PATH_INFO: `/v3/users/c9954fe714cf4868bdda9000825174a3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:01:43.908676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3a936-f17e-4a0e-8ce7-de9c9db1ecd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9954fe714cf4868bdda9000825174a3)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:01:43.909701 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: WARNING py.warnings [None req-44b3a936-f17e-4a0e-8ce7-de9c9db1ecd6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 15:01:43.909701 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: warnings.warn(msg) May 19 15:01:43.909701 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: May 19 15:01:43.910912 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3a936-f17e-4a0e-8ce7-de9c9db1ecd6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:01:43.973952 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-44b3a936-f17e-4a0e-8ce7-de9c9db1ecd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9954fe714cf4868bdda9000825174a3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:01:43.986732 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-44b3a936-f17e-4a0e-8ce7-de9c9db1ecd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9954fe714cf4868bdda9000825174a3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:01:44.007740 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-44b3a936-f17e-4a0e-8ce7-de9c9db1ecd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9954fe714cf4868bdda9000825174a3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:01:44.008500 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-44b3a936-f17e-4a0e-8ce7-de9c9db1ecd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9954fe714cf4868bdda9000825174a3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:01:44.009232 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-44b3a936-f17e-4a0e-8ce7-de9c9db1ecd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9954fe714cf4868bdda9000825174a3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:01:44.013305 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:01:44.026927 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 748/1507] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:01:43 2022] DELETE /identity/v3/users/c9954fe714cf4868bdda9000825174a3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:01:44.033738 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297ccfc-94ab-484b-99dd-69ecd5cd3c8a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:01:44.034029 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297ccfc-94ab-484b-99dd-69ecd5cd3c8a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:01:44.034307 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297ccfc-94ab-484b-99dd-69ecd5cd3c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:01:44.053648 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7297ccfc-94ab-484b-99dd-69ecd5cd3c8a None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:01:44.055116 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7297ccfc-94ab-484b-99dd-69ecd5cd3c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:01:44.116969 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 760/1508] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:01:44.126703 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3a936-f17e-4a0e-8ce7-de9c9db1ecd6 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:01:44.128226 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-44b3a936-f17e-4a0e-8ce7-de9c9db1ecd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:01:44.183650 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3a936-f17e-4a0e-8ce7-de9c9db1ecd6 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:01:44.187102 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb73a1c-5e1c-4f56-bd33-0b71a88508a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:01:44.187770 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb73a1c-5e1c-4f56-bd33-0b71a88508a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:01:44.188070 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb73a1c-5e1c-4f56-bd33-0b71a88508a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:01:44.188341 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb73a1c-5e1c-4f56-bd33-0b71a88508a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:01:44.196987 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb73a1c-5e1c-4f56-bd33-0b71a88508a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:01:44.198447 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb73a1c-5e1c-4f56-bd33-0b71a88508a9 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:01:44.208042 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 749/1509] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:01:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:01:44.569987 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297ccfc-94ab-484b-99dd-69ecd5cd3c8a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:01:44.571511 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7297ccfc-94ab-484b-99dd-69ecd5cd3c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:01:44.585808 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297ccfc-94ab-484b-99dd-69ecd5cd3c8a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:01:44.591714 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa4ba3-2c03-421c-8bcc-959a60d59a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:01:44.592720 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa4ba3-2c03-421c-8bcc-959a60d59a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:01:44.593143 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa4ba3-2c03-421c-8bcc-959a60d59a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:01:44.593436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa4ba3-2c03-421c-8bcc-959a60d59a82 admin admin] PATH_INFO: `/v3/projects/17edee93fea9434eb76897f922ff6574` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:01:44.595641 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa4ba3-2c03-421c-8bcc-959a60d59a82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17edee93fea9434eb76897f922ff6574)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:01:44.597042 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: WARNING py.warnings [None req-86aa4ba3-2c03-421c-8bcc-959a60d59a82 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 15:01:44.597042 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: warnings.warn(msg) May 19 15:01:44.597042 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: May 19 15:01:44.598435 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa4ba3-2c03-421c-8bcc-959a60d59a82 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:01:44.671460 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-86aa4ba3-2c03-421c-8bcc-959a60d59a82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17edee93fea9434eb76897f922ff6574', 'request_id': 'req-86aa4ba3-2c03-421c-8bcc-959a60d59a82'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:01:44.677387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-86aa4ba3-2c03-421c-8bcc-959a60d59a82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17edee93fea9434eb76897f922ff6574', 'request_id': 'req-86aa4ba3-2c03-421c-8bcc-959a60d59a82'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:01:44.691018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-86aa4ba3-2c03-421c-8bcc-959a60d59a82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17edee93fea9434eb76897f922ff6574', 'request_id': 'req-86aa4ba3-2c03-421c-8bcc-959a60d59a82'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:01:44.706312 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-86aa4ba3-2c03-421c-8bcc-959a60d59a82 admin admin] The token cache is being invalidate because project 17edee93fea9434eb76897f922ff6574 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:01:44.706520 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-86aa4ba3-2c03-421c-8bcc-959a60d59a82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:01:44.707156 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-86aa4ba3-2c03-421c-8bcc-959a60d59a82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:01:44.708824 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 761/1510] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:01:44 2022] DELETE /identity/v3/projects/17edee93fea9434eb76897f922ff6574 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:01:54.204058 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:01:54.703268 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:03:26.899666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef74a6-1241-4eb2-8950-b0015c80b34e None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:03:26.900256 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef74a6-1241-4eb2-8950-b0015c80b34e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:03:26.900256 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef74a6-1241-4eb2-8950-b0015c80b34e None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:03:26.901615 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 15:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 15:03:26.906465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4469600-d133-45c2-9cb8-b767327bf0d8 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:03:26.906892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4469600-d133-45c2-9cb8-b767327bf0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:03:26.907050 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4469600-d133-45c2-9cb8-b767327bf0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:03:26.924654 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a4469600-d133-45c2-9cb8-b767327bf0d8 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:03:26.925833 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a4469600-d133-45c2-9cb8-b767327bf0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:03:26.984152 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 15:03:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:03:27.154894 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef74a6-1241-4eb2-8950-b0015c80b34e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:03:27.156614 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c9ef74a6-1241-4eb2-8950-b0015c80b34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:03:27.229529 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef74a6-1241-4eb2-8950-b0015c80b34e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:03:27.235097 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336d252-ebe0-43bd-9d6b-3e635a4f395b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:03:27.235834 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336d252-ebe0-43bd-9d6b-3e635a4f395b service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:03:27.236181 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336d252-ebe0-43bd-9d6b-3e635a4f395b service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:03:27.236483 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336d252-ebe0-43bd-9d6b-3e635a4f395b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:03:27.245030 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336d252-ebe0-43bd-9d6b-3e635a4f395b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:03:27.246923 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336d252-ebe0-43bd-9d6b-3e635a4f395b service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:03:27.256260 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 751/1513] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:03:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:03:28.005611 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698510c7-a9d9-453e-9d6c-a03f844e1e09 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:03:28.006172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698510c7-a9d9-453e-9d6c-a03f844e1e09 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:03:28.006172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698510c7-a9d9-453e-9d6c-a03f844e1e09 None None] PATH_INFO: `/v3` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:03:28.007561 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 763/1514] 10.222.0.49 () {54 vars in 925 bytes} [Thu May 19 15:03:28 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:03:28.014371 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185ef19-3964-42ff-82f0-7897215bba31 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:03:28.014799 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185ef19-3964-42ff-82f0-7897215bba31 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:03:28.014915 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185ef19-3964-42ff-82f0-7897215bba31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:03:28.033231 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1185ef19-3964-42ff-82f0-7897215bba31 None None] MFA Rules not processed for user `adec680c4f5f4e6dbe5989d5d7acf620`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:03:28.034420 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1185ef19-3964-42ff-82f0-7897215bba31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:03:28.096752 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 752/1515] 10.222.0.49 () {58 vars in 1015 bytes} [Thu May 19 15:03:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:03:28.164547 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7be3d0-ff19-4da5-a0e8-2a6e5a0f5365 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:03:28.165198 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7be3d0-ff19-4da5-a0e8-2a6e5a0f5365 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:03:28.165497 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7be3d0-ff19-4da5-a0e8-2a6e5a0f5365 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:03:28.166882 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 764/1516] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 15:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 15:03:28.171730 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35bcdb-5060-4265-9608-7895252fb6b0 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:03:28.172026 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35bcdb-5060-4265-9608-7895252fb6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:03:28.172309 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35bcdb-5060-4265-9608-7895252fb6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:03:28.189880 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8f35bcdb-5060-4265-9608-7895252fb6b0 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:03:28.191060 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8f35bcdb-5060-4265-9608-7895252fb6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:03:28.199162 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 753/1517] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 15:03:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:03:28.348427 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7be3d0-ff19-4da5-a0e8-2a6e5a0f5365 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:03:28.362355 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7be3d0-ff19-4da5-a0e8-2a6e5a0f5365 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:03:28.367673 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e2ba6-322a-4173-bdde-b3591fb959f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:03:28.368300 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e2ba6-322a-4173-bdde-b3591fb959f3 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:03:28.368580 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e2ba6-322a-4173-bdde-b3591fb959f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:03:28.368855 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e2ba6-322a-4173-bdde-b3591fb959f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:03:28.381677 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e2ba6-322a-4173-bdde-b3591fb959f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:03:28.383377 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e2ba6-322a-4173-bdde-b3591fb959f3 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:03:28.394537 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 765/1518] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:03:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:03:31.930844 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec534b47-e47c-4c9c-8cb1-b4e0046e03c7 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:03:31.931456 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec534b47-e47c-4c9c-8cb1-b4e0046e03c7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:03:31.931456 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec534b47-e47c-4c9c-8cb1-b4e0046e03c7 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:03:31.932874 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 754/1519] 10.222.0.24 () {54 vars in 960 bytes} [Thu May 19 15:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 15:03:31.937931 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591723d-644a-4e32-b98b-89353b6be98d None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:03:31.938393 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591723d-644a-4e32-b98b-89353b6be98d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:03:31.938499 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591723d-644a-4e32-b98b-89353b6be98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:03:31.956745 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-1591723d-644a-4e32-b98b-89353b6be98d None None] MFA Rules not processed for user `adec680c4f5f4e6dbe5989d5d7acf620`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:03:31.957933 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1591723d-644a-4e32-b98b-89353b6be98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:03:31.968106 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 766/1520] 10.222.0.24 () {58 vars in 1057 bytes} [Thu May 19 15:03:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:03:31.975389 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec534b47-e47c-4c9c-8cb1-b4e0046e03c7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:03:31.988331 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec534b47-e47c-4c9c-8cb1-b4e0046e03c7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:03:31.993198 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a69769-3f89-43f0-94c4-8935a29915cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adec680c4f5f4e6dbe5989d5d7acf620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:03:31.993815 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a69769-3f89-43f0-94c4-8935a29915cf service placement] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:03:31.994098 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a69769-3f89-43f0-94c4-8935a29915cf service placement] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:03:31.994374 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a69769-3f89-43f0-94c4-8935a29915cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:03:32.002663 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a69769-3f89-43f0-94c4-8935a29915cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:03:32.004276 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a69769-3f89-43f0-94c4-8935a29915cf service placement] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:03:32.014427 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 755/1521] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:03:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:03:39.719435 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b4081-60c0-4cba-8961-c762b78f6f36 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:03:39.719999 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b4081-60c0-4cba-8961-c762b78f6f36 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:03:39.719999 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b4081-60c0-4cba-8961-c762b78f6f36 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:03:39.721427 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 15:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 15:03:39.726307 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec617557-4aea-4b7b-bf71-996c4f0f0337 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:03:39.726742 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec617557-4aea-4b7b-bf71-996c4f0f0337 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:03:39.726907 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec617557-4aea-4b7b-bf71-996c4f0f0337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:03:39.745055 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ec617557-4aea-4b7b-bf71-996c4f0f0337 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:03:39.746238 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ec617557-4aea-4b7b-bf71-996c4f0f0337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:03:39.754131 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 15:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:03:39.908855 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b4081-60c0-4cba-8961-c762b78f6f36 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:03:39.923707 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b4081-60c0-4cba-8961-c762b78f6f36 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:03:39.928934 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a010f8-df98-4e02-82cb-2aa35676f34e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:03:39.929593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a010f8-df98-4e02-82cb-2aa35676f34e service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:03:39.929881 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a010f8-df98-4e02-82cb-2aa35676f34e service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:03:39.930156 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a010f8-df98-4e02-82cb-2aa35676f34e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:03:39.938252 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a010f8-df98-4e02-82cb-2aa35676f34e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:03:39.939876 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a010f8-df98-4e02-82cb-2aa35676f34e service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:03:39.949401 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 768/1524] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:03:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:03:40.835636 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65461263-d245-44cd-bcdb-fa7884a7d930 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:03:40.836213 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65461263-d245-44cd-bcdb-fa7884a7d930 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:03:40.836213 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65461263-d245-44cd-bcdb-fa7884a7d930 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:03:40.837619 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 19 15:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 15:03:40.842600 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6169b-c423-4f45-8491-1e71099481e1 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:03:40.842997 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6169b-c423-4f45-8491-1e71099481e1 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:03:40.843168 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6169b-c423-4f45-8491-1e71099481e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:03:40.861117 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-0ca6169b-c423-4f45-8491-1e71099481e1 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:03:40.862289 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0ca6169b-c423-4f45-8491-1e71099481e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:03:40.870526 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 19 15:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:03:41.018073 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65461263-d245-44cd-bcdb-fa7884a7d930 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:03:41.032332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65461263-d245-44cd-bcdb-fa7884a7d930 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:03:41.037714 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f886f043-2fb5-4984-95da-f154b387d3d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:03:41.038353 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886f043-2fb5-4984-95da-f154b387d3d5 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:03:41.038642 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886f043-2fb5-4984-95da-f154b387d3d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:03:41.038924 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886f043-2fb5-4984-95da-f154b387d3d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:03:41.047535 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f886f043-2fb5-4984-95da-f154b387d3d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:03:41.049136 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f886f043-2fb5-4984-95da-f154b387d3d5 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:03:41.058975 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 758/1527] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:03:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:03:45.361496 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7ec84-3e37-4db9-90f3-f0014dc1515d None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:03:45.362037 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7ec84-3e37-4db9-90f3-f0014dc1515d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:03:45.362037 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7ec84-3e37-4db9-90f3-f0014dc1515d None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:03:45.363445 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 15:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 15:03:45.368608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744c626-49b4-4699-8eaf-7c5a15f0618d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:03:45.369030 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744c626-49b4-4699-8eaf-7c5a15f0618d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:03:45.369162 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744c626-49b4-4699-8eaf-7c5a15f0618d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:03:45.389622 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-6744c626-49b4-4699-8eaf-7c5a15f0618d None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:03:45.390821 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6744c626-49b4-4699-8eaf-7c5a15f0618d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:03:45.398550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 15:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:03:45.435828 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7ec84-3e37-4db9-90f3-f0014dc1515d None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:03:45.437467 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-61f7ec84-3e37-4db9-90f3-f0014dc1515d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:03:45.497721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7ec84-3e37-4db9-90f3-f0014dc1515d None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:03:45.501229 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f3801-5abd-4361-a578-ad506cafafbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:03:45.501872 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f3801-5abd-4361-a578-ad506cafafbc service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:03:45.502156 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f3801-5abd-4361-a578-ad506cafafbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:03:45.502432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f3801-5abd-4361-a578-ad506cafafbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:03:45.511324 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f3801-5abd-4361-a578-ad506cafafbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:03:45.512802 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f3801-5abd-4361-a578-ad506cafafbc service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:03:45.522424 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 771/1530] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:03:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:03:47.731930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e26158-4194-49ae-9756-24e541e23bc1 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:03:47.732506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e26158-4194-49ae-9756-24e541e23bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:03:47.732506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e26158-4194-49ae-9756-24e541e23bc1 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:03:47.733881 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 15:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 15:03:47.739027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ddece-1d3a-4377-a2ad-50c5c511c9be None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:03:47.739426 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ddece-1d3a-4377-a2ad-50c5c511c9be None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:03:47.739639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ddece-1d3a-4377-a2ad-50c5c511c9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:03:47.757578 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-254ddece-1d3a-4377-a2ad-50c5c511c9be None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:03:47.758780 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-254ddece-1d3a-4377-a2ad-50c5c511c9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:03:47.767091 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 15:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:03:47.803542 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e26158-4194-49ae-9756-24e541e23bc1 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:03:47.817016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e26158-4194-49ae-9756-24e541e23bc1 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:03:47.820550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67203f20-6996-4785-8969-3370b898098d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:03:47.821189 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67203f20-6996-4785-8969-3370b898098d service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:03:47.821478 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67203f20-6996-4785-8969-3370b898098d service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:03:47.821753 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67203f20-6996-4785-8969-3370b898098d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:03:47.831556 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67203f20-6996-4785-8969-3370b898098d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:03:47.832987 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67203f20-6996-4785-8969-3370b898098d service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:03:47.842683 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 761/1533] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:03:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:03:51.622768 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec69a2a-e521-4a17-a867-80823ec4ba01 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:03:51.623398 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec69a2a-e521-4a17-a867-80823ec4ba01 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:03:51.623398 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec69a2a-e521-4a17-a867-80823ec4ba01 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:03:51.624772 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 15:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 15:03:51.630026 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a703faf-a7bd-4c20-8615-b50e8cc5a5ae None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:03:51.630443 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a703faf-a7bd-4c20-8615-b50e8cc5a5ae None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:03:51.630586 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a703faf-a7bd-4c20-8615-b50e8cc5a5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:03:51.648064 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-6a703faf-a7bd-4c20-8615-b50e8cc5a5ae None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:03:51.649269 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6a703faf-a7bd-4c20-8615-b50e8cc5a5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:03:51.657478 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 15:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:03:51.928632 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec69a2a-e521-4a17-a867-80823ec4ba01 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:03:51.930269 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-dec69a2a-e521-4a17-a867-80823ec4ba01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:03:51.986288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec69a2a-e521-4a17-a867-80823ec4ba01 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:03:51.989759 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3be84-b052-4c6f-b383-e47742358333 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:03:51.990393 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3be84-b052-4c6f-b383-e47742358333 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:03:51.990676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3be84-b052-4c6f-b383-e47742358333 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:03:51.990951 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3be84-b052-4c6f-b383-e47742358333 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:03:52.000004 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3be84-b052-4c6f-b383-e47742358333 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:03:52.001420 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3be84-b052-4c6f-b383-e47742358333 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:03:52.006210 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:03:52.012342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 774/1536] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:03:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:03:54.290906 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d61a5-3aec-4c2a-95a1-8c7d0da3ab4d None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:03:54.292030 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d61a5-3aec-4c2a-95a1-8c7d0da3ab4d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:03:54.292030 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d61a5-3aec-4c2a-95a1-8c7d0da3ab4d None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:03:54.293428 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 19 15:03:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 15:03:54.298746 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551b479-25ff-42b4-8db3-2e279ac0452f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:03:54.299120 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551b479-25ff-42b4-8db3-2e279ac0452f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:03:54.299341 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551b479-25ff-42b4-8db3-2e279ac0452f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:03:54.318901 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d551b479-25ff-42b4-8db3-2e279ac0452f None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:03:54.320116 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d551b479-25ff-42b4-8db3-2e279ac0452f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:03:54.327880 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 19 15:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:03:54.608573 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d61a5-3aec-4c2a-95a1-8c7d0da3ab4d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:03:54.610262 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b00d61a5-3aec-4c2a-95a1-8c7d0da3ab4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:03:54.617757 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=94 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:03:54.624283 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d61a5-3aec-4c2a-95a1-8c7d0da3ab4d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:03:54.627778 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ae1c3-3065-494b-a988-8d1c9c570bea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:03:54.628431 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ae1c3-3065-494b-a988-8d1c9c570bea service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:03:54.628714 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ae1c3-3065-494b-a988-8d1c9c570bea service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:03:54.628991 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ae1c3-3065-494b-a988-8d1c9c570bea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:03:54.637760 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ae1c3-3065-494b-a988-8d1c9c570bea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:03:54.639191 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ae1c3-3065-494b-a988-8d1c9c570bea service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:03:54.648506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 764/1539] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:03:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:04:04.312594 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:04:04.644409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:24.578957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032e46a-59c3-4b46-919f-515ecfef357b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:24.580544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032e46a-59c3-4b46-919f-515ecfef357b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:24.581019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032e46a-59c3-4b46-919f-515ecfef357b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:24.614514 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f032e46a-59c3-4b46-919f-515ecfef357b None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:24.615776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f032e46a-59c3-4b46-919f-515ecfef357b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:24.628385 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 776/1540] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:24.638059 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74a7e7-0788-458d-99c2-1fe269392106 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:24.639099 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74a7e7-0788-458d-99c2-1fe269392106 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:24.639252 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c428e-3064-4556-8a68-af842c9d2497 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:24.639557 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c428e-3064-4556-8a68-af842c9d2497 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:24.639835 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c428e-3064-4556-8a68-af842c9d2497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:24.640228 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74a7e7-0788-458d-99c2-1fe269392106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:24.666929 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-bd74a7e7-0788-458d-99c2-1fe269392106 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:24.668218 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bd74a7e7-0788-458d-99c2-1fe269392106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:24.673429 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-328c428e-3064-4556-8a68-af842c9d2497 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:24.674901 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-328c428e-3064-4556-8a68-af842c9d2497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:24.693596 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 777/1541] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:24.694002 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 765/1542] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:24.698636 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c428e-3064-4556-8a68-af842c9d2497 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:24.704554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac00e69-05b3-431c-8a04-995d489c13f7 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:24.707533 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac00e69-05b3-431c-8a04-995d489c13f7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:24.707533 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac00e69-05b3-431c-8a04-995d489c13f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:24.725622 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c428e-3064-4556-8a68-af842c9d2497 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:24.736819 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a60bd-a30c-462f-ace8-80f5c8d7c4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:24.737511 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a60bd-a30c-462f-ace8-80f5c8d7c4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:24.737792 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a60bd-a30c-462f-ace8-80f5c8d7c4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:24.738074 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a60bd-a30c-462f-ace8-80f5c8d7c4f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:24.738953 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a60bd-a30c-462f-ace8-80f5c8d7c4f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:05:24.739410 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a60bd-a30c-462f-ace8-80f5c8d7c4f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:24.741032 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a60bd-a30c-462f-ace8-80f5c8d7c4f9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:24.744195 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8ac00e69-05b3-431c-8a04-995d489c13f7 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:24.745634 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8ac00e69-05b3-431c-8a04-995d489c13f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:24.760426 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 778/1543] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:05:24.764965 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c255ee2-d608-4fb7-8e7b-8f0d2892ac48 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:24.765268 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c255ee2-d608-4fb7-8e7b-8f0d2892ac48 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:24.765555 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c255ee2-d608-4fb7-8e7b-8f0d2892ac48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:24.769664 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 766/1544] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:24.774825 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac00e69-05b3-431c-8a04-995d489c13f7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:24.798698 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac00e69-05b3-431c-8a04-995d489c13f7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:24.808190 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-2c255ee2-d608-4fb7-8e7b-8f0d2892ac48 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:24.808891 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8dd997-df91-43c7-812b-06eddd834c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:24.809854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8dd997-df91-43c7-812b-06eddd834c9d admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:24.809978 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2c255ee2-d608-4fb7-8e7b-8f0d2892ac48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:24.810486 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8dd997-df91-43c7-812b-06eddd834c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:24.811007 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8dd997-df91-43c7-812b-06eddd834c9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:24.812283 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8dd997-df91-43c7-812b-06eddd834c9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:05:24.812898 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8dd997-df91-43c7-812b-06eddd834c9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:24.814143 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: WARNING py.warnings [None req-cd8dd997-df91-43c7-812b-06eddd834c9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 15:05:24.814143 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: warnings.warn(msg) May 19 15:05:24.814143 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: May 19 15:05:24.815459 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8dd997-df91-43c7-812b-06eddd834c9d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:24.834106 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 767/1545] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:05:24.839872 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 779/1546] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:24.839872 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c255ee2-d608-4fb7-8e7b-8f0d2892ac48 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:24.841691 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33657e1f-2be5-47fc-9f49-16bcee6a1c8a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:24.842228 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33657e1f-2be5-47fc-9f49-16bcee6a1c8a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:24.842741 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33657e1f-2be5-47fc-9f49-16bcee6a1c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:24.858733 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c255ee2-d608-4fb7-8e7b-8f0d2892ac48 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:24.865547 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-33657e1f-2be5-47fc-9f49-16bcee6a1c8a None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:24.867045 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-33657e1f-2be5-47fc-9f49-16bcee6a1c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:24.872545 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcd2aa-1e3e-49bc-9952-d3e4b11d5a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:24.873223 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcd2aa-1e3e-49bc-9952-d3e4b11d5a06 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:24.873508 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcd2aa-1e3e-49bc-9952-d3e4b11d5a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:24.873785 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcd2aa-1e3e-49bc-9952-d3e4b11d5a06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:24.874831 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fcd2aa-1e3e-49bc-9952-d3e4b11d5a06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:24.876084 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: WARNING py.warnings [None req-97fcd2aa-1e3e-49bc-9952-d3e4b11d5a06 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 15:05:24.876084 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: warnings.warn(msg) May 19 15:05:24.876084 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: May 19 15:05:24.877614 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fcd2aa-1e3e-49bc-9952-d3e4b11d5a06 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:24.878220 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 768/1547] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:24.879615 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccbcbb-57fe-4f00-8833-ed9fb5eaf632 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:24.879997 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccbcbb-57fe-4f00-8833-ed9fb5eaf632 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:24.880370 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccbcbb-57fe-4f00-8833-ed9fb5eaf632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:24.905029 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4dccbcbb-57fe-4f00-8833-ed9fb5eaf632 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:24.906397 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4dccbcbb-57fe-4f00-8833-ed9fb5eaf632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:24.910648 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 780/1548] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:05:24 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:24.911779 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcd2aa-1e3e-49bc-9952-d3e4b11d5a06 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:24.919273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 769/1549] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:24.920760 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa73f0-48da-4708-97df-711486857b98 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:24.920934 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa73f0-48da-4708-97df-711486857b98 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:24.921287 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa73f0-48da-4708-97df-711486857b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:24.942733 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4ffa73f0-48da-4708-97df-711486857b98 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:24.943972 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4ffa73f0-48da-4708-97df-711486857b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:24.988973 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcd2aa-1e3e-49bc-9952-d3e4b11d5a06 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:24.993610 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646a80c-899b-48b8-b111-75d9d81681cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:24.994272 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646a80c-899b-48b8-b111-75d9d81681cb admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:24.994559 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646a80c-899b-48b8-b111-75d9d81681cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:24.994836 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646a80c-899b-48b8-b111-75d9d81681cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:24.995563 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646a80c-899b-48b8-b111-75d9d81681cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:24.997740 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646a80c-899b-48b8-b111-75d9d81681cb admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:25.003117 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 770/1550] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:25.004519 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924b0bd-a0fb-44c7-852d-cf772235f250 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:25.004824 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924b0bd-a0fb-44c7-852d-cf772235f250 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:25.005110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924b0bd-a0fb-44c7-852d-cf772235f250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:25.025671 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 781/1551] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:05:24 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:25.026971 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f92390-37cb-45f6-8d7a-3d4e872a83d5 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:25.027299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f92390-37cb-45f6-8d7a-3d4e872a83d5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:25.027579 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f92390-37cb-45f6-8d7a-3d4e872a83d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:25.030008 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f924b0bd-a0fb-44c7-852d-cf772235f250 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:25.031261 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f924b0bd-a0fb-44c7-852d-cf772235f250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:25.044411 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-29f92390-37cb-45f6-8d7a-3d4e872a83d5 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:25.045607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-29f92390-37cb-45f6-8d7a-3d4e872a83d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:25.092217 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 771/1552] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:25.093501 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866f97c-03b3-4906-8647-e1c0fa3dfbe0 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:25.093709 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866f97c-03b3-4906-8647-e1c0fa3dfbe0 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:25.093993 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866f97c-03b3-4906-8647-e1c0fa3dfbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:25.105167 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 782/1553] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:25.106319 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9c50b-6164-42c2-b289-917061eac5f6 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:25.106609 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9c50b-6164-42c2-b289-917061eac5f6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:25.106888 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9c50b-6164-42c2-b289-917061eac5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:25.111800 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e866f97c-03b3-4906-8647-e1c0fa3dfbe0 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:25.113055 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e866f97c-03b3-4906-8647-e1c0fa3dfbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:25.121490 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 772/1554] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:25.122244 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866f97c-03b3-4906-8647-e1c0fa3dfbe0 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:25.125493 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-09d9c50b-6164-42c2-b289-917061eac5f6 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:25.126763 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-09d9c50b-6164-42c2-b289-917061eac5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:25.131353 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866f97c-03b3-4906-8647-e1c0fa3dfbe0 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:25.135609 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 783/1555] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:25.136384 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeffded-babc-450c-b095-5768aecd1cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:25.136525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9c50b-6164-42c2-b289-917061eac5f6 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:25.137034 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeffded-babc-450c-b095-5768aecd1cee admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:25.137319 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeffded-babc-450c-b095-5768aecd1cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:25.137622 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeffded-babc-450c-b095-5768aecd1cee admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:25.138305 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeffded-babc-450c-b095-5768aecd1cee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:25.139364 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: WARNING py.warnings [None req-2aeffded-babc-450c-b095-5768aecd1cee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 15:05:25.139364 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: warnings.warn(msg) May 19 15:05:25.139364 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: May 19 15:05:25.140579 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeffded-babc-450c-b095-5768aecd1cee admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:25.149537 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9c50b-6164-42c2-b289-917061eac5f6 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:25.154417 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2127f-443c-4840-9af7-4e67c4b14a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:25.155078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2127f-443c-4840-9af7-4e67c4b14a20 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:25.155391 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2127f-443c-4840-9af7-4e67c4b14a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:25.155711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2127f-443c-4840-9af7-4e67c4b14a20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:25.156437 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2127f-443c-4840-9af7-4e67c4b14a20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:05:25.156747 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2127f-443c-4840-9af7-4e67c4b14a20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:25.158384 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2127f-443c-4840-9af7-4e67c4b14a20 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:25.161713 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 773/1556] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:05:25 2022] POST /identity/v3/users => generated 293 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:25.162985 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bd919-dda2-41ae-8609-b0ca3302001e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:25.163314 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bd919-dda2-41ae-8609-b0ca3302001e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:25.163605 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bd919-dda2-41ae-8609-b0ca3302001e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:25.170495 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 784/1557] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:05:25.171368 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2127f-443c-4840-9af7-4e67c4b14a20 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:25.180805 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2127f-443c-4840-9af7-4e67c4b14a20 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:25.181768 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f88bd919-dda2-41ae-8609-b0ca3302001e None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:25.182958 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f88bd919-dda2-41ae-8609-b0ca3302001e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:25.185339 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804995ee-414c-47ae-91af-6fc2cf813eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:25.185982 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804995ee-414c-47ae-91af-6fc2cf813eee admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:25.186274 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804995ee-414c-47ae-91af-6fc2cf813eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:25.186544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804995ee-414c-47ae-91af-6fc2cf813eee admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:25.187253 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804995ee-414c-47ae-91af-6fc2cf813eee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:25.189163 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804995ee-414c-47ae-91af-6fc2cf813eee admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:25.190788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 774/1558] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:25.192137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55e7ea-36cf-46b8-a93e-f7fbdef0b8d4 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:25.192430 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55e7ea-36cf-46b8-a93e-f7fbdef0b8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:25.192708 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55e7ea-36cf-46b8-a93e-f7fbdef0b8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:25.201931 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:25.212874 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-dd55e7ea-36cf-46b8-a93e-f7fbdef0b8d4 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:25.214154 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-dd55e7ea-36cf-46b8-a93e-f7fbdef0b8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:25.220063 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 785/1559] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:05:25 2022] POST /identity/v3/users => generated 287 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:25.220063 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a7765-afee-42a0-868e-563668812fd0 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:25.220063 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a7765-afee-42a0-868e-563668812fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:25.220063 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a7765-afee-42a0-868e-563668812fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:25.222520 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 775/1560] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:25.223347 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55e7ea-36cf-46b8-a93e-f7fbdef0b8d4 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:25.232543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55e7ea-36cf-46b8-a93e-f7fbdef0b8d4 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:25.237089 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096da2ff-a4a7-40b0-a4da-514bb2b38f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:25.237732 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096da2ff-a4a7-40b0-a4da-514bb2b38f50 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:25.238020 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096da2ff-a4a7-40b0-a4da-514bb2b38f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:25.238245 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9c7a7765-afee-42a0-868e-563668812fd0 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:25.238354 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096da2ff-a4a7-40b0-a4da-514bb2b38f50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:25.239005 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096da2ff-a4a7-40b0-a4da-514bb2b38f50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:05:25.239357 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096da2ff-a4a7-40b0-a4da-514bb2b38f50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:25.239463 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9c7a7765-afee-42a0-868e-563668812fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:25.240966 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096da2ff-a4a7-40b0-a4da-514bb2b38f50 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:25.248041 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 786/1561] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:25.249247 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00a011-7b10-439c-b0af-4f879d9d2d40 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:25.249539 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00a011-7b10-439c-b0af-4f879d9d2d40 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:25.249823 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00a011-7b10-439c-b0af-4f879d9d2d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:25.260547 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 776/1562] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:05:25.260547 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096da2ff-a4a7-40b0-a4da-514bb2b38f50 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:25.269202 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-6b00a011-7b10-439c-b0af-4f879d9d2d40 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:25.269978 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096da2ff-a4a7-40b0-a4da-514bb2b38f50 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:25.270389 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6b00a011-7b10-439c-b0af-4f879d9d2d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:25.274557 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821aa87-1254-4fa6-9a8d-0357c93c3cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:25.275291 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821aa87-1254-4fa6-9a8d-0357c93c3cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:25.275585 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821aa87-1254-4fa6-9a8d-0357c93c3cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:25.275869 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821aa87-1254-4fa6-9a8d-0357c93c3cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:25.276592 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821aa87-1254-4fa6-9a8d-0357c93c3cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:25.278208 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 787/1563] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:25.278348 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821aa87-1254-4fa6-9a8d-0357c93c3cc9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:25.278948 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00a011-7b10-439c-b0af-4f879d9d2d40 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:25.284201 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:25.288418 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00a011-7b10-439c-b0af-4f879d9d2d40 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:25.291438 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 777/1564] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:25.292365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821aa87-1254-4fa6-9a8d-0357c93c3cc9 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:25.294213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179681b-32a2-4f69-a3b3-cef76975ef4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:25.294862 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179681b-32a2-4f69-a3b3-cef76975ef4a admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:25.295141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179681b-32a2-4f69-a3b3-cef76975ef4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:25.295446 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179681b-32a2-4f69-a3b3-cef76975ef4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:25.296132 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179681b-32a2-4f69-a3b3-cef76975ef4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:25.298035 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179681b-32a2-4f69-a3b3-cef76975ef4a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:25.302335 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821aa87-1254-4fa6-9a8d-0357c93c3cc9 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:25.307563 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6488781-0b4a-4e81-a015-a94866ba0d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:25.308355 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6488781-0b4a-4e81-a015-a94866ba0d93 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:25.308718 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6488781-0b4a-4e81-a015-a94866ba0d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:25.309003 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6488781-0b4a-4e81-a015-a94866ba0d93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:25.309756 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6488781-0b4a-4e81-a015-a94866ba0d93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:05:25.310071 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6488781-0b4a-4e81-a015-a94866ba0d93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:25.311726 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6488781-0b4a-4e81-a015-a94866ba0d93 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:25.327101 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 788/1565] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:05:25 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:25.328068 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179681b-32a2-4f69-a3b3-cef76975ef4a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:25.332036 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 778/1566] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:05:25.333058 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6488781-0b4a-4e81-a015-a94866ba0d93 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:25.349570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6488781-0b4a-4e81-a015-a94866ba0d93 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:25.389753 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179681b-32a2-4f69-a3b3-cef76975ef4a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:25.394307 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520469d-06a8-429b-bfc4-9186665c789a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:25.394970 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520469d-06a8-429b-bfc4-9186665c789a admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:25.395281 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520469d-06a8-429b-bfc4-9186665c789a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:25.395564 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0520469d-06a8-429b-bfc4-9186665c789a admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:25.396287 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520469d-06a8-429b-bfc4-9186665c789a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:25.397881 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0520469d-06a8-429b-bfc4-9186665c789a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:25.407987 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 789/1567] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:25.408264 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f55ba5-831c-44f6-a124-45e0414d2a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:25.408814 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f55ba5-831c-44f6-a124-45e0414d2a44 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:25.409102 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f55ba5-831c-44f6-a124-45e0414d2a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:25.409341 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520469d-06a8-429b-bfc4-9186665c789a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:25.409446 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f55ba5-831c-44f6-a124-45e0414d2a44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:25.410095 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f55ba5-831c-44f6-a124-45e0414d2a44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:05:25.410405 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f55ba5-831c-44f6-a124-45e0414d2a44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:25.412094 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f55ba5-831c-44f6-a124-45e0414d2a44 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:25.420019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0520469d-06a8-429b-bfc4-9186665c789a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:25.431527 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 779/1568] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:05:25.431711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e62a7-9c56-4429-b5a9-4039520fd872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:25.431827 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f55ba5-831c-44f6-a124-45e0414d2a44 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:25.431917 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e62a7-9c56-4429-b5a9-4039520fd872 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:25.431917 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e62a7-9c56-4429-b5a9-4039520fd872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:25.431917 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e62a7-9c56-4429-b5a9-4039520fd872 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:25.431917 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e62a7-9c56-4429-b5a9-4039520fd872 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:05:25.431917 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e62a7-9c56-4429-b5a9-4039520fd872 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:25.431917 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e62a7-9c56-4429-b5a9-4039520fd872 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:25.437144 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f55ba5-831c-44f6-a124-45e0414d2a44 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:25.441573 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 790/1569] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:05:25.441991 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd37d25-b07d-401d-978a-99656354bdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:25.442372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e62a7-9c56-4429-b5a9-4039520fd872 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:25.442715 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd37d25-b07d-401d-978a-99656354bdda admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:25.443006 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd37d25-b07d-401d-978a-99656354bdda admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:25.443306 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd37d25-b07d-401d-978a-99656354bdda admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:25.443996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd37d25-b07d-401d-978a-99656354bdda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:25.446440 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd37d25-b07d-401d-978a-99656354bdda admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:25.458471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e62a7-9c56-4429-b5a9-4039520fd872 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:25.463822 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005204f-cc98-4cb8-9c80-18e64935b71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:25.464622 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005204f-cc98-4cb8-9c80-18e64935b71a admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:25.464951 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005204f-cc98-4cb8-9c80-18e64935b71a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:25.465269 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005204f-cc98-4cb8-9c80-18e64935b71a admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:25.466039 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005204f-cc98-4cb8-9c80-18e64935b71a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:05:25.466391 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005204f-cc98-4cb8-9c80-18e64935b71a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:25.468058 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005204f-cc98-4cb8-9c80-18e64935b71a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:25.474509 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 780/1570] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:05:25 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:25.475431 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd37d25-b07d-401d-978a-99656354bdda admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:25.480856 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 791/1571] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:05:25.481595 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005204f-cc98-4cb8-9c80-18e64935b71a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:25.491415 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005204f-cc98-4cb8-9c80-18e64935b71a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:25.535766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd37d25-b07d-401d-978a-99656354bdda admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:25.541181 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ae09e-4137-4ab2-b18b-06f5f3274f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:25.541854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ae09e-4137-4ab2-b18b-06f5f3274f2c admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:25.542147 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ae09e-4137-4ab2-b18b-06f5f3274f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:25.542454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ae09e-4137-4ab2-b18b-06f5f3274f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:25.543225 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ae09e-4137-4ab2-b18b-06f5f3274f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:25.544928 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ae09e-4137-4ab2-b18b-06f5f3274f2c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:25.547601 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f44cb4-d649-4bf7-b8a6-5796c77d366e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:25.548289 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f44cb4-d649-4bf7-b8a6-5796c77d366e admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:25.548569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f44cb4-d649-4bf7-b8a6-5796c77d366e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:25.548841 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f44cb4-d649-4bf7-b8a6-5796c77d366e admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:25.549521 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f44cb4-d649-4bf7-b8a6-5796c77d366e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:25.551501 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f44cb4-d649-4bf7-b8a6-5796c77d366e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:25.554759 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 781/1572] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:25.556306 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ae09e-4137-4ab2-b18b-06f5f3274f2c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:25.567495 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ae09e-4137-4ab2-b18b-06f5f3274f2c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:25.572761 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2b8db-5bf1-43e8-b2d4-108dc4fc2705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:25.573401 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2b8db-5bf1-43e8-b2d4-108dc4fc2705 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:25.573694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2b8db-5bf1-43e8-b2d4-108dc4fc2705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:25.573977 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2b8db-5bf1-43e8-b2d4-108dc4fc2705 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:25.574810 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2b8db-5bf1-43e8-b2d4-108dc4fc2705 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:25.574929 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 792/1573] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:05:25 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:25.576237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f44cb4-d649-4bf7-b8a6-5796c77d366e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:25.576608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2b8db-5bf1-43e8-b2d4-108dc4fc2705 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:25.588275 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f44cb4-d649-4bf7-b8a6-5796c77d366e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:25.596651 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ea90a-e73f-4ffb-b00f-06ab3288783d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:25.597602 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ea90a-e73f-4ffb-b00f-06ab3288783d admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:25.598066 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ea90a-e73f-4ffb-b00f-06ab3288783d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:25.598518 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ea90a-e73f-4ffb-b00f-06ab3288783d admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:25.599543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ea90a-e73f-4ffb-b00f-06ab3288783d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:25.601903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ea90a-e73f-4ffb-b00f-06ab3288783d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:25.609903 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 782/1574] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:05:25 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:25.609903 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2b8db-5bf1-43e8-b2d4-108dc4fc2705 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:25.612428 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 793/1575] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:25.613135 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ea90a-e73f-4ffb-b00f-06ab3288783d admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:25.624375 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ea90a-e73f-4ffb-b00f-06ab3288783d admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:25.628124 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:25.644845 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:25.673446 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2b8db-5bf1-43e8-b2d4-108dc4fc2705 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:25.677987 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fef2a-a3a6-4236-84d7-4df4e49b3ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:25.678644 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fef2a-a3a6-4236-84d7-4df4e49b3ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:25.678928 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fef2a-a3a6-4236-84d7-4df4e49b3ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:25.679216 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fef2a-a3a6-4236-84d7-4df4e49b3ca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:25.679904 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68fef2a-a3a6-4236-84d7-4df4e49b3ca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:25.682503 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68fef2a-a3a6-4236-84d7-4df4e49b3ca6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:25.684851 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582e9d8-7894-46e4-88eb-3ed7e4c3b209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:25.685679 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582e9d8-7894-46e4-88eb-3ed7e4c3b209 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:25.685803 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582e9d8-7894-46e4-88eb-3ed7e4c3b209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:25.686074 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582e9d8-7894-46e4-88eb-3ed7e4c3b209 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:25.686768 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582e9d8-7894-46e4-88eb-3ed7e4c3b209 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:25.688689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582e9d8-7894-46e4-88eb-3ed7e4c3b209 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:25.707645 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 783/1576] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:05:25 2022] POST /identity/v3/projects => generated 391 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:25.708660 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fef2a-a3a6-4236-84d7-4df4e49b3ca6 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:25.718071 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 794/1577] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:05:25 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:25.718071 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582e9d8-7894-46e4-88eb-3ed7e4c3b209 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:25.773419 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fef2a-a3a6-4236-84d7-4df4e49b3ca6 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:25.776267 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582e9d8-7894-46e4-88eb-3ed7e4c3b209 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:25.778078 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cc04b-bbfa-42da-a13c-81febbe53d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:25.778740 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cc04b-bbfa-42da-a13c-81febbe53d71 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:25.779023 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cc04b-bbfa-42da-a13c-81febbe53d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:25.779337 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cc04b-bbfa-42da-a13c-81febbe53d71 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:25.780015 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594cc04b-bbfa-42da-a13c-81febbe53d71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:25.780842 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834dc0a-a85a-4d8d-a5a6-fbf23f773904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:25.781489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834dc0a-a85a-4d8d-a5a6-fbf23f773904 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:25.781773 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834dc0a-a85a-4d8d-a5a6-fbf23f773904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:25.781941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594cc04b-bbfa-42da-a13c-81febbe53d71 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:25.782041 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834dc0a-a85a-4d8d-a5a6-fbf23f773904 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:25.782719 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834dc0a-a85a-4d8d-a5a6-fbf23f773904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:25.784702 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834dc0a-a85a-4d8d-a5a6-fbf23f773904 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:25.802757 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 784/1578] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:05:25 2022] POST /identity/v3/users => generated 282 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:25.803624 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cc04b-bbfa-42da-a13c-81febbe53d71 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:25.815244 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 795/1579] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:05:25 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:25.815244 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834dc0a-a85a-4d8d-a5a6-fbf23f773904 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:25.815491 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cc04b-bbfa-42da-a13c-81febbe53d71 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:25.882577 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4165a-c948-40e3-9533-555ea9789c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:25.883483 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4165a-c948-40e3-9533-555ea9789c29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:25.883772 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4165a-c948-40e3-9533-555ea9789c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:25.884052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4165a-c948-40e3-9533-555ea9789c29 admin admin] PATH_INFO: `/v3/projects/34c1099557144b8bb2fff88f5b526834/users/af7838e525a042dfa0357ad1fc58cf21/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:25.884798 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834dc0a-a85a-4d8d-a5a6-fbf23f773904 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:25.889628 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ef241-b5a3-4581-b464-3058360ff340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:25.890295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ef241-b5a3-4581-b464-3058360ff340 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:25.890702 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ef241-b5a3-4581-b464-3058360ff340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:25.890987 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ef241-b5a3-4581-b464-3058360ff340 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:25.891746 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ef241-b5a3-4581-b464-3058360ff340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:25.893364 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ef241-b5a3-4581-b464-3058360ff340 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:25.898966 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4165a-c948-40e3-9533-555ea9789c29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34c1099557144b8bb2fff88f5b526834, user_id=af7838e525a042dfa0357ad1fc58cf21, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:25.902159 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4165a-c948-40e3-9533-555ea9789c29 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:25.903557 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 796/1580] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:25.904190 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ef241-b5a3-4581-b464-3058360ff340 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:25.915138 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ef241-b5a3-4581-b464-3058360ff340 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:25.918437 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 785/1581] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:05:25 2022] PUT /identity/v3/projects/34c1099557144b8bb2fff88f5b526834/users/af7838e525a042dfa0357ad1fc58cf21/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:25.919353 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4165a-c948-40e3-9533-555ea9789c29 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:25.924946 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:25.956264 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:25.973836 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce2b68-acaa-4e05-a4f8-d0b5e97efa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:25.974599 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce2b68-acaa-4e05-a4f8-d0b5e97efa93 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:25.974830 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce2b68-acaa-4e05-a4f8-d0b5e97efa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:25.975111 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce2b68-acaa-4e05-a4f8-d0b5e97efa93 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:25.975830 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce2b68-acaa-4e05-a4f8-d0b5e97efa93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:25.978265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce2b68-acaa-4e05-a4f8-d0b5e97efa93 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:25.987056 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4165a-c948-40e3-9533-555ea9789c29 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:25.993333 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b790227-e0b5-4c3a-b0d1-e709f2876132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:25.994309 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b790227-e0b5-4c3a-b0d1-e709f2876132 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:25.994672 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b790227-e0b5-4c3a-b0d1-e709f2876132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:25.995025 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b790227-e0b5-4c3a-b0d1-e709f2876132 admin admin] PATH_INFO: `/v3/projects/9df0c05a04984193ad8649a31bcb7d05/users/1433960e92d44d23b690e40a733778a8/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:25.998505 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 797/1582] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:05:25 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:25.999381 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce2b68-acaa-4e05-a4f8-d0b5e97efa93 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:26.008708 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce2b68-acaa-4e05-a4f8-d0b5e97efa93 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:26.010348 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b790227-e0b5-4c3a-b0d1-e709f2876132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9df0c05a04984193ad8649a31bcb7d05, user_id=1433960e92d44d23b690e40a733778a8, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:26.013065 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b790227-e0b5-4c3a-b0d1-e709f2876132 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:26.013213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6aab0-8ba9-46a1-b80c-2a4281fa1d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:26.013846 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6aab0-8ba9-46a1-b80c-2a4281fa1d73 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:26.014124 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6aab0-8ba9-46a1-b80c-2a4281fa1d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:26.014412 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6aab0-8ba9-46a1-b80c-2a4281fa1d73 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:26.015063 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6aab0-8ba9-46a1-b80c-2a4281fa1d73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:26.017024 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6aab0-8ba9-46a1-b80c-2a4281fa1d73 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:26.027119 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 786/1583] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:05:25 2022] PUT /identity/v3/projects/9df0c05a04984193ad8649a31bcb7d05/users/1433960e92d44d23b690e40a733778a8/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:26.027998 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b790227-e0b5-4c3a-b0d1-e709f2876132 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:26.041090 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 798/1584] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:05:25 2022] POST /identity/v3/users => generated 296 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:26.041090 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6aab0-8ba9-46a1-b80c-2a4281fa1d73 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:26.050663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6aab0-8ba9-46a1-b80c-2a4281fa1d73 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:26.096164 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b790227-e0b5-4c3a-b0d1-e709f2876132 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:26.100957 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada69a47-2b72-47ee-bc0b-c98065f0e0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:26.101629 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada69a47-2b72-47ee-bc0b-c98065f0e0bf admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:26.102578 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada69a47-2b72-47ee-bc0b-c98065f0e0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:26.102865 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada69a47-2b72-47ee-bc0b-c98065f0e0bf admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:26.103584 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada69a47-2b72-47ee-bc0b-c98065f0e0bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:26.105524 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada69a47-2b72-47ee-bc0b-c98065f0e0bf admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:26.107657 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4bf77-4eab-4ecc-85fa-b3d5fd85d13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:26.108374 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4bf77-4eab-4ecc-85fa-b3d5fd85d13b admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:26.108685 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4bf77-4eab-4ecc-85fa-b3d5fd85d13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:26.108959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4bf77-4eab-4ecc-85fa-b3d5fd85d13b admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:26.109681 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4bf77-4eab-4ecc-85fa-b3d5fd85d13b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:26.111312 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4bf77-4eab-4ecc-85fa-b3d5fd85d13b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:26.122198 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 799/1585] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:26.123094 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4bf77-4eab-4ecc-85fa-b3d5fd85d13b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:26.129030 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 787/1586] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:05:26 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:26.129030 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada69a47-2b72-47ee-bc0b-c98065f0e0bf admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:26.132975 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4bf77-4eab-4ecc-85fa-b3d5fd85d13b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:26.137209 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada69a47-2b72-47ee-bc0b-c98065f0e0bf admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:26.137548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97212d03-8c34-4d12-bcaa-264e346cf03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:26.138190 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97212d03-8c34-4d12-bcaa-264e346cf03a admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:26.138474 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97212d03-8c34-4d12-bcaa-264e346cf03a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:26.138749 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97212d03-8c34-4d12-bcaa-264e346cf03a admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:26.139467 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97212d03-8c34-4d12-bcaa-264e346cf03a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:26.141389 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97212d03-8c34-4d12-bcaa-264e346cf03a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:26.141881 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84703d6-f854-49fd-be7c-849129371bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:26.142523 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84703d6-f854-49fd-be7c-849129371bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:26.142810 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84703d6-f854-49fd-be7c-849129371bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:26.143092 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84703d6-f854-49fd-be7c-849129371bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:26.143845 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84703d6-f854-49fd-be7c-849129371bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:26.145446 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84703d6-f854-49fd-be7c-849129371bd0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:26.156080 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 788/1587] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:26.157314 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab5cc2-9f08-4589-ad9e-ec0ba24177a9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:26.157609 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab5cc2-9f08-4589-ad9e-ec0ba24177a9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:26.157890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab5cc2-9f08-4589-ad9e-ec0ba24177a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:26.165592 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 800/1588] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:05:26 2022] POST /identity/v3/users => generated 294 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:26.166420 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97212d03-8c34-4d12-bcaa-264e346cf03a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:26.175985 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97212d03-8c34-4d12-bcaa-264e346cf03a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:26.177107 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-76ab5cc2-9f08-4589-ad9e-ec0ba24177a9 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:26.178331 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-76ab5cc2-9f08-4589-ad9e-ec0ba24177a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:26.180568 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df926b-9ac5-4187-923d-f25040310fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:26.181225 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df926b-9ac5-4187-923d-f25040310fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:26.181506 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df926b-9ac5-4187-923d-f25040310fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:26.181780 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df926b-9ac5-4187-923d-f25040310fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:26.182540 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df926b-9ac5-4187-923d-f25040310fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:26.184311 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df926b-9ac5-4187-923d-f25040310fe4 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:26.186741 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 789/1589] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:26.187606 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab5cc2-9f08-4589-ad9e-ec0ba24177a9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:26.198055 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab5cc2-9f08-4589-ad9e-ec0ba24177a9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:26.199234 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 801/1590] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:26.200317 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af1fd6-ff96-44a9-97ec-edae16d757ba None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:26.200607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af1fd6-ff96-44a9-97ec-edae16d757ba None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:26.200882 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af1fd6-ff96-44a9-97ec-edae16d757ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:26.204293 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e20d84-cfaf-4fb7-99ae-5917f23e3074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:26.205119 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e20d84-cfaf-4fb7-99ae-5917f23e3074 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:26.207149 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e20d84-cfaf-4fb7-99ae-5917f23e3074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:26.207149 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e20d84-cfaf-4fb7-99ae-5917f23e3074 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:26.207149 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e20d84-cfaf-4fb7-99ae-5917f23e3074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:26.208882 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e20d84-cfaf-4fb7-99ae-5917f23e3074 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:26.222944 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 790/1591] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:26.223778 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e20d84-cfaf-4fb7-99ae-5917f23e3074 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:26.234013 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e20d84-cfaf-4fb7-99ae-5917f23e3074 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:26.235552 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-53af1fd6-ff96-44a9-97ec-edae16d757ba None None] MFA Rules not processed for user `1433960e92d44d23b690e40a733778a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:26.236849 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-53af1fd6-ff96-44a9-97ec-edae16d757ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:26.238713 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fc835-e2b4-47b2-ab90-7c96df44c124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:26.239406 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fc835-e2b4-47b2-ab90-7c96df44c124 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:26.239697 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fc835-e2b4-47b2-ab90-7c96df44c124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:26.239977 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fc835-e2b4-47b2-ab90-7c96df44c124 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:26.240732 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9fc835-e2b4-47b2-ab90-7c96df44c124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:26.242478 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9fc835-e2b4-47b2-ab90-7c96df44c124 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:26.256994 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 791/1592] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:26.256994 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fc835-e2b4-47b2-ab90-7c96df44c124 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:26.264750 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fc835-e2b4-47b2-ab90-7c96df44c124 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:26.269360 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae36488-8c05-42fe-88e7-4c9e2bf2f247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:26.270007 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae36488-8c05-42fe-88e7-4c9e2bf2f247 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:26.270297 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae36488-8c05-42fe-88e7-4c9e2bf2f247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:26.270581 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae36488-8c05-42fe-88e7-4c9e2bf2f247 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:26.271341 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae36488-8c05-42fe-88e7-4c9e2bf2f247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:26.272947 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae36488-8c05-42fe-88e7-4c9e2bf2f247 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:26.283635 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 792/1593] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:26.284328 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:26.284452 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae36488-8c05-42fe-88e7-4c9e2bf2f247 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:26.294478 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae36488-8c05-42fe-88e7-4c9e2bf2f247 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:26.299089 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7963c-57a6-4e27-8faf-325d880bba63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:26.299989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7963c-57a6-4e27-8faf-325d880bba63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:26.300283 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7963c-57a6-4e27-8faf-325d880bba63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:26.300565 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7963c-57a6-4e27-8faf-325d880bba63 admin admin] PATH_INFO: `/v3/projects/4f393107cd16496f85de03046f03c461/users/8b06fc42235a4ea08cd81b2bf6b4a4cb/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:26.310897 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 802/1594] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:26.311785 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af1fd6-ff96-44a9-97ec-edae16d757ba None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:26.320467 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7963c-57a6-4e27-8faf-325d880bba63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f393107cd16496f85de03046f03c461, user_id=8b06fc42235a4ea08cd81b2bf6b4a4cb, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:26.321956 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af1fd6-ff96-44a9-97ec-edae16d757ba None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:26.324980 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7963c-57a6-4e27-8faf-325d880bba63 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:26.330861 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829fc44-fcb0-43ce-8fae-182eef82c60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:26.331730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829fc44-fcb0-43ce-8fae-182eef82c60f admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:26.332106 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829fc44-fcb0-43ce-8fae-182eef82c60f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:26.332498 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829fc44-fcb0-43ce-8fae-182eef82c60f admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:26.333269 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829fc44-fcb0-43ce-8fae-182eef82c60f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:26.335239 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829fc44-fcb0-43ce-8fae-182eef82c60f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:26.349656 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 793/1595] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:05:26 2022] PUT /identity/v3/projects/4f393107cd16496f85de03046f03c461/users/8b06fc42235a4ea08cd81b2bf6b4a4cb/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:26.349656 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7963c-57a6-4e27-8faf-325d880bba63 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:26.350359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 803/1596] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:26.350359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829fc44-fcb0-43ce-8fae-182eef82c60f admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:26.350893 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8be7963c-57a6-4e27-8faf-325d880bba63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:26.358574 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829fc44-fcb0-43ce-8fae-182eef82c60f admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:26.386274 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:26.412251 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7963c-57a6-4e27-8faf-325d880bba63 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:26.417072 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8745555-4b5e-449c-9c42-b3dd9b93fcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:26.417245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee00ff-8ded-4a98-94ea-602dcb688a60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:26.417739 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8745555-4b5e-449c-9c42-b3dd9b93fcf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:26.417946 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee00ff-8ded-4a98-94ea-602dcb688a60 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:26.418058 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8745555-4b5e-449c-9c42-b3dd9b93fcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:26.418161 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee00ff-8ded-4a98-94ea-602dcb688a60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:26.418260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8745555-4b5e-449c-9c42-b3dd9b93fcf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:26.418444 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee00ff-8ded-4a98-94ea-602dcb688a60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:26.418984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8745555-4b5e-449c-9c42-b3dd9b93fcf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:26.420638 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8745555-4b5e-449c-9c42-b3dd9b93fcf5 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:26.428391 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee00ff-8ded-4a98-94ea-602dcb688a60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:26.429856 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee00ff-8ded-4a98-94ea-602dcb688a60 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:26.431053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 804/1597] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:26.431960 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8745555-4b5e-449c-9c42-b3dd9b93fcf5 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:26.440742 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 794/1598] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:05:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:05:26.441536 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee00ff-8ded-4a98-94ea-602dcb688a60 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:26.442028 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8745555-4b5e-449c-9c42-b3dd9b93fcf5 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:26.446995 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef483e3-7558-4960-a65f-b0abe9d5731f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:26.447676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef483e3-7558-4960-a65f-b0abe9d5731f admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:26.447958 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef483e3-7558-4960-a65f-b0abe9d5731f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:26.448232 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef483e3-7558-4960-a65f-b0abe9d5731f admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:26.448967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef483e3-7558-4960-a65f-b0abe9d5731f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:26.450537 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef483e3-7558-4960-a65f-b0abe9d5731f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:26.451452 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee00ff-8ded-4a98-94ea-602dcb688a60 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:26.457103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974065e-8ce9-4f97-8712-77fe9d945140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:26.457999 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974065e-8ce9-4f97-8712-77fe9d945140 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:26.458290 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974065e-8ce9-4f97-8712-77fe9d945140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:26.458570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974065e-8ce9-4f97-8712-77fe9d945140 admin admin] PATH_INFO: `/v3/projects/489d04a97b6541239f213a7efd074bd3/users/9f9bcabf7c9c416094babd1f30b992cb/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:26.460913 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 805/1599] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:26.461787 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef483e3-7558-4960-a65f-b0abe9d5731f admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:26.471411 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef483e3-7558-4960-a65f-b0abe9d5731f admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:26.476475 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1d565-972a-405a-86c1-52ac579eee25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:26.477670 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1d565-972a-405a-86c1-52ac579eee25 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:26.477958 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1d565-972a-405a-86c1-52ac579eee25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:26.478233 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1d565-972a-405a-86c1-52ac579eee25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:26.478630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974065e-8ce9-4f97-8712-77fe9d945140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=489d04a97b6541239f213a7efd074bd3, user_id=9f9bcabf7c9c416094babd1f30b992cb, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:26.478956 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1d565-972a-405a-86c1-52ac579eee25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:26.480584 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1d565-972a-405a-86c1-52ac579eee25 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:26.481409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974065e-8ce9-4f97-8712-77fe9d945140 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:26.493297 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 806/1600] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:26.494617 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a32c8-7b61-4381-a90e-a9bf0d30174c None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:26.494813 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a32c8-7b61-4381-a90e-a9bf0d30174c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:26.495071 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a32c8-7b61-4381-a90e-a9bf0d30174c None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:26.496958 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 807/1601] 10.222.0.24 () {54 vars in 961 bytes} [Thu May 19 15:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 15:05:26.498040 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eca1f6-1c7e-496c-b6f2-5f8fee5b158c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:26.498316 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eca1f6-1c7e-496c-b6f2-5f8fee5b158c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:26.498587 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eca1f6-1c7e-496c-b6f2-5f8fee5b158c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:26.501080 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 795/1602] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:05:26 2022] PUT /identity/v3/projects/489d04a97b6541239f213a7efd074bd3/users/9f9bcabf7c9c416094babd1f30b992cb/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:26.501928 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974065e-8ce9-4f97-8712-77fe9d945140 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:26.523654 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a1eca1f6-1c7e-496c-b6f2-5f8fee5b158c None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:26.525291 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a1eca1f6-1c7e-496c-b6f2-5f8fee5b158c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:26.579671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974065e-8ce9-4f97-8712-77fe9d945140 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:26.585411 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40108cf5-7cfd-4020-8e27-0f823ce3ef72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:26.586103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40108cf5-7cfd-4020-8e27-0f823ce3ef72 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:26.586421 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40108cf5-7cfd-4020-8e27-0f823ce3ef72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:26.586704 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40108cf5-7cfd-4020-8e27-0f823ce3ef72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:26.587547 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40108cf5-7cfd-4020-8e27-0f823ce3ef72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:26.589482 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40108cf5-7cfd-4020-8e27-0f823ce3ef72 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:26.601450 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 796/1603] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:26.602820 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40108cf5-7cfd-4020-8e27-0f823ce3ef72 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:26.604186 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 808/1604] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:26.608699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eca1f6-1c7e-496c-b6f2-5f8fee5b158c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:26.617062 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40108cf5-7cfd-4020-8e27-0f823ce3ef72 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:26.621840 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eca1f6-1c7e-496c-b6f2-5f8fee5b158c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:26.623371 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a26118-6ba4-4c21-95fa-c9c9974ae960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:26.624285 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a26118-6ba4-4c21-95fa-c9c9974ae960 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:26.624578 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a26118-6ba4-4c21-95fa-c9c9974ae960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:26.624857 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a26118-6ba4-4c21-95fa-c9c9974ae960 admin admin] PATH_INFO: `/v3/projects/33f091f18edf4402bd1e81f64f97a7a0/users/0eb25b3219a84d76ac31193db03fd2b3/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:26.626988 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9863d6-a076-406c-8446-84c5e79943b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:26.628040 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9863d6-a076-406c-8446-84c5e79943b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:26.629085 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9863d6-a076-406c-8446-84c5e79943b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:26.629085 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9863d6-a076-406c-8446-84c5e79943b1 admin admin] PATH_INFO: `/v3/projects/199f08479d9541bc936bb4ea80bae96a/users/e5374c90f38b47fcb611e346f3f2ec69/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:26.641902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a26118-6ba4-4c21-95fa-c9c9974ae960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33f091f18edf4402bd1e81f64f97a7a0, user_id=0eb25b3219a84d76ac31193db03fd2b3, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:26.644228 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9863d6-a076-406c-8446-84c5e79943b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=199f08479d9541bc936bb4ea80bae96a, user_id=e5374c90f38b47fcb611e346f3f2ec69, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:26.644739 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a26118-6ba4-4c21-95fa-c9c9974ae960 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:26.645258 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: WARNING py.warnings [None req-8e9863d6-a076-406c-8446-84c5e79943b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 15:05:26.645258 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: warnings.warn(msg) May 19 15:05:26.645258 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: May 19 15:05:26.647314 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9863d6-a076-406c-8446-84c5e79943b1 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:26.659658 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 797/1605] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:05:26 2022] PUT /identity/v3/projects/33f091f18edf4402bd1e81f64f97a7a0/users/0eb25b3219a84d76ac31193db03fd2b3/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:26.662443 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 809/1606] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:05:26 2022] PUT /identity/v3/projects/199f08479d9541bc936bb4ea80bae96a/users/e5374c90f38b47fcb611e346f3f2ec69/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:26.668243 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ed221-6fe0-4f93-9d82-418436b8da6f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:26.668443 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ed221-6fe0-4f93-9d82-418436b8da6f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:26.668725 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ed221-6fe0-4f93-9d82-418436b8da6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:26.670538 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a26118-6ba4-4c21-95fa-c9c9974ae960 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:26.688495 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b17ed221-6fe0-4f93-9d82-418436b8da6f None None] MFA Rules not processed for user `06fb8bb5aeb143ad95f33c3b43dbd346`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:26.689718 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b17ed221-6fe0-4f93-9d82-418436b8da6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:26.712264 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:26.751836 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a26118-6ba4-4c21-95fa-c9c9974ae960 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:26.779453 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:26.784821 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 810/1607] 10.222.0.24 () {58 vars in 1058 bytes} [Thu May 19 15:05:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:26.787156 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afc45b-0755-49f1-a870-1b7dd97ba568 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:26.787623 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afc45b-0755-49f1-a870-1b7dd97ba568 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:26.787895 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afc45b-0755-49f1-a870-1b7dd97ba568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:26.816991 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a1afc45b-0755-49f1-a870-1b7dd97ba568 None None] MFA Rules not processed for user `9f9bcabf7c9c416094babd1f30b992cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:26.818352 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a1afc45b-0755-49f1-a870-1b7dd97ba568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:26.821517 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366302a9-3d0b-4785-9c73-4de595ebed68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:26.822436 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366302a9-3d0b-4785-9c73-4de595ebed68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:26.822722 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366302a9-3d0b-4785-9c73-4de595ebed68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:26.823074 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366302a9-3d0b-4785-9c73-4de595ebed68 admin admin] PATH_INFO: `/v3/projects/4cc5447e9dec427ab5383fe3b9addfd5/users/00af60114c034815833604218f8c32d4/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:26.840474 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366302a9-3d0b-4785-9c73-4de595ebed68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cc5447e9dec427ab5383fe3b9addfd5, user_id=00af60114c034815833604218f8c32d4, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:26.843681 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366302a9-3d0b-4785-9c73-4de595ebed68 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:26.872096 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 798/1608] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:05:26 2022] PUT /identity/v3/projects/4cc5447e9dec427ab5383fe3b9addfd5/users/00af60114c034815833604218f8c32d4/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:26.872096 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366302a9-3d0b-4785-9c73-4de595ebed68 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:26.903234 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 811/1609] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:26 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:26.904270 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afc45b-0755-49f1-a870-1b7dd97ba568 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:26.969126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366302a9-3d0b-4785-9c73-4de595ebed68 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:26.976191 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d3399-6693-48b8-bba1-7d78320d3a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:26.976922 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afc45b-0755-49f1-a870-1b7dd97ba568 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:26.977276 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d3399-6693-48b8-bba1-7d78320d3a58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:26.977622 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d3399-6693-48b8-bba1-7d78320d3a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:26.978417 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d3399-6693-48b8-bba1-7d78320d3a58 admin admin] PATH_INFO: `/v3/projects/edea803526e44a55b74472ecefdb0fbc/users/644abe5583e94049abd23e4ca050a066/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:27.002313 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d3399-6693-48b8-bba1-7d78320d3a58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edea803526e44a55b74472ecefdb0fbc, user_id=644abe5583e94049abd23e4ca050a066, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:27.005288 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16d3399-6693-48b8-bba1-7d78320d3a58 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:27.027413 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 799/1610] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:05:26 2022] PUT /identity/v3/projects/edea803526e44a55b74472ecefdb0fbc/users/644abe5583e94049abd23e4ca050a066/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:27.027413 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6bc44-0437-4456-bbbe-1560c31f4b8d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:27.027413 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6bc44-0437-4456-bbbe-1560c31f4b8d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:27.027413 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6bc44-0437-4456-bbbe-1560c31f4b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:27.040414 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be038d9e-2026-4e6d-b0c0-c7b78160e578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:27.041453 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be038d9e-2026-4e6d-b0c0-c7b78160e578 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:27.041964 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be038d9e-2026-4e6d-b0c0-c7b78160e578 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:27.042960 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be038d9e-2026-4e6d-b0c0-c7b78160e578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:27.043364 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0cd6bc44-0437-4456-bbbe-1560c31f4b8d None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:27.044594 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0cd6bc44-0437-4456-bbbe-1560c31f4b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:27.057510 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be038d9e-2026-4e6d-b0c0-c7b78160e578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:27.059113 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be038d9e-2026-4e6d-b0c0-c7b78160e578 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:27.069957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 812/1611] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:05:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:05:27.072248 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5f832-32e1-4e8b-9571-9ce453aa3382 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:27.072601 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5f832-32e1-4e8b-9571-9ce453aa3382 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:27.072927 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5f832-32e1-4e8b-9571-9ce453aa3382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:27.080704 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:27.104979 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-4ee5f832-32e1-4e8b-9571-9ce453aa3382 None None] MFA Rules not processed for user `0eb25b3219a84d76ac31193db03fd2b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:27.106351 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4ee5f832-32e1-4e8b-9571-9ce453aa3382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:27.110064 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 800/1612] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:27.111052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6bc44-0437-4456-bbbe-1560c31f4b8d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:27.157014 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:27.195070 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 813/1613] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:27.195070 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d8c19-ad0f-49d8-907a-4d04611dab7c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:27.195070 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d8c19-ad0f-49d8-907a-4d04611dab7c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:27.195070 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d8c19-ad0f-49d8-907a-4d04611dab7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:27.202902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6bc44-0437-4456-bbbe-1560c31f4b8d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:27.212082 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73207a88-fafb-49d4-9bf8-f8f00fb222b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:27.212082 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73207a88-fafb-49d4-9bf8-f8f00fb222b4 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:27.212082 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73207a88-fafb-49d4-9bf8-f8f00fb222b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:27.212082 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73207a88-fafb-49d4-9bf8-f8f00fb222b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:27.230827 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-030d8c19-ad0f-49d8-907a-4d04611dab7c None None] MFA Rules not processed for user `00af60114c034815833604218f8c32d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:27.232482 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-030d8c19-ad0f-49d8-907a-4d04611dab7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:27.297616 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73207a88-fafb-49d4-9bf8-f8f00fb222b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:27.299353 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73207a88-fafb-49d4-9bf8-f8f00fb222b4 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:27.308868 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 801/1614] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:05:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:05:27.309673 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73207a88-fafb-49d4-9bf8-f8f00fb222b4 service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:27.312230 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 814/1615] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:27.314321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632bd9e-ee01-4fb9-987f-36538dd0d70e None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:27.314321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632bd9e-ee01-4fb9-987f-36538dd0d70e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:27.314321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632bd9e-ee01-4fb9-987f-36538dd0d70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:27.324708 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73207a88-fafb-49d4-9bf8-f8f00fb222b4 service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:27.329971 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3389d9-d3e6-40c8-8b3f-c1ab0d6e86d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:27.330668 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3389d9-d3e6-40c8-8b3f-c1ab0d6e86d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:27.330960 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3389d9-d3e6-40c8-8b3f-c1ab0d6e86d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:27.331286 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3389d9-d3e6-40c8-8b3f-c1ab0d6e86d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:27.332015 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3389d9-d3e6-40c8-8b3f-c1ab0d6e86d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:27.333937 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3389d9-d3e6-40c8-8b3f-c1ab0d6e86d8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:27.337674 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-8632bd9e-ee01-4fb9-987f-36538dd0d70e None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:27.338884 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8632bd9e-ee01-4fb9-987f-36538dd0d70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:27.351435 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 815/1616] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:27.352184 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632bd9e-ee01-4fb9-987f-36538dd0d70e None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:27.381560 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 802/1617] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:05:27 2022] POST /identity/v3/projects => generated 365 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:27.384449 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cd867-3bc8-4120-871d-ce747ddf427d None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:27.385058 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cd867-3bc8-4120-871d-ce747ddf427d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:27.385533 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cd867-3bc8-4120-871d-ce747ddf427d None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:27.388263 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 803/1618] 10.222.0.24 () {54 vars in 961 bytes} [Thu May 19 15:05:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 15:05:27.389548 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cd867-3bc8-4120-871d-ce747ddf427d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:27.428435 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632bd9e-ee01-4fb9-987f-36538dd0d70e None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:27.478184 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:27.525366 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211e628-f366-414d-a7e9-dc5032f9b6b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:27.526185 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211e628-f366-414d-a7e9-dc5032f9b6b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:27.526479 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211e628-f366-414d-a7e9-dc5032f9b6b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:27.526794 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211e628-f366-414d-a7e9-dc5032f9b6b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:27.583475 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cd867-3bc8-4120-871d-ce747ddf427d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:27.592235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53879d4-b27f-408f-9079-12dd834be0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:27.593222 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53879d4-b27f-408f-9079-12dd834be0de admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:27.593506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53879d4-b27f-408f-9079-12dd834be0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:27.593782 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53879d4-b27f-408f-9079-12dd834be0de admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:27.600027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53879d4-b27f-408f-9079-12dd834be0de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:27.604223 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53879d4-b27f-408f-9079-12dd834be0de admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:27.618357 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211e628-f366-414d-a7e9-dc5032f9b6b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:27.619844 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211e628-f366-414d-a7e9-dc5032f9b6b7 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:27.634110 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 816/1619] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:05:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:05:27.637653 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211e628-f366-414d-a7e9-dc5032f9b6b7 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:27.645219 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211e628-f366-414d-a7e9-dc5032f9b6b7 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:27.650047 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e47610-5fbd-4869-af73-0e53a85431c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:27.651013 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e47610-5fbd-4869-af73-0e53a85431c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:27.651411 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e47610-5fbd-4869-af73-0e53a85431c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:27.651758 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e47610-5fbd-4869-af73-0e53a85431c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:27.656935 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 804/1620] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:05:27 2022] POST /identity/v3/projects => generated 379 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:27.656935 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53879d4-b27f-408f-9079-12dd834be0de admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:27.664783 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e47610-5fbd-4869-af73-0e53a85431c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:27.666665 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e47610-5fbd-4869-af73-0e53a85431c6 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:27.677723 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 817/1621] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:05:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:05:27.679278 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522aaf65-bbb2-4b50-bd53-f523d4a1f0b0 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:27.679655 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522aaf65-bbb2-4b50-bd53-f523d4a1f0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:27.680516 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522aaf65-bbb2-4b50-bd53-f523d4a1f0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:27.700698 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-522aaf65-bbb2-4b50-bd53-f523d4a1f0b0 None None] MFA Rules not processed for user `06fb8bb5aeb143ad95f33c3b43dbd346`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:27.702024 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-522aaf65-bbb2-4b50-bd53-f523d4a1f0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:27.753775 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:27.790909 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 818/1622] 10.222.0.24 () {58 vars in 1058 bytes} [Thu May 19 15:05:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:27.792034 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522aaf65-bbb2-4b50-bd53-f523d4a1f0b0 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:27.827335 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53879d4-b27f-408f-9079-12dd834be0de admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:27.842645 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d663518-6ccd-41e0-bb21-825129a20192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:27.843444 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d663518-6ccd-41e0-bb21-825129a20192 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:27.843786 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d663518-6ccd-41e0-bb21-825129a20192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:27.844169 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d663518-6ccd-41e0-bb21-825129a20192 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:27.844881 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d663518-6ccd-41e0-bb21-825129a20192 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:27.849976 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d663518-6ccd-41e0-bb21-825129a20192 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:27.865557 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522aaf65-bbb2-4b50-bd53-f523d4a1f0b0 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:27.872723 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf5c7a-dd59-4063-8579-bf02da5c1104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:27.873836 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf5c7a-dd59-4063-8579-bf02da5c1104 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:27.874221 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf5c7a-dd59-4063-8579-bf02da5c1104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:27.874564 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf5c7a-dd59-4063-8579-bf02da5c1104 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:27.875392 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf5c7a-dd59-4063-8579-bf02da5c1104 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:27.877427 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf5c7a-dd59-4063-8579-bf02da5c1104 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:27.885827 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:27.910354 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 805/1623] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:05:27 2022] POST /identity/v3/users => generated 289 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:27.912479 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b0296-1457-484f-9190-ca73e2344ae6 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:27.915124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b0296-1457-484f-9190-ca73e2344ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:27.915381 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b0296-1457-484f-9190-ca73e2344ae6 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:27.916488 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 819/1624] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:05:27 2022] POST /identity/v3/users => generated 296 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:27.917623 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf5c7a-dd59-4063-8579-bf02da5c1104 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:27.921170 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 806/1625] 10.222.0.24 () {54 vars in 912 bytes} [Thu May 19 15:05:27 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 15:05:27.925405 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b0296-1457-484f-9190-ca73e2344ae6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:27.934601 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf5c7a-dd59-4063-8579-bf02da5c1104 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:27.948646 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac673091-4ce2-46b6-ad21-872144b362ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:27.949587 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac673091-4ce2-46b6-ad21-872144b362ce service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:27.949880 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac673091-4ce2-46b6-ad21-872144b362ce service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:27.950164 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac673091-4ce2-46b6-ad21-872144b362ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:27.963149 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b0296-1457-484f-9190-ca73e2344ae6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:27.971584 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168ae68-40d9-4442-bf51-c6b2cac39ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:27.972831 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168ae68-40d9-4442-bf51-c6b2cac39ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:27.973499 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168ae68-40d9-4442-bf51-c6b2cac39ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:27.973841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168ae68-40d9-4442-bf51-c6b2cac39ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:27.974657 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168ae68-40d9-4442-bf51-c6b2cac39ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:27.977992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168ae68-40d9-4442-bf51-c6b2cac39ea5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:27.995316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 807/1626] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:27.996560 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168ae68-40d9-4442-bf51-c6b2cac39ea5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:28.015557 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168ae68-40d9-4442-bf51-c6b2cac39ea5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:28.030408 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13298305-afd1-4e65-9ff8-af719bb7b265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:28.031233 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13298305-afd1-4e65-9ff8-af719bb7b265 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:28.032500 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13298305-afd1-4e65-9ff8-af719bb7b265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:28.032812 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13298305-afd1-4e65-9ff8-af719bb7b265 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:28.034613 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13298305-afd1-4e65-9ff8-af719bb7b265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:28.040024 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13298305-afd1-4e65-9ff8-af719bb7b265 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:28.040334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac673091-4ce2-46b6-ad21-872144b362ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:28.043750 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac673091-4ce2-46b6-ad21-872144b362ce service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:28.058821 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 808/1627] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:28.060686 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f7eb7-6889-443f-beb3-66fc7d929fda None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:28.060985 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f7eb7-6889-443f-beb3-66fc7d929fda None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:28.061267 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f7eb7-6889-443f-beb3-66fc7d929fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:28.067729 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 820/1628] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:05:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:05:28.068660 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac673091-4ce2-46b6-ad21-872144b362ce service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:28.103951 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac673091-4ce2-46b6-ad21-872144b362ce service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:28.110169 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-212f7eb7-6889-443f-beb3-66fc7d929fda None None] MFA Rules not processed for user `06fb8bb5aeb143ad95f33c3b43dbd346`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:28.113129 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-212f7eb7-6889-443f-beb3-66fc7d929fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:28.121912 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d6788-f405-445f-9b07-179a43f855ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:28.125208 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d6788-f405-445f-9b07-179a43f855ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:28.125525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d6788-f405-445f-9b07-179a43f855ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:28.127567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d6788-f405-445f-9b07-179a43f855ae admin admin] PATH_INFO: `/v3/projects/992e5db9a82242438791cf05877ec50d/users/59f425ed72c346f6a0df0f1a604f35db/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:28.133664 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 809/1629] 10.222.0.24 () {58 vars in 1009 bytes} [Thu May 19 15:05:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:28.137301 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f7eb7-6889-443f-beb3-66fc7d929fda None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:28.162557 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f7eb7-6889-443f-beb3-66fc7d929fda None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:28.176373 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57bd67-ca03-4ed4-b8bf-95e672ec5a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:28.176735 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57bd67-ca03-4ed4-b8bf-95e672ec5a5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:28.177029 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57bd67-ca03-4ed4-b8bf-95e672ec5a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:28.177367 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57bd67-ca03-4ed4-b8bf-95e672ec5a5e admin admin] PATH_INFO: `/v3/projects/829153b474f448008890d05f1d1ef215/users/d15081d681544172be93871f71124ca6/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:28.179020 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d6788-f405-445f-9b07-179a43f855ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=992e5db9a82242438791cf05877ec50d, user_id=59f425ed72c346f6a0df0f1a604f35db, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:28.192927 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d6788-f405-445f-9b07-179a43f855ae admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:28.215849 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57bd67-ca03-4ed4-b8bf-95e672ec5a5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=829153b474f448008890d05f1d1ef215, user_id=d15081d681544172be93871f71124ca6, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:28.226333 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57bd67-ca03-4ed4-b8bf-95e672ec5a5e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:28.228722 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 821/1630] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:05:28 2022] PUT /identity/v3/projects/992e5db9a82242438791cf05877ec50d/users/59f425ed72c346f6a0df0f1a604f35db/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:28.235531 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d6788-f405-445f-9b07-179a43f855ae admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:28.271773 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 810/1631] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:05:28 2022] PUT /identity/v3/projects/829153b474f448008890d05f1d1ef215/users/d15081d681544172be93871f71124ca6/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:28.272962 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57bd67-ca03-4ed4-b8bf-95e672ec5a5e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:28.395687 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57bd67-ca03-4ed4-b8bf-95e672ec5a5e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:28.407785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8af2a4-2df4-4167-90db-a4c419489378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:28.409348 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8af2a4-2df4-4167-90db-a4c419489378 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:28.410601 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8af2a4-2df4-4167-90db-a4c419489378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:28.412003 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8af2a4-2df4-4167-90db-a4c419489378 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:28.413857 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d6788-f405-445f-9b07-179a43f855ae admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:28.413973 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8af2a4-2df4-4167-90db-a4c419489378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:28.419674 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8af2a4-2df4-4167-90db-a4c419489378 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:28.443053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 811/1632] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:28.443053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8af2a4-2df4-4167-90db-a4c419489378 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:28.454920 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8af2a4-2df4-4167-90db-a4c419489378 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:28.461600 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f99158-20e4-416b-9a12-18f35a54c87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:28.462837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f99158-20e4-416b-9a12-18f35a54c87c admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:28.463260 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f99158-20e4-416b-9a12-18f35a54c87c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:28.463649 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f99158-20e4-416b-9a12-18f35a54c87c admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:28.464560 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f99158-20e4-416b-9a12-18f35a54c87c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:28.466836 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f99158-20e4-416b-9a12-18f35a54c87c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:28.483328 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 812/1633] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:28.484967 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a9b1e-fd2a-4f1a-b398-a09b4e359562 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:28.485373 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a9b1e-fd2a-4f1a-b398-a09b4e359562 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:28.485762 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a9b1e-fd2a-4f1a-b398-a09b4e359562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:28.503359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebe9c5-8777-4023-99d3-c16f9d223929 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:28.505116 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebe9c5-8777-4023-99d3-c16f9d223929 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:28.505621 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebe9c5-8777-4023-99d3-c16f9d223929 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:28.506283 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebe9c5-8777-4023-99d3-c16f9d223929 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:28.517406 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-715a9b1e-fd2a-4f1a-b398-a09b4e359562 None None] MFA Rules not processed for user `8b06fc42235a4ea08cd81b2bf6b4a4cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:28.518786 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-715a9b1e-fd2a-4f1a-b398-a09b4e359562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:28.559518 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:28.595894 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:28.620685 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebe9c5-8777-4023-99d3-c16f9d223929 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:28.624754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebe9c5-8777-4023-99d3-c16f9d223929 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:28.627868 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 813/1634] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:28.629233 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a9b1e-fd2a-4f1a-b398-a09b4e359562 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:28.640845 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 822/1635] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:05:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:05:28.642309 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d511c-b14e-441d-9ae0-a0a7deabc1fd None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:28.642639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d511c-b14e-441d-9ae0-a0a7deabc1fd None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:28.642883 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d511c-b14e-441d-9ae0-a0a7deabc1fd None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:28.652908 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 823/1636] 10.222.0.24 () {54 vars in 912 bytes} [Thu May 19 15:05:28 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 15:05:28.653831 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d511c-b14e-441d-9ae0-a0a7deabc1fd None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:28.659255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a9b1e-fd2a-4f1a-b398-a09b4e359562 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:28.669149 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d511c-b14e-441d-9ae0-a0a7deabc1fd None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:28.675284 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337a3e4-1c83-4aec-9768-a6ed6be5a838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:28.676345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337a3e4-1c83-4aec-9768-a6ed6be5a838 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:28.676562 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337a3e4-1c83-4aec-9768-a6ed6be5a838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:28.676897 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337a3e4-1c83-4aec-9768-a6ed6be5a838 admin admin] PATH_INFO: `/v3/projects/829153b474f448008890d05f1d1ef215/users/d15081d681544172be93871f71124ca6/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:28.680602 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337a3e4-1c83-4aec-9768-a6ed6be5a838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=829153b474f448008890d05f1d1ef215, user_id=d15081d681544172be93871f71124ca6, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:28.684733 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337a3e4-1c83-4aec-9768-a6ed6be5a838 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:28.688419 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078306c-db95-44d5-9dd4-23204f4358a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:28.691334 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078306c-db95-44d5-9dd4-23204f4358a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:28.693329 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078306c-db95-44d5-9dd4-23204f4358a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:28.693743 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078306c-db95-44d5-9dd4-23204f4358a2 admin admin] PATH_INFO: `/v3/projects/992e5db9a82242438791cf05877ec50d/users/59f425ed72c346f6a0df0f1a604f35db/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:28.699427 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 824/1637] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:05:28 2022] PUT /identity/v3/projects/829153b474f448008890d05f1d1ef215/users/d15081d681544172be93871f71124ca6/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:28.701209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520a66a-164a-4113-abfb-b85a63f47b5b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:28.701508 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520a66a-164a-4113-abfb-b85a63f47b5b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:28.701930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520a66a-164a-4113-abfb-b85a63f47b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:28.716812 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078306c-db95-44d5-9dd4-23204f4358a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=992e5db9a82242438791cf05877ec50d, user_id=59f425ed72c346f6a0df0f1a604f35db, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:28.720819 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078306c-db95-44d5-9dd4-23204f4358a2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:28.728142 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-6520a66a-164a-4113-abfb-b85a63f47b5b None None] MFA Rules not processed for user `8b06fc42235a4ea08cd81b2bf6b4a4cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:28.730369 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6520a66a-164a-4113-abfb-b85a63f47b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:28.745728 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 814/1638] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:05:28 2022] PUT /identity/v3/projects/992e5db9a82242438791cf05877ec50d/users/59f425ed72c346f6a0df0f1a604f35db/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:28.749910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59292876-e839-4bf3-8df5-5ef123ae4cda None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:28.751461 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59292876-e839-4bf3-8df5-5ef123ae4cda None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:28.751760 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59292876-e839-4bf3-8df5-5ef123ae4cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:28.780364 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-59292876-e839-4bf3-8df5-5ef123ae4cda None None] MFA Rules not processed for user `06fb8bb5aeb143ad95f33c3b43dbd346`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:28.794141 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-59292876-e839-4bf3-8df5-5ef123ae4cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:28.818475 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 825/1639] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:28.819878 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48050677-f7e8-48f8-9d7f-797091b4dc1f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:28.820173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48050677-f7e8-48f8-9d7f-797091b4dc1f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:28.820993 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48050677-f7e8-48f8-9d7f-797091b4dc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:28.861082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-48050677-f7e8-48f8-9d7f-797091b4dc1f None None] MFA Rules not processed for user `d15081d681544172be93871f71124ca6`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:28.862419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-48050677-f7e8-48f8-9d7f-797091b4dc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:28.941159 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 815/1640] 10.222.0.24 () {58 vars in 1009 bytes} [Thu May 19 15:05:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:28.943354 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc7482-5a2b-470f-a915-ea41a65d8985 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:28.943849 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc7482-5a2b-470f-a915-ea41a65d8985 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:28.944487 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc7482-5a2b-470f-a915-ea41a65d8985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:28.977212 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 826/1641] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:28.977212 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48050677-f7e8-48f8-9d7f-797091b4dc1f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:28.997987 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-3ccc7482-5a2b-470f-a915-ea41a65d8985 None None] MFA Rules not processed for user `59f425ed72c346f6a0df0f1a604f35db`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:29.001159 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3ccc7482-5a2b-470f-a915-ea41a65d8985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:29.004580 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48050677-f7e8-48f8-9d7f-797091b4dc1f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:29.017067 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b1711-92dd-43f7-92a2-2a02361336fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:29.018796 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b1711-92dd-43f7-92a2-2a02361336fd service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:29.020735 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b1711-92dd-43f7-92a2-2a02361336fd service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:29.021111 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b1711-92dd-43f7-92a2-2a02361336fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:29.041572 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b1711-92dd-43f7-92a2-2a02361336fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:29.043355 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b1711-92dd-43f7-92a2-2a02361336fd service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:29.066920 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 827/1642] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:05:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:05:29.069682 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b1711-92dd-43f7-92a2-2a02361336fd service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:29.130226 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:29.140625 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 816/1643] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:28 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:29.145347 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc7482-5a2b-470f-a915-ea41a65d8985 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:29.219699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b1711-92dd-43f7-92a2-2a02361336fd service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:29.225722 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02fdb6-e0d1-42fb-b980-b146e5dc81a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:29.227811 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02fdb6-e0d1-42fb-b980-b146e5dc81a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:29.228344 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02fdb6-e0d1-42fb-b980-b146e5dc81a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:29.230578 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02fdb6-e0d1-42fb-b980-b146e5dc81a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:29.255682 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02fdb6-e0d1-42fb-b980-b146e5dc81a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:29.257870 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02fdb6-e0d1-42fb-b980-b146e5dc81a4 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:29.269648 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:29.276245 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 828/1644] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:05:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:05:29.278165 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc7482-5a2b-470f-a915-ea41a65d8985 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:29.290816 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dcbd3e-254e-45c6-8177-293c3d570851 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:29.291793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcbd3e-254e-45c6-8177-293c3d570851 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:29.292081 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcbd3e-254e-45c6-8177-293c3d570851 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:29.292391 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcbd3e-254e-45c6-8177-293c3d570851 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:29.319183 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dcbd3e-254e-45c6-8177-293c3d570851 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:29.321141 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dcbd3e-254e-45c6-8177-293c3d570851 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:29.347689 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 817/1645] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:05:29 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:05:29.416640 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02fdb6-e0d1-42fb-b980-b146e5dc81a4 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:29.440661 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02fdb6-e0d1-42fb-b980-b146e5dc81a4 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:29.451139 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ad9f6-7085-4c8d-8abc-19eeec26aec8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:29.455106 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ad9f6-7085-4c8d-8abc-19eeec26aec8 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:29.456078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ad9f6-7085-4c8d-8abc-19eeec26aec8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:29.456511 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ad9f6-7085-4c8d-8abc-19eeec26aec8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:29.482566 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ad9f6-7085-4c8d-8abc-19eeec26aec8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:29.486400 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ad9f6-7085-4c8d-8abc-19eeec26aec8 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:29.507997 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 829/1646] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:05:29 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:05:29.722833 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dcbd3e-254e-45c6-8177-293c3d570851 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:29.739798 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dcbd3e-254e-45c6-8177-293c3d570851 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:29.747083 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73728387-2cb5-4f19-b1d9-bb4d52d394de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:29.748298 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73728387-2cb5-4f19-b1d9-bb4d52d394de service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:29.749273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73728387-2cb5-4f19-b1d9-bb4d52d394de service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:29.750772 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73728387-2cb5-4f19-b1d9-bb4d52d394de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:29.920883 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73728387-2cb5-4f19-b1d9-bb4d52d394de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:29.922838 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73728387-2cb5-4f19-b1d9-bb4d52d394de service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:29.954695 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 818/1647] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:05:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:05:30.170250 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4036b6-9d33-4f9c-9070-ba840655c103 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:30.170756 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4036b6-9d33-4f9c-9070-ba840655c103 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:30.171053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4036b6-9d33-4f9c-9070-ba840655c103 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:30.172813 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 830/1648] 10.222.0.24 () {54 vars in 912 bytes} [Thu May 19 15:05:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 15:05:30.178437 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcaea9-c43d-44e1-b770-bb6de79a8a28 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:30.178733 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcaea9-c43d-44e1-b770-bb6de79a8a28 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:30.179086 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcaea9-c43d-44e1-b770-bb6de79a8a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:30.195884 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4036b6-9d33-4f9c-9070-ba840655c103 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:30.212312 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8edcaea9-c43d-44e1-b770-bb6de79a8a28 None None] MFA Rules not processed for user `2d089b5ee94e441ebbd084c2581a42df`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:30.213964 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8edcaea9-c43d-44e1-b770-bb6de79a8a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:30.218415 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4036b6-9d33-4f9c-9070-ba840655c103 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:30.232453 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412b1ca-09d0-4180-bc16-ab27b7b01013 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:30.233154 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412b1ca-09d0-4180-bc16-ab27b7b01013 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:30.234404 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412b1ca-09d0-4180-bc16-ab27b7b01013 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:30.236168 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412b1ca-09d0-4180-bc16-ab27b7b01013 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:30.363996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 819/1649] 10.222.0.24 () {58 vars in 1009 bytes} [Thu May 19 15:05:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:30.402678 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412b1ca-09d0-4180-bc16-ab27b7b01013 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:30.405093 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412b1ca-09d0-4180-bc16-ab27b7b01013 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:30.414865 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcaea9-c43d-44e1-b770-bb6de79a8a28 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:30.431444 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcaea9-c43d-44e1-b770-bb6de79a8a28 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:30.441432 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5f85f-90a2-4179-9159-b2e61bed6326 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:30.442504 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5f85f-90a2-4179-9159-b2e61bed6326 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:30.442794 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5f85f-90a2-4179-9159-b2e61bed6326 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:30.443074 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5f85f-90a2-4179-9159-b2e61bed6326 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:30.454360 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 831/1650] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:05:30 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 15:05:30.458252 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5f85f-90a2-4179-9159-b2e61bed6326 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:30.459766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5f85f-90a2-4179-9159-b2e61bed6326 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:30.484096 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 820/1651] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:05:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 15:05:30.866464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412b1ca-09d0-4180-bc16-ab27b7b01013 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:31.011550 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412b1ca-09d0-4180-bc16-ab27b7b01013 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:31.024388 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50164623-5ff0-4cd0-be84-8e1b9d17dfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:31.025706 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50164623-5ff0-4cd0-be84-8e1b9d17dfb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:31.025706 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50164623-5ff0-4cd0-be84-8e1b9d17dfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:31.026159 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50164623-5ff0-4cd0-be84-8e1b9d17dfb1 admin admin] PATH_INFO: `/v3/users/1433960e92d44d23b690e40a733778a8` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:31.029034 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50164623-5ff0-4cd0-be84-8e1b9d17dfb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1433960e92d44d23b690e40a733778a8)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:31.030845 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: WARNING py.warnings [None req-50164623-5ff0-4cd0-be84-8e1b9d17dfb1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 15:05:31.030845 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: warnings.warn(msg) May 19 15:05:31.030845 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: May 19 15:05:31.034857 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50164623-5ff0-4cd0-be84-8e1b9d17dfb1 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:31.188719 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-50164623-5ff0-4cd0-be84-8e1b9d17dfb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1433960e92d44d23b690e40a733778a8'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:31.189319 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-50164623-5ff0-4cd0-be84-8e1b9d17dfb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1433960e92d44d23b690e40a733778a8'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:31.190686 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-50164623-5ff0-4cd0-be84-8e1b9d17dfb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1433960e92d44d23b690e40a733778a8'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:31.215154 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-50164623-5ff0-4cd0-be84-8e1b9d17dfb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1433960e92d44d23b690e40a733778a8'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:31.220631 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:31.273285 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-50164623-5ff0-4cd0-be84-8e1b9d17dfb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1433960e92d44d23b690e40a733778a8'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:31.308820 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 832/1652] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:05:30 2022] DELETE /identity/v3/users/1433960e92d44d23b690e40a733778a8 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:31.317461 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb708cb-372b-4f78-a95d-f5dd2290c3aa None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:31.317461 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb708cb-372b-4f78-a95d-f5dd2290c3aa None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:31.318001 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb708cb-372b-4f78-a95d-f5dd2290c3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:31.378274 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0fb708cb-372b-4f78-a95d-f5dd2290c3aa None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:31.382195 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0fb708cb-372b-4f78-a95d-f5dd2290c3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:31.528333 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5f0cb-0bde-41c0-91c5-561d10dfb6f6 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:31.528333 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5f0cb-0bde-41c0-91c5-561d10dfb6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:31.528333 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5f0cb-0bde-41c0-91c5-561d10dfb6f6 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:31.528333 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 833/1653] 10.222.0.24 () {54 vars in 960 bytes} [Thu May 19 15:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 15:05:31.528333 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c250d-b5d7-44a9-b6d5-fb63c5731f96 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:31.528333 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c250d-b5d7-44a9-b6d5-fb63c5731f96 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:31.539913 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c250d-b5d7-44a9-b6d5-fb63c5731f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:31.559335 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 821/1654] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:31.598011 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb708cb-372b-4f78-a95d-f5dd2290c3aa None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:31.599548 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0fb708cb-372b-4f78-a95d-f5dd2290c3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:31.681215 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:31.744480 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb708cb-372b-4f78-a95d-f5dd2290c3aa None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:31.761522 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59412ed-dfe7-440f-95f8-3367040c6ed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:31.766170 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59412ed-dfe7-440f-95f8-3367040c6ed9 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:31.766529 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59412ed-dfe7-440f-95f8-3367040c6ed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:31.767551 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59412ed-dfe7-440f-95f8-3367040c6ed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:31.803969 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59412ed-dfe7-440f-95f8-3367040c6ed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:31.806062 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59412ed-dfe7-440f-95f8-3367040c6ed9 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:31.854223 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 822/1655] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:05:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 15:05:32.106098 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-c46c250d-b5d7-44a9-b6d5-fb63c5731f96 None None] MFA Rules not processed for user `adec680c4f5f4e6dbe5989d5d7acf620`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:32.110169 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c46c250d-b5d7-44a9-b6d5-fb63c5731f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:32.274403 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 834/1656] 10.222.0.24 () {58 vars in 1057 bytes} [Thu May 19 15:05:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 751 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:32.283326 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59412ed-dfe7-440f-95f8-3367040c6ed9 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:32.305466 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59412ed-dfe7-440f-95f8-3367040c6ed9 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:32.321870 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63471c-9321-482e-bdbb-bfad083742c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adec680c4f5f4e6dbe5989d5d7acf620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:32.325749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63471c-9321-482e-bdbb-bfad083742c9 service placement] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:32.326804 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63471c-9321-482e-bdbb-bfad083742c9 service placement] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:32.327445 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63471c-9321-482e-bdbb-bfad083742c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:32.333173 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9d63471c-9321-482e-bdbb-bfad083742c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:32.366243 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63471c-9321-482e-bdbb-bfad083742c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:32.372956 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63471c-9321-482e-bdbb-bfad083742c9 service placement] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:32.400656 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 823/1657] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:05:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:05:32.880299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c250d-b5d7-44a9-b6d5-fb63c5731f96 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:32.881764 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c46c250d-b5d7-44a9-b6d5-fb63c5731f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:32.933995 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c250d-b5d7-44a9-b6d5-fb63c5731f96 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:32.961620 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a045c-75c1-4988-9f76-99b4010a7701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:32.962680 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a045c-75c1-4988-9f76-99b4010a7701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:32.963031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a045c-75c1-4988-9f76-99b4010a7701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:32.963342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a045c-75c1-4988-9f76-99b4010a7701 admin admin] PATH_INFO: `/v3/projects/9df0c05a04984193ad8649a31bcb7d05` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:32.965382 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a045c-75c1-4988-9f76-99b4010a7701 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9df0c05a04984193ad8649a31bcb7d05)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:32.979868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a045c-75c1-4988-9f76-99b4010a7701 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:33.112455 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-dc4a045c-75c1-4988-9f76-99b4010a7701 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9df0c05a04984193ad8649a31bcb7d05', 'request_id': 'req-dc4a045c-75c1-4988-9f76-99b4010a7701'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:33.127442 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-dc4a045c-75c1-4988-9f76-99b4010a7701 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9df0c05a04984193ad8649a31bcb7d05', 'request_id': 'req-dc4a045c-75c1-4988-9f76-99b4010a7701'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:33.141031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-dc4a045c-75c1-4988-9f76-99b4010a7701 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9df0c05a04984193ad8649a31bcb7d05', 'request_id': 'req-dc4a045c-75c1-4988-9f76-99b4010a7701'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:33.169043 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-dc4a045c-75c1-4988-9f76-99b4010a7701 admin admin] The token cache is being invalidate because project 9df0c05a04984193ad8649a31bcb7d05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:05:33.170096 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-dc4a045c-75c1-4988-9f76-99b4010a7701 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:33.170973 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-dc4a045c-75c1-4988-9f76-99b4010a7701 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:33.176615 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 835/1658] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:05:32 2022] DELETE /identity/v3/projects/9df0c05a04984193ad8649a31bcb7d05 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:33.177980 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3207e-ddc9-4bd0-bae8-3d9aedb5927b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:33.178468 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3207e-ddc9-4bd0-bae8-3d9aedb5927b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:33.178992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3207e-ddc9-4bd0-bae8-3d9aedb5927b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:33.220562 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-65e3207e-ddc9-4bd0-bae8-3d9aedb5927b None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:33.225399 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-65e3207e-ddc9-4bd0-bae8-3d9aedb5927b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:33.458458 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 824/1659] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:33.458996 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a212b-9c77-46c3-a510-2a5968b7e4d2 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:33.458996 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a212b-9c77-46c3-a510-2a5968b7e4d2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:33.458996 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a212b-9c77-46c3-a510-2a5968b7e4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:33.490730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-c24a212b-9c77-46c3-a510-2a5968b7e4d2 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:33.494304 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c24a212b-9c77-46c3-a510-2a5968b7e4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:33.506137 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 836/1660] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:33.507443 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3207e-ddc9-4bd0-bae8-3d9aedb5927b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:33.525522 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3207e-ddc9-4bd0-bae8-3d9aedb5927b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:33.541327 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e50aa-61f8-4614-9406-bca639b776a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:33.542346 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e50aa-61f8-4614-9406-bca639b776a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:33.542768 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e50aa-61f8-4614-9406-bca639b776a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:33.543173 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e50aa-61f8-4614-9406-bca639b776a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:33.544199 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e50aa-61f8-4614-9406-bca639b776a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:05:33.544829 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e50aa-61f8-4614-9406-bca639b776a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:33.546817 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e50aa-61f8-4614-9406-bca639b776a3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:33.569481 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a212b-9c77-46c3-a510-2a5968b7e4d2 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:33.577311 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 825/1661] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:05:33.583039 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a212b-9c77-46c3-a510-2a5968b7e4d2 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:33.588355 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb6c83-9578-4bdf-b6fd-b5e553e5d06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:33.589114 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb6c83-9578-4bdf-b6fd-b5e553e5d06c admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:33.589603 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb6c83-9578-4bdf-b6fd-b5e553e5d06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:33.590553 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb6c83-9578-4bdf-b6fd-b5e553e5d06c admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:33.591426 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb6c83-9578-4bdf-b6fd-b5e553e5d06c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:33.593706 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb6c83-9578-4bdf-b6fd-b5e553e5d06c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:33.639423 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 837/1662] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:05:33 2022] POST /identity/v3/projects => generated 401 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:33.643911 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e50aa-61f8-4614-9406-bca639b776a3 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:33.664908 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e50aa-61f8-4614-9406-bca639b776a3 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:33.786343 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f52d25-d62b-4a2f-8fb6-b86f266e9633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:33.786980 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f52d25-d62b-4a2f-8fb6-b86f266e9633 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:33.788045 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f52d25-d62b-4a2f-8fb6-b86f266e9633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:33.788345 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f52d25-d62b-4a2f-8fb6-b86f266e9633 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:33.789684 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f52d25-d62b-4a2f-8fb6-b86f266e9633 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:33.794298 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f52d25-d62b-4a2f-8fb6-b86f266e9633 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:33.858751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 826/1663] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:05:33 2022] POST /identity/v3/users => generated 301 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:33.860353 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb6c83-9578-4bdf-b6fd-b5e553e5d06c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:33.900107 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb6c83-9578-4bdf-b6fd-b5e553e5d06c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:33.916681 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610714e-d308-475d-be29-96c70589a515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:33.917532 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610714e-d308-475d-be29-96c70589a515 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:33.917895 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610714e-d308-475d-be29-96c70589a515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:33.918249 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610714e-d308-475d-be29-96c70589a515 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:33.919718 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610714e-d308-475d-be29-96c70589a515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:33.922965 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610714e-d308-475d-be29-96c70589a515 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:33.950523 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 838/1664] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:33.956846 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f52d25-d62b-4a2f-8fb6-b86f266e9633 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:33.978516 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f52d25-d62b-4a2f-8fb6-b86f266e9633 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:34.000012 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ebf7ed-3080-4749-8ea9-60b4fd0ee847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:34.001554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebf7ed-3080-4749-8ea9-60b4fd0ee847 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:34.001856 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebf7ed-3080-4749-8ea9-60b4fd0ee847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:34.002143 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebf7ed-3080-4749-8ea9-60b4fd0ee847 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:34.005313 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ebf7ed-3080-4749-8ea9-60b4fd0ee847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:34.010650 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ebf7ed-3080-4749-8ea9-60b4fd0ee847 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:34.067086 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610714e-d308-475d-be29-96c70589a515 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:34.078354 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 827/1665] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:34.089285 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610714e-d308-475d-be29-96c70589a515 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:34.116828 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5a3d3-7f22-4607-830c-cf80defae42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:34.118631 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5a3d3-7f22-4607-830c-cf80defae42c admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:34.118773 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5a3d3-7f22-4607-830c-cf80defae42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:34.119161 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5a3d3-7f22-4607-830c-cf80defae42c admin admin] PATH_INFO: `/v3/projects/5c5f786b6e3843c8bb013bc7466f531e/users/e277601d42b14c9ba60367a45b138341/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:34.165989 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:34.188969 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5a3d3-7f22-4607-830c-cf80defae42c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c5f786b6e3843c8bb013bc7466f531e, user_id=e277601d42b14c9ba60367a45b138341, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:34.195036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5a3d3-7f22-4607-830c-cf80defae42c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:34.227428 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 839/1666] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:05:34 2022] PUT /identity/v3/projects/5c5f786b6e3843c8bb013bc7466f531e/users/e277601d42b14c9ba60367a45b138341/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:05:34.239248 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b55a0-162a-47ed-95f7-a0f6831dff98 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:34.243020 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b55a0-162a-47ed-95f7-a0f6831dff98 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:34.243673 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b55a0-162a-47ed-95f7-a0f6831dff98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:34.299304 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d02b55a0-162a-47ed-95f7-a0f6831dff98 None None] MFA Rules not processed for user `e277601d42b14c9ba60367a45b138341`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:34.307050 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d02b55a0-162a-47ed-95f7-a0f6831dff98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:34.349920 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:34.453631 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 828/1667] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:34.453853 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5a3d3-7f22-4607-830c-cf80defae42c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:34.612530 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5a3d3-7f22-4607-830c-cf80defae42c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:34.618892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccded22f-57d7-40b8-8630-eeb274b46f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:34.619601 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccded22f-57d7-40b8-8630-eeb274b46f92 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:34.619893 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccded22f-57d7-40b8-8630-eeb274b46f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:34.620172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccded22f-57d7-40b8-8630-eeb274b46f92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:34.621142 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccded22f-57d7-40b8-8630-eeb274b46f92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:34.623049 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccded22f-57d7-40b8-8630-eeb274b46f92 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:34.685413 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 840/1668] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:05:34 2022] POST /identity/v3/projects => generated 405 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:34.690154 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b55a0-162a-47ed-95f7-a0f6831dff98 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:34.718183 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b55a0-162a-47ed-95f7-a0f6831dff98 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:34.858271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545cf555-ded5-4b39-a1e9-8d1b370e2ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:34.859026 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cf555-ded5-4b39-a1e9-8d1b370e2ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:34.859346 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cf555-ded5-4b39-a1e9-8d1b370e2ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:34.863032 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cf555-ded5-4b39-a1e9-8d1b370e2ed0 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:34.863687 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545cf555-ded5-4b39-a1e9-8d1b370e2ed0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:34.865690 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545cf555-ded5-4b39-a1e9-8d1b370e2ed0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:34.916660 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 829/1669] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:05:34 2022] POST /identity/v3/users => generated 309 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:34.919465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccded22f-57d7-40b8-8630-eeb274b46f92 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:34.944379 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccded22f-57d7-40b8-8630-eeb274b46f92 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:34.960030 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534739c-4041-4809-b5ad-8f1fac716c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:34.960729 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534739c-4041-4809-b5ad-8f1fac716c32 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:34.961065 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534739c-4041-4809-b5ad-8f1fac716c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:34.962420 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534739c-4041-4809-b5ad-8f1fac716c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:34.962420 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534739c-4041-4809-b5ad-8f1fac716c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:34.965348 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534739c-4041-4809-b5ad-8f1fac716c32 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:34.998990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 841/1670] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:35.003388 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545cf555-ded5-4b39-a1e9-8d1b370e2ed0 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:35.017921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545cf555-ded5-4b39-a1e9-8d1b370e2ed0 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:35.033241 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81331e94-efc6-4545-a3b9-07cdd24e4d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:35.034165 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81331e94-efc6-4545-a3b9-07cdd24e4d9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:35.034611 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81331e94-efc6-4545-a3b9-07cdd24e4d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:35.034904 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81331e94-efc6-4545-a3b9-07cdd24e4d9c admin admin] PATH_INFO: `/v3/projects/4ec716c74be140948fb351709f807505/users/3800507e4e4046a297cc7ee59f5d9948/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:35.068913 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81331e94-efc6-4545-a3b9-07cdd24e4d9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ec716c74be140948fb351709f807505, user_id=3800507e4e4046a297cc7ee59f5d9948, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:35.072247 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81331e94-efc6-4545-a3b9-07cdd24e4d9c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:35.104875 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 830/1671] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:05:35 2022] PUT /identity/v3/projects/4ec716c74be140948fb351709f807505/users/3800507e4e4046a297cc7ee59f5d9948/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:35.109992 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534739c-4041-4809-b5ad-8f1fac716c32 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:35.127766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534739c-4041-4809-b5ad-8f1fac716c32 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:35.259907 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075ab05-6013-4f15-a9ec-6d341f6f5ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:35.260603 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075ab05-6013-4f15-a9ec-6d341f6f5ddc admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:35.260898 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075ab05-6013-4f15-a9ec-6d341f6f5ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:35.261225 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075ab05-6013-4f15-a9ec-6d341f6f5ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:35.261895 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075ab05-6013-4f15-a9ec-6d341f6f5ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:35.263531 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075ab05-6013-4f15-a9ec-6d341f6f5ddc admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:35.294302 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81331e94-efc6-4545-a3b9-07cdd24e4d9c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:35.301082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 842/1672] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:35.309489 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81331e94-efc6-4545-a3b9-07cdd24e4d9c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:35.330168 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cebd03-8eb3-4e66-916a-6f4afed1b59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:35.331028 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cebd03-8eb3-4e66-916a-6f4afed1b59b admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:35.331345 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cebd03-8eb3-4e66-916a-6f4afed1b59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:35.331629 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cebd03-8eb3-4e66-916a-6f4afed1b59b admin admin] PATH_INFO: `/v3/projects/4ec716c74be140948fb351709f807505/users/3800507e4e4046a297cc7ee59f5d9948/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:35.345096 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cebd03-8eb3-4e66-916a-6f4afed1b59b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ec716c74be140948fb351709f807505, user_id=3800507e4e4046a297cc7ee59f5d9948, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:35.347932 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cebd03-8eb3-4e66-916a-6f4afed1b59b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:35.371276 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 831/1673] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:05:35 2022] PUT /identity/v3/projects/4ec716c74be140948fb351709f807505/users/3800507e4e4046a297cc7ee59f5d9948/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:35.381747 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ca681-eaf5-4afb-8c03-406712a58841 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:35.382561 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ca681-eaf5-4afb-8c03-406712a58841 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:35.383587 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ca681-eaf5-4afb-8c03-406712a58841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:35.471081 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-da8ca681-eaf5-4afb-8c03-406712a58841 None None] MFA Rules not processed for user `3800507e4e4046a297cc7ee59f5d9948`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:35.473527 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-da8ca681-eaf5-4afb-8c03-406712a58841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:35.596385 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:35.673169 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 843/1674] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:35 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:35.686378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cebd03-8eb3-4e66-916a-6f4afed1b59b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:35.689049 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-52cebd03-8eb3-4e66-916a-6f4afed1b59b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:35.818309 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cebd03-8eb3-4e66-916a-6f4afed1b59b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:35.831674 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65890a51-26f6-4ba0-8d81-7bfb49ba9add service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:35.832607 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65890a51-26f6-4ba0-8d81-7bfb49ba9add service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:35.833606 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65890a51-26f6-4ba0-8d81-7bfb49ba9add service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:35.834049 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65890a51-26f6-4ba0-8d81-7bfb49ba9add service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:35.847031 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65890a51-26f6-4ba0-8d81-7bfb49ba9add service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:35.849189 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65890a51-26f6-4ba0-8d81-7bfb49ba9add service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:35.881757 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 832/1675] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:05:35 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:05:36.161335 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ca681-eaf5-4afb-8c03-406712a58841 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:36.275937 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ca681-eaf5-4afb-8c03-406712a58841 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:36.281434 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e099f-1e5a-4e8e-892b-f21e922dbe9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:36.282334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e099f-1e5a-4e8e-892b-f21e922dbe9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:36.282622 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e099f-1e5a-4e8e-892b-f21e922dbe9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:36.282899 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e099f-1e5a-4e8e-892b-f21e922dbe9d admin admin] PATH_INFO: `/v3/users/e277601d42b14c9ba60367a45b138341` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:36.284416 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e099f-1e5a-4e8e-892b-f21e922dbe9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e277601d42b14c9ba60367a45b138341)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:36.286793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e099f-1e5a-4e8e-892b-f21e922dbe9d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:36.392512 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-df5e099f-1e5a-4e8e-892b-f21e922dbe9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e277601d42b14c9ba60367a45b138341'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:36.393012 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-df5e099f-1e5a-4e8e-892b-f21e922dbe9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e277601d42b14c9ba60367a45b138341'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:36.393765 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-df5e099f-1e5a-4e8e-892b-f21e922dbe9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e277601d42b14c9ba60367a45b138341'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:36.413376 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-df5e099f-1e5a-4e8e-892b-f21e922dbe9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e277601d42b14c9ba60367a45b138341'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:36.466346 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-df5e099f-1e5a-4e8e-892b-f21e922dbe9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e277601d42b14c9ba60367a45b138341'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:36.513838 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 844/1676] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:05:36 2022] DELETE /identity/v3/users/e277601d42b14c9ba60367a45b138341 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:36.517288 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa552a3d-dd15-413b-82c5-93252c8a27b6 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:36.517953 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa552a3d-dd15-413b-82c5-93252c8a27b6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:36.518259 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa552a3d-dd15-413b-82c5-93252c8a27b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:36.543245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:36.564244 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-aa552a3d-dd15-413b-82c5-93252c8a27b6 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:36.570931 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-aa552a3d-dd15-413b-82c5-93252c8a27b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:36.768285 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 833/1677] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:36.839339 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e099f-1e5a-4e8e-892b-f21e922dbe9d admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:36.845407 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-df5e099f-1e5a-4e8e-892b-f21e922dbe9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:37.041937 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e099f-1e5a-4e8e-892b-f21e922dbe9d admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:37.048550 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547050f2-dada-4e9e-aa5d-cd85c90f160b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:37.049903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547050f2-dada-4e9e-aa5d-cd85c90f160b service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:37.050579 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547050f2-dada-4e9e-aa5d-cd85c90f160b service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:37.051087 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547050f2-dada-4e9e-aa5d-cd85c90f160b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:37.072470 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547050f2-dada-4e9e-aa5d-cd85c90f160b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:37.074638 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547050f2-dada-4e9e-aa5d-cd85c90f160b service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:37.090384 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 845/1678] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:05:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:05:37.218771 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684862be-9e25-4946-abcd-a5fcfa768557 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:37.219340 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684862be-9e25-4946-abcd-a5fcfa768557 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:37.219737 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684862be-9e25-4946-abcd-a5fcfa768557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:37.276678 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-684862be-9e25-4946-abcd-a5fcfa768557 None None] MFA Rules not processed for user `fcd1725924134616b903b3e374d45817`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:37.282791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-684862be-9e25-4946-abcd-a5fcfa768557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:37.408090 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 834/1679] 10.222.0.24 () {58 vars in 1009 bytes} [Thu May 19 15:05:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:37.681730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547050f2-dada-4e9e-aa5d-cd85c90f160b service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:37.684280 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-547050f2-dada-4e9e-aa5d-cd85c90f160b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:37.694728 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:37.872410 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547050f2-dada-4e9e-aa5d-cd85c90f160b service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:37.893946 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb4ea1-5fd4-4817-b5dc-33809179cb92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecbeee0c1cf4c58be6c22aa11d7ff5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:37.906976 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb4ea1-5fd4-4817-b5dc-33809179cb92 service swift] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:37.907819 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb4ea1-5fd4-4817-b5dc-33809179cb92 service swift] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:37.908324 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb4ea1-5fd4-4817-b5dc-33809179cb92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:37.936989 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb4ea1-5fd4-4817-b5dc-33809179cb92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:37.938903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb4ea1-5fd4-4817-b5dc-33809179cb92 service swift] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:37.973027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 846/1680] 10.222.0.24 () {60 vars in 1384 bytes} [Thu May 19 15:05:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 15:05:38.418419 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684862be-9e25-4946-abcd-a5fcfa768557 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:38.420216 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-684862be-9e25-4946-abcd-a5fcfa768557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:38.467102 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659899a-0a67-457f-9f02-d13a8df54017 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:38.467458 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659899a-0a67-457f-9f02-d13a8df54017 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:38.467808 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659899a-0a67-457f-9f02-d13a8df54017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:38.471247 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684862be-9e25-4946-abcd-a5fcfa768557 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:38.507644 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf2e00-894c-4ea1-a112-747660015d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:38.508786 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf2e00-894c-4ea1-a112-747660015d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:38.509241 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf2e00-894c-4ea1-a112-747660015d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:38.509671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf2e00-894c-4ea1-a112-747660015d5d admin admin] PATH_INFO: `/v3/projects/5c5f786b6e3843c8bb013bc7466f531e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:38.511349 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf2e00-894c-4ea1-a112-747660015d5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c5f786b6e3843c8bb013bc7466f531e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:38.513367 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: WARNING py.warnings [None req-daaf2e00-894c-4ea1-a112-747660015d5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 19 15:05:38.513367 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: warnings.warn(msg) May 19 15:05:38.513367 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: May 19 15:05:38.521768 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf2e00-894c-4ea1-a112-747660015d5d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:38.531595 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-8659899a-0a67-457f-9f02-d13a8df54017 None None] MFA Rules not processed for user `af7838e525a042dfa0357ad1fc58cf21`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:38.532870 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8659899a-0a67-457f-9f02-d13a8df54017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:38.695935 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-daaf2e00-894c-4ea1-a112-747660015d5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c5f786b6e3843c8bb013bc7466f531e', 'request_id': 'req-daaf2e00-894c-4ea1-a112-747660015d5d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:38.723040 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-daaf2e00-894c-4ea1-a112-747660015d5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c5f786b6e3843c8bb013bc7466f531e', 'request_id': 'req-daaf2e00-894c-4ea1-a112-747660015d5d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:38.754488 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-daaf2e00-894c-4ea1-a112-747660015d5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c5f786b6e3843c8bb013bc7466f531e', 'request_id': 'req-daaf2e00-894c-4ea1-a112-747660015d5d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:38.775763 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-daaf2e00-894c-4ea1-a112-747660015d5d admin admin] The token cache is being invalidate because project 5c5f786b6e3843c8bb013bc7466f531e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:05:38.776392 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-daaf2e00-894c-4ea1-a112-747660015d5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:38.778356 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-daaf2e00-894c-4ea1-a112-747660015d5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:38.780569 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 835/1681] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:05:38 2022] DELETE /identity/v3/projects/5c5f786b6e3843c8bb013bc7466f531e => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:38.784542 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf2e00-894c-4ea1-a112-747660015d5d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:38.786914 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-daaf2e00-894c-4ea1-a112-747660015d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:38.827949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 847/1682] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:05:38.835105 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659899a-0a67-457f-9f02-d13a8df54017 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:38.843092 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8659899a-0a67-457f-9f02-d13a8df54017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:39.035282 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659899a-0a67-457f-9f02-d13a8df54017 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:39.060450 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:39.098250 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:39.161355 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf2e00-894c-4ea1-a112-747660015d5d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:39.186342 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2a9d5-8116-4cb8-b171-e2c8e411baf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:39.187305 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2a9d5-8116-4cb8-b171-e2c8e411baf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:39.187602 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2a9d5-8116-4cb8-b171-e2c8e411baf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:39.194044 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2a9d5-8116-4cb8-b171-e2c8e411baf3 admin admin] PATH_INFO: `/v3/users/3800507e4e4046a297cc7ee59f5d9948` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:39.206074 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2a9d5-8116-4cb8-b171-e2c8e411baf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3800507e4e4046a297cc7ee59f5d9948)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:39.208412 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e04da-c351-4e22-a8e8-24c2a710cd6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:39.209165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e04da-c351-4e22-a8e8-24c2a710cd6e service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:39.209517 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e04da-c351-4e22-a8e8-24c2a710cd6e service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:39.209952 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e04da-c351-4e22-a8e8-24c2a710cd6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:39.216423 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ee5e04da-c351-4e22-a8e8-24c2a710cd6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:39.220265 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2a9d5-8116-4cb8-b171-e2c8e411baf3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:39.356834 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3ed2a9d5-8116-4cb8-b171-e2c8e411baf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3800507e4e4046a297cc7ee59f5d9948'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:39.367917 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e04da-c351-4e22-a8e8-24c2a710cd6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:39.368488 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3ed2a9d5-8116-4cb8-b171-e2c8e411baf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3800507e4e4046a297cc7ee59f5d9948'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:39.369551 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e04da-c351-4e22-a8e8-24c2a710cd6e service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:39.386291 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3ed2a9d5-8116-4cb8-b171-e2c8e411baf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3800507e4e4046a297cc7ee59f5d9948'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:39.387487 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3ed2a9d5-8116-4cb8-b171-e2c8e411baf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3800507e4e4046a297cc7ee59f5d9948'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:39.388357 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3ed2a9d5-8116-4cb8-b171-e2c8e411baf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3800507e4e4046a297cc7ee59f5d9948'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:39.394314 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 848/1683] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:05:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:05:39.396692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b66598-5649-4e3d-b877-fd2d6ccd9771 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:39.397203 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b66598-5649-4e3d-b877-fd2d6ccd9771 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:39.397700 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b66598-5649-4e3d-b877-fd2d6ccd9771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:39.429518 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 836/1684] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:05:38 2022] DELETE /identity/v3/users/3800507e4e4046a297cc7ee59f5d9948 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:39.453869 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-27b66598-5649-4e3d-b877-fd2d6ccd9771 None None] MFA Rules not processed for user `e5374c90f38b47fcb611e346f3f2ec69`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:39.455190 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-27b66598-5649-4e3d-b877-fd2d6ccd9771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:39.604486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 849/1685] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:39.613632 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7664d8-160a-412e-98ad-0aae427ddccd None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:39.613928 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7664d8-160a-412e-98ad-0aae427ddccd None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:39.614211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7664d8-160a-412e-98ad-0aae427ddccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:39.655344 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4e7664d8-160a-412e-98ad-0aae427ddccd None None] MFA Rules not processed for user `e5374c90f38b47fcb611e346f3f2ec69`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:39.658345 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4e7664d8-160a-412e-98ad-0aae427ddccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:39.683519 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 837/1686] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:39.693469 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b66598-5649-4e3d-b877-fd2d6ccd9771 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:39.700082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-27b66598-5649-4e3d-b877-fd2d6ccd9771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:39.891571 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:39.981214 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b66598-5649-4e3d-b877-fd2d6ccd9771 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:39.991859 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb42b80-1e4b-46e6-8758-16b40a975d17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:39.993671 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb42b80-1e4b-46e6-8758-16b40a975d17 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:39.993671 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb42b80-1e4b-46e6-8758-16b40a975d17 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:39.994024 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb42b80-1e4b-46e6-8758-16b40a975d17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:40.015494 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb42b80-1e4b-46e6-8758-16b40a975d17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:40.027187 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb42b80-1e4b-46e6-8758-16b40a975d17 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:40.113967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 850/1687] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:05:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:05:40.421372 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7664d8-160a-412e-98ad-0aae427ddccd None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:40.422813 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4e7664d8-160a-412e-98ad-0aae427ddccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:40.747539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7664d8-160a-412e-98ad-0aae427ddccd None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:40.775986 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fec03f-fd8f-490c-ab26-03b874e692f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:40.776887 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fec03f-fd8f-490c-ab26-03b874e692f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:40.777174 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fec03f-fd8f-490c-ab26-03b874e692f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:40.777454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fec03f-fd8f-490c-ab26-03b874e692f7 admin admin] PATH_INFO: `/v3/projects/4ec716c74be140948fb351709f807505` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:40.781407 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fec03f-fd8f-490c-ab26-03b874e692f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ec716c74be140948fb351709f807505)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:40.790430 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fec03f-fd8f-490c-ab26-03b874e692f7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:40.918224 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b9fec03f-fd8f-490c-ab26-03b874e692f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ec716c74be140948fb351709f807505', 'request_id': 'req-b9fec03f-fd8f-490c-ab26-03b874e692f7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:40.920201 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:40.956846 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b9fec03f-fd8f-490c-ab26-03b874e692f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ec716c74be140948fb351709f807505', 'request_id': 'req-b9fec03f-fd8f-490c-ab26-03b874e692f7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:40.981186 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b9fec03f-fd8f-490c-ab26-03b874e692f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ec716c74be140948fb351709f807505', 'request_id': 'req-b9fec03f-fd8f-490c-ab26-03b874e692f7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:41.014349 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b9fec03f-fd8f-490c-ab26-03b874e692f7 admin admin] The token cache is being invalidate because project 4ec716c74be140948fb351709f807505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:05:41.014635 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b9fec03f-fd8f-490c-ab26-03b874e692f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:41.019809 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b9fec03f-fd8f-490c-ab26-03b874e692f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:41.026799 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 838/1688] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:05:40 2022] DELETE /identity/v3/projects/4ec716c74be140948fb351709f807505 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:41.028306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7612f9f-3fdc-4946-822f-35ccab55671d None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:41.028597 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7612f9f-3fdc-4946-822f-35ccab55671d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:41.028877 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7612f9f-3fdc-4946-822f-35ccab55671d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:41.091845 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b96850-2039-4181-9b25-05ffa0e0eda6 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:41.092163 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b96850-2039-4181-9b25-05ffa0e0eda6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:41.092420 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b96850-2039-4181-9b25-05ffa0e0eda6 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:41.093966 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 839/1689] 10.222.0.24 () {54 vars in 912 bytes} [Thu May 19 15:05:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 19 15:05:41.100668 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a270c-98eb-4838-bc0c-ac2af962c61b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:41.100964 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a270c-98eb-4838-bc0c-ac2af962c61b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:41.101364 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a270c-98eb-4838-bc0c-ac2af962c61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:41.122777 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-c7612f9f-3fdc-4946-822f-35ccab55671d None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:41.124106 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c7612f9f-3fdc-4946-822f-35ccab55671d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:41.147266 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-dc0a270c-98eb-4838-bc0c-ac2af962c61b None None] MFA Rules not processed for user `2d089b5ee94e441ebbd084c2581a42df`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:41.151124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-dc0a270c-98eb-4838-bc0c-ac2af962c61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:41.279649 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 851/1690] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:05:41.281159 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3525e8-f225-4d10-8b8d-428adf4a492d None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:41.281451 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3525e8-f225-4d10-8b8d-428adf4a492d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:41.281729 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3525e8-f225-4d10-8b8d-428adf4a492d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:41.283130 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 840/1691] 10.222.0.24 () {58 vars in 1009 bytes} [Thu May 19 15:05:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:05:41.293495 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a270c-98eb-4838-bc0c-ac2af962c61b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:41.294943 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-dc0a270c-98eb-4838-bc0c-ac2af962c61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:41.322942 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a270c-98eb-4838-bc0c-ac2af962c61b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:41.330258 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-2a3525e8-f225-4d10-8b8d-428adf4a492d None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:41.330258 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2a3525e8-f225-4d10-8b8d-428adf4a492d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:41.338072 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504adbc-d227-4a6b-8fad-a1c28a8c688a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:41.338916 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504adbc-d227-4a6b-8fad-a1c28a8c688a service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:41.339703 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504adbc-d227-4a6b-8fad-a1c28a8c688a service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:41.340424 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504adbc-d227-4a6b-8fad-a1c28a8c688a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:41.369077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504adbc-d227-4a6b-8fad-a1c28a8c688a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:41.372755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504adbc-d227-4a6b-8fad-a1c28a8c688a service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:41.389214 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 852/1692] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:41.399908 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3525e8-f225-4d10-8b8d-428adf4a492d None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:41.414995 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3525e8-f225-4d10-8b8d-428adf4a492d None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:41.420543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 841/1693] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:05:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:05:41.432595 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038173be-9ba8-4e67-93b2-a653de227351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:41.433291 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038173be-9ba8-4e67-93b2-a653de227351 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:41.433573 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038173be-9ba8-4e67-93b2-a653de227351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:41.433847 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038173be-9ba8-4e67-93b2-a653de227351 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:41.434586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038173be-9ba8-4e67-93b2-a653de227351 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:05:41.434888 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038173be-9ba8-4e67-93b2-a653de227351 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:41.436789 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038173be-9ba8-4e67-93b2-a653de227351 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:41.492011 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 853/1694] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:05:41.497853 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504adbc-d227-4a6b-8fad-a1c28a8c688a service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:41.514549 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504adbc-d227-4a6b-8fad-a1c28a8c688a service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:41.525860 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23232694-f0b9-4330-bbe9-f11471bd1058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:41.526487 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23232694-f0b9-4330-bbe9-f11471bd1058 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:41.526758 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23232694-f0b9-4330-bbe9-f11471bd1058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:41.527038 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23232694-f0b9-4330-bbe9-f11471bd1058 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:41.527774 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23232694-f0b9-4330-bbe9-f11471bd1058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:41.529709 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23232694-f0b9-4330-bbe9-f11471bd1058 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:41.604359 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 842/1695] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:05:41 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:41.609725 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038173be-9ba8-4e67-93b2-a653de227351 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:41.635079 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038173be-9ba8-4e67-93b2-a653de227351 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:41.840646 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c3a13-1d6b-46fb-9fc7-b0058d0f3f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:41.841483 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c3a13-1d6b-46fb-9fc7-b0058d0f3f87 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:41.841771 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c3a13-1d6b-46fb-9fc7-b0058d0f3f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:41.842045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c3a13-1d6b-46fb-9fc7-b0058d0f3f87 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:41.842760 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c3a13-1d6b-46fb-9fc7-b0058d0f3f87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:41.850975 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c3a13-1d6b-46fb-9fc7-b0058d0f3f87 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:41.906453 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 854/1696] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:05:41 2022] POST /identity/v3/users => generated 283 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:05:41.910056 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23232694-f0b9-4330-bbe9-f11471bd1058 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:41.922965 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23232694-f0b9-4330-bbe9-f11471bd1058 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:41.934220 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa186d-21c7-4856-9793-f1ff3d30ed17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:41.934978 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa186d-21c7-4856-9793-f1ff3d30ed17 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:41.935307 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa186d-21c7-4856-9793-f1ff3d30ed17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:41.935593 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa186d-21c7-4856-9793-f1ff3d30ed17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:41.936347 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa186d-21c7-4856-9793-f1ff3d30ed17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:41.937987 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa186d-21c7-4856-9793-f1ff3d30ed17 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:41.964703 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c3a13-1d6b-46fb-9fc7-b0058d0f3f87 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:41.971976 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 843/1697] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:41.978838 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c3a13-1d6b-46fb-9fc7-b0058d0f3f87 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:41.983745 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe4285-47e2-4c9b-83ab-885ac6aca3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:41.984429 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe4285-47e2-4c9b-83ab-885ac6aca3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:41.984716 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe4285-47e2-4c9b-83ab-885ac6aca3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:41.984995 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe4285-47e2-4c9b-83ab-885ac6aca3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:41.986968 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe4285-47e2-4c9b-83ab-885ac6aca3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:41.989445 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe4285-47e2-4c9b-83ab-885ac6aca3b7 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:42.005996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa186d-21c7-4856-9793-f1ff3d30ed17 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:42.018079 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa186d-21c7-4856-9793-f1ff3d30ed17 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:42.019215 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 855/1698] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:42.026075 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74931513-ecd1-4557-b608-5d959fef65bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:42.027011 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74931513-ecd1-4557-b608-5d959fef65bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:42.027397 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74931513-ecd1-4557-b608-5d959fef65bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:42.027679 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74931513-ecd1-4557-b608-5d959fef65bb admin admin] PATH_INFO: `/v3/projects/05811e82bc594b00820ca45b50c52fdd/users/3430b124826347138303856f6378acc6/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:42.055757 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74931513-ecd1-4557-b608-5d959fef65bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=05811e82bc594b00820ca45b50c52fdd, user_id=3430b124826347138303856f6378acc6, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:42.057702 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74931513-ecd1-4557-b608-5d959fef65bb admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:42.095727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff3a28-3bf3-4845-9a38-e3b572af79c8 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:42.096054 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff3a28-3bf3-4845-9a38-e3b572af79c8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:42.096285 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff3a28-3bf3-4845-9a38-e3b572af79c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:42.119457 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 844/1699] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:05:42 2022] PUT /identity/v3/projects/05811e82bc594b00820ca45b50c52fdd/users/3430b124826347138303856f6378acc6/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:05:42.169485 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-85ff3a28-3bf3-4845-9a38-e3b572af79c8 None None] MFA Rules not processed for user `3430b124826347138303856f6378acc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:42.172772 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-85ff3a28-3bf3-4845-9a38-e3b572af79c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:42.221258 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:42.329501 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 856/1700] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:42 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:42.330756 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74931513-ecd1-4557-b608-5d959fef65bb admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:42.499681 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74931513-ecd1-4557-b608-5d959fef65bb admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:42.510008 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba4c69-9ef8-45f6-890a-747a44b35b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:42.513753 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba4c69-9ef8-45f6-890a-747a44b35b34 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:42.514047 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba4c69-9ef8-45f6-890a-747a44b35b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:42.514680 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba4c69-9ef8-45f6-890a-747a44b35b34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:42.515457 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba4c69-9ef8-45f6-890a-747a44b35b34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:42.524577 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba4c69-9ef8-45f6-890a-747a44b35b34 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:42.591728 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 845/1701] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:05:42 2022] POST /identity/v3/projects => generated 365 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:42.594114 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff3a28-3bf3-4845-9a38-e3b572af79c8 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:42.609354 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff3a28-3bf3-4845-9a38-e3b572af79c8 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:42.780270 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947bdb8-334d-45fd-bcde-189ee489e99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:42.781215 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947bdb8-334d-45fd-bcde-189ee489e99f admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:42.781654 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947bdb8-334d-45fd-bcde-189ee489e99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:42.782093 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947bdb8-334d-45fd-bcde-189ee489e99f admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:42.782961 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947bdb8-334d-45fd-bcde-189ee489e99f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:42.785162 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947bdb8-334d-45fd-bcde-189ee489e99f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:42.843445 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad150572-584c-4561-9e8d-f4385c892b12 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:42.843957 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad150572-584c-4561-9e8d-f4385c892b12 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:42.844436 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad150572-584c-4561-9e8d-f4385c892b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:42.862597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:42.875323 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 857/1702] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:05:42 2022] POST /identity/v3/users => generated 289 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:42.880151 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947bdb8-334d-45fd-bcde-189ee489e99f admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:42.894771 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ad150572-584c-4561-9e8d-f4385c892b12 None None] MFA Rules not processed for user `e5374c90f38b47fcb611e346f3f2ec69`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:42.897598 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ad150572-584c-4561-9e8d-f4385c892b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:42.901295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947bdb8-334d-45fd-bcde-189ee489e99f admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:42.912639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31d948-62c9-4213-9244-80f9ee712d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:42.913436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31d948-62c9-4213-9244-80f9ee712d2b admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:42.914839 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31d948-62c9-4213-9244-80f9ee712d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:42.916010 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31d948-62c9-4213-9244-80f9ee712d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:42.916872 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31d948-62c9-4213-9244-80f9ee712d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:42.921763 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31d948-62c9-4213-9244-80f9ee712d2b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:42.951832 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 858/1703] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:42.956784 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31d948-62c9-4213-9244-80f9ee712d2b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:43.005259 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31d948-62c9-4213-9244-80f9ee712d2b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:43.026365 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08122f-a9a7-4dab-a092-ebdb15323cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:43.031076 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 846/1704] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:43.032330 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08122f-a9a7-4dab-a092-ebdb15323cdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:43.032673 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08122f-a9a7-4dab-a092-ebdb15323cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:43.032998 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08122f-a9a7-4dab-a092-ebdb15323cdf admin admin] PATH_INFO: `/v3/projects/f01e9a677c674e5ab7ce70657984652a/users/50ee90839f8e47b0b8cffa049e5258dd/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:43.090807 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08122f-a9a7-4dab-a092-ebdb15323cdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f01e9a677c674e5ab7ce70657984652a, user_id=50ee90839f8e47b0b8cffa049e5258dd, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:43.093637 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08122f-a9a7-4dab-a092-ebdb15323cdf admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:43.150522 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 859/1705] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:05:42 2022] PUT /identity/v3/projects/f01e9a677c674e5ab7ce70657984652a/users/50ee90839f8e47b0b8cffa049e5258dd/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:43.154323 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad150572-584c-4561-9e8d-f4385c892b12 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:43.172796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad150572-584c-4561-9e8d-f4385c892b12 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:43.342798 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b42ad2-316c-4b64-9f64-a79644be56b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:43.344170 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b42ad2-316c-4b64-9f64-a79644be56b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:43.344994 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b42ad2-316c-4b64-9f64-a79644be56b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:43.345670 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b42ad2-316c-4b64-9f64-a79644be56b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:43.347623 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b42ad2-316c-4b64-9f64-a79644be56b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:43.350408 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b42ad2-316c-4b64-9f64-a79644be56b0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:43.364809 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 847/1706] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:43.372139 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08122f-a9a7-4dab-a092-ebdb15323cdf admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:43.407798 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08122f-a9a7-4dab-a092-ebdb15323cdf admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:43.425758 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae9558-184a-4620-a3b6-3586abf499c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:43.428642 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae9558-184a-4620-a3b6-3586abf499c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:43.430503 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae9558-184a-4620-a3b6-3586abf499c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:43.431306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae9558-184a-4620-a3b6-3586abf499c2 admin admin] PATH_INFO: `/v3/projects/f01e9a677c674e5ab7ce70657984652a/users/50ee90839f8e47b0b8cffa049e5258dd/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:43.446146 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae9558-184a-4620-a3b6-3586abf499c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f01e9a677c674e5ab7ce70657984652a, user_id=50ee90839f8e47b0b8cffa049e5258dd, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:43.461826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae9558-184a-4620-a3b6-3586abf499c2 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:43.497139 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 860/1707] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:05:43 2022] PUT /identity/v3/projects/f01e9a677c674e5ab7ce70657984652a/users/50ee90839f8e47b0b8cffa049e5258dd/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:43.509421 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f2710-e38e-441c-aa1b-0c4e58b1da6a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:43.509720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f2710-e38e-441c-aa1b-0c4e58b1da6a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:43.510254 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f2710-e38e-441c-aa1b-0c4e58b1da6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:43.633348 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-581f2710-e38e-441c-aa1b-0c4e58b1da6a None None] MFA Rules not processed for user `50ee90839f8e47b0b8cffa049e5258dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:43.634683 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-581f2710-e38e-441c-aa1b-0c4e58b1da6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:43.731342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a43a20-9dee-4b8c-b577-a58de7033e2c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:43.731712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a43a20-9dee-4b8c-b577-a58de7033e2c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:43.732066 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a43a20-9dee-4b8c-b577-a58de7033e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:43.776562 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-65a43a20-9dee-4b8c-b577-a58de7033e2c None None] MFA Rules not processed for user `2d089b5ee94e441ebbd084c2581a42df`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:43.777797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-65a43a20-9dee-4b8c-b577-a58de7033e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:43.981781 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 848/1708] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:43 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:43.994676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f2710-e38e-441c-aa1b-0c4e58b1da6a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:43.997547 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-581f2710-e38e-441c-aa1b-0c4e58b1da6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:44.103913 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 861/1709] 10.222.0.49 () {58 vars in 1015 bytes} [Thu May 19 15:05:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:44.132833 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:44.246376 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a43a20-9dee-4b8c-b577-a58de7033e2c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:44.248513 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-65a43a20-9dee-4b8c-b577-a58de7033e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:44.250312 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f2710-e38e-441c-aa1b-0c4e58b1da6a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:44.278477 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a43a20-9dee-4b8c-b577-a58de7033e2c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:44.280268 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23505fee-c233-488b-85af-858f9ad9fb93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:44.287969 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feeea7e-e047-4d22-8811-793c14d9f2ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:44.289564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23505fee-c233-488b-85af-858f9ad9fb93 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:44.291354 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feeea7e-e047-4d22-8811-793c14d9f2ca service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:44.291806 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feeea7e-e047-4d22-8811-793c14d9f2ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:44.292237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feeea7e-e047-4d22-8811-793c14d9f2ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:44.292643 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23505fee-c233-488b-85af-858f9ad9fb93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:44.294467 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23505fee-c233-488b-85af-858f9ad9fb93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:44.321941 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feeea7e-e047-4d22-8811-793c14d9f2ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:44.331400 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feeea7e-e047-4d22-8811-793c14d9f2ca service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:44.344166 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:44.346759 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23505fee-c233-488b-85af-858f9ad9fb93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:44.348699 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23505fee-c233-488b-85af-858f9ad9fb93 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:44.355447 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 862/1710] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:05:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 15:05:44.419563 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 849/1711] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:05:43 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:05:44.881574 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feeea7e-e047-4d22-8811-793c14d9f2ca service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:44.884380 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6feeea7e-e047-4d22-8811-793c14d9f2ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:45.222892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feeea7e-e047-4d22-8811-793c14d9f2ca service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:45.261534 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ec209-305d-4f63-a4b9-2dee486fc7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:45.262496 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ec209-305d-4f63-a4b9-2dee486fc7f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:45.266564 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ec209-305d-4f63-a4b9-2dee486fc7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:45.266710 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ec209-305d-4f63-a4b9-2dee486fc7f4 admin admin] PATH_INFO: `/v3/users/0eb25b3219a84d76ac31193db03fd2b3` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:45.269568 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ec209-305d-4f63-a4b9-2dee486fc7f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eb25b3219a84d76ac31193db03fd2b3)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:45.275916 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ec209-305d-4f63-a4b9-2dee486fc7f4 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:45.410819 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-669ec209-305d-4f63-a4b9-2dee486fc7f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eb25b3219a84d76ac31193db03fd2b3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:45.412688 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-669ec209-305d-4f63-a4b9-2dee486fc7f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eb25b3219a84d76ac31193db03fd2b3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:45.413878 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-669ec209-305d-4f63-a4b9-2dee486fc7f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eb25b3219a84d76ac31193db03fd2b3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:45.439899 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-669ec209-305d-4f63-a4b9-2dee486fc7f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eb25b3219a84d76ac31193db03fd2b3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:45.499302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-669ec209-305d-4f63-a4b9-2dee486fc7f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eb25b3219a84d76ac31193db03fd2b3'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:45.572101 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 863/1712] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:05:44 2022] DELETE /identity/v3/users/0eb25b3219a84d76ac31193db03fd2b3 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:45.582212 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d2049-b411-4ff5-95a9-38efe3f8dd92 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:45.583247 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d2049-b411-4ff5-95a9-38efe3f8dd92 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:45.584174 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d2049-b411-4ff5-95a9-38efe3f8dd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:45.654467 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b90d2049-b411-4ff5-95a9-38efe3f8dd92 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:45.686197 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b90d2049-b411-4ff5-95a9-38efe3f8dd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:45.728883 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ec209-305d-4f63-a4b9-2dee486fc7f4 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:45.730984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-669ec209-305d-4f63-a4b9-2dee486fc7f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:45.899713 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 850/1713] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:05:45.919523 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d2049-b411-4ff5-95a9-38efe3f8dd92 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:45.921226 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b90d2049-b411-4ff5-95a9-38efe3f8dd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:45.943134 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ec209-305d-4f63-a4b9-2dee486fc7f4 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:45.968736 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5de45-791c-4730-9938-e2900d983c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:45.977978 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5de45-791c-4730-9938-e2900d983c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:45.980054 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5de45-791c-4730-9938-e2900d983c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:45.982691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5de45-791c-4730-9938-e2900d983c07 admin admin] PATH_INFO: `/v3/users/00af60114c034815833604218f8c32d4` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:45.988988 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5de45-791c-4730-9938-e2900d983c07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00af60114c034815833604218f8c32d4)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:46.000385 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5de45-791c-4730-9938-e2900d983c07 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:46.091795 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:46.159539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d2049-b411-4ff5-95a9-38efe3f8dd92 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:46.184051 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c149ba0-d61f-4e22-8b8e-5658886263ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:46.196281 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c149ba0-d61f-4e22-8b8e-5658886263ed service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:46.198343 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c149ba0-d61f-4e22-8b8e-5658886263ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:46.200878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c149ba0-d61f-4e22-8b8e-5658886263ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:46.208777 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6fb5de45-791c-4730-9938-e2900d983c07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00af60114c034815833604218f8c32d4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:46.211624 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6fb5de45-791c-4730-9938-e2900d983c07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00af60114c034815833604218f8c32d4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:46.212940 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6fb5de45-791c-4730-9938-e2900d983c07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00af60114c034815833604218f8c32d4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:46.226825 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6fb5de45-791c-4730-9938-e2900d983c07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00af60114c034815833604218f8c32d4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:46.265918 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c149ba0-d61f-4e22-8b8e-5658886263ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:46.269041 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c149ba0-d61f-4e22-8b8e-5658886263ed service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:46.273723 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6fb5de45-791c-4730-9938-e2900d983c07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00af60114c034815833604218f8c32d4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:46.317851 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 864/1714] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:05:45 2022] DELETE /identity/v3/users/00af60114c034815833604218f8c32d4 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:46.323002 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cafde-6ce7-4979-8cef-47fc88fdfdde None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:46.324326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cafde-6ce7-4979-8cef-47fc88fdfdde None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:46.326060 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cafde-6ce7-4979-8cef-47fc88fdfdde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:46.331081 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 851/1715] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:05:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:05:46.380494 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f35cafde-6ce7-4979-8cef-47fc88fdfdde None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:46.382018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f35cafde-6ce7-4979-8cef-47fc88fdfdde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:46.437536 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c149ba0-d61f-4e22-8b8e-5658886263ed service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:46.439404 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3c149ba0-d61f-4e22-8b8e-5658886263ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:46.466986 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c149ba0-d61f-4e22-8b8e-5658886263ed service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:46.586040 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 865/1716] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:46.629631 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cca999-0b0f-4552-8179-0edaf934d199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:46.630792 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cca999-0b0f-4552-8179-0edaf934d199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:46.631288 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cca999-0b0f-4552-8179-0edaf934d199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:46.631742 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cca999-0b0f-4552-8179-0edaf934d199 admin admin] PATH_INFO: `/v3/users/3430b124826347138303856f6378acc6` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:46.641352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cca999-0b0f-4552-8179-0edaf934d199 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3430b124826347138303856f6378acc6)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:46.655854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cca999-0b0f-4552-8179-0edaf934d199 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:46.722636 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:46.816705 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-71cca999-0b0f-4552-8179-0edaf934d199 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3430b124826347138303856f6378acc6'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:46.846507 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-71cca999-0b0f-4552-8179-0edaf934d199 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3430b124826347138303856f6378acc6'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:46.889601 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-71cca999-0b0f-4552-8179-0edaf934d199 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3430b124826347138303856f6378acc6'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:46.891663 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-71cca999-0b0f-4552-8179-0edaf934d199 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3430b124826347138303856f6378acc6'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:46.893332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-71cca999-0b0f-4552-8179-0edaf934d199 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3430b124826347138303856f6378acc6'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:46.932186 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 852/1717] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:05:46 2022] DELETE /identity/v3/users/3430b124826347138303856f6378acc6 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:46.936859 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a2216-42f6-4217-bcda-01c19816173f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:46.937155 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a2216-42f6-4217-bcda-01c19816173f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:46.937435 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a2216-42f6-4217-bcda-01c19816173f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:46.964256 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-5f2a2216-42f6-4217-bcda-01c19816173f None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:46.965523 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5f2a2216-42f6-4217-bcda-01c19816173f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:47.004009 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cca999-0b0f-4552-8179-0edaf934d199 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:47.005467 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-71cca999-0b0f-4552-8179-0edaf934d199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:47.076204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 866/1718] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:47.221865 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cca999-0b0f-4552-8179-0edaf934d199 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:47.228205 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e8e6ab-f134-4134-b478-e2b314775e19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:47.228947 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8e6ab-f134-4134-b478-e2b314775e19 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:47.229260 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8e6ab-f134-4134-b478-e2b314775e19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:47.229625 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8e6ab-f134-4134-b478-e2b314775e19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:47.234533 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d9e8e6ab-f134-4134-b478-e2b314775e19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:47.270659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e8e6ab-f134-4134-b478-e2b314775e19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:47.274688 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e8e6ab-f134-4134-b478-e2b314775e19 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:47.306520 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 853/1719] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:05:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 15:05:47.425879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a2216-42f6-4217-bcda-01c19816173f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:47.500543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a2216-42f6-4217-bcda-01c19816173f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:47.515364 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39a8c2-d18a-47f1-b642-9788fc7492fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:47.517059 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39a8c2-d18a-47f1-b642-9788fc7492fe service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:47.524056 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39a8c2-d18a-47f1-b642-9788fc7492fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:47.526564 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39a8c2-d18a-47f1-b642-9788fc7492fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:47.575608 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a39a8c2-d18a-47f1-b642-9788fc7492fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:47.584100 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a39a8c2-d18a-47f1-b642-9788fc7492fe service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:47.623955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 867/1720] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:05:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:05:48.502075 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba42e2e-d483-45d5-96e8-7643fffd5c23 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:48.502594 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba42e2e-d483-45d5-96e8-7643fffd5c23 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:48.502594 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba42e2e-d483-45d5-96e8-7643fffd5c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:48.567247 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-dba42e2e-d483-45d5-96e8-7643fffd5c23 None None] MFA Rules not processed for user `644abe5583e94049abd23e4ca050a066`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:48.573713 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-dba42e2e-d483-45d5-96e8-7643fffd5c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:48.825624 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39a8c2-d18a-47f1-b642-9788fc7492fe service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:48.828317 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 854/1721] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:48.832862 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9a39a8c2-d18a-47f1-b642-9788fc7492fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:48.981726 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:49.097809 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39a8c2-d18a-47f1-b642-9788fc7492fe service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:49.122641 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c70e2-e930-43e7-9d4f-43b2bd27e999 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:49.123551 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c70e2-e930-43e7-9d4f-43b2bd27e999 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:49.125618 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c70e2-e930-43e7-9d4f-43b2bd27e999 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:49.126124 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c70e2-e930-43e7-9d4f-43b2bd27e999 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:49.148682 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c70e2-e930-43e7-9d4f-43b2bd27e999 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:49.154613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c70e2-e930-43e7-9d4f-43b2bd27e999 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:49.189178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 868/1722] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:05:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:05:49.277611 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba42e2e-d483-45d5-96e8-7643fffd5c23 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:49.279011 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-dba42e2e-d483-45d5-96e8-7643fffd5c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:49.315898 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827326b2-6802-4490-96c6-088ee69e1177 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:49.316594 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827326b2-6802-4490-96c6-088ee69e1177 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:49.317249 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827326b2-6802-4490-96c6-088ee69e1177 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:49.319611 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 869/1723] 10.222.0.24 () {54 vars in 921 bytes} [Thu May 19 15:05:49 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 15:05:49.327770 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba42e2e-d483-45d5-96e8-7643fffd5c23 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:49.357394 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cdf24-c467-4daa-bee3-2b132e1a1770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:49.362957 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cdf24-c467-4daa-bee3-2b132e1a1770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:49.363505 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cdf24-c467-4daa-bee3-2b132e1a1770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:49.364011 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cdf24-c467-4daa-bee3-2b132e1a1770 admin admin] PATH_INFO: `/v3/users/9f9bcabf7c9c416094babd1f30b992cb` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:49.368068 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cdf24-c467-4daa-bee3-2b132e1a1770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f9bcabf7c9c416094babd1f30b992cb)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:49.374420 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cdf24-c467-4daa-bee3-2b132e1a1770 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:49.451879 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:49.506777 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a63ff-164c-410c-aa4f-7f411c28354c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:49.507913 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a63ff-164c-410c-aa4f-7f411c28354c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:49.508407 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a63ff-164c-410c-aa4f-7f411c28354c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:49.542093 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e31cdf24-c467-4daa-bee3-2b132e1a1770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f9bcabf7c9c416094babd1f30b992cb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:49.561274 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-282a63ff-164c-410c-aa4f-7f411c28354c None None] MFA Rules not processed for user `06fb8bb5aeb143ad95f33c3b43dbd346`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:49.564588 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-282a63ff-164c-410c-aa4f-7f411c28354c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:49.565632 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e31cdf24-c467-4daa-bee3-2b132e1a1770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f9bcabf7c9c416094babd1f30b992cb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:49.606970 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 870/1724] 10.222.0.24 () {58 vars in 1018 bytes} [Thu May 19 15:05:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:05:49.613515 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e31cdf24-c467-4daa-bee3-2b132e1a1770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f9bcabf7c9c416094babd1f30b992cb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:49.615134 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e31cdf24-c467-4daa-bee3-2b132e1a1770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f9bcabf7c9c416094babd1f30b992cb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:49.620319 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e31cdf24-c467-4daa-bee3-2b132e1a1770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f9bcabf7c9c416094babd1f30b992cb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:49.667162 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 855/1725] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:05:49 2022] DELETE /identity/v3/users/9f9bcabf7c9c416094babd1f30b992cb => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:49.671117 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c42e8d-3db7-42a5-a4eb-b066882a7f24 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:49.671724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c42e8d-3db7-42a5-a4eb-b066882a7f24 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:49.672455 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c42e8d-3db7-42a5-a4eb-b066882a7f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:49.722702 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-c3c42e8d-3db7-42a5-a4eb-b066882a7f24 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:49.728486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c3c42e8d-3db7-42a5-a4eb-b066882a7f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:49.904952 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 871/1726] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:49.985654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cdf24-c467-4daa-bee3-2b132e1a1770 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:49.987850 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e31cdf24-c467-4daa-bee3-2b132e1a1770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:50.088041 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c42e8d-3db7-42a5-a4eb-b066882a7f24 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:50.089566 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c3c42e8d-3db7-42a5-a4eb-b066882a7f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:50.239595 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c42e8d-3db7-42a5-a4eb-b066882a7f24 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:50.247167 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be97b86-a02a-4095-a081-cbb02b4b7ad4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:50.248181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be97b86-a02a-4095-a081-cbb02b4b7ad4 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:50.248591 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be97b86-a02a-4095-a081-cbb02b4b7ad4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:50.248878 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be97b86-a02a-4095-a081-cbb02b4b7ad4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:50.276468 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be97b86-a02a-4095-a081-cbb02b4b7ad4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:50.277972 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be97b86-a02a-4095-a081-cbb02b4b7ad4 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:50.278955 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cdf24-c467-4daa-bee3-2b132e1a1770 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:50.297944 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11bbee-7fe9-46a0-8d56-acbb67765cf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:50.298356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 872/1727] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:05:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:05:50.299027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11bbee-7fe9-46a0-8d56-acbb67765cf1 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:50.299603 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11bbee-7fe9-46a0-8d56-acbb67765cf1 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:50.299913 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11bbee-7fe9-46a0-8d56-acbb67765cf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:50.309813 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ab11bbee-7fe9-46a0-8d56-acbb67765cf1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:50.327778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be97b86-a02a-4095-a081-cbb02b4b7ad4 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:50.329532 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2be97b86-a02a-4095-a081-cbb02b4b7ad4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:50.338872 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11bbee-7fe9-46a0-8d56-acbb67765cf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:50.343459 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab11bbee-7fe9-46a0-8d56-acbb67765cf1 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:50.364865 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 856/1728] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:05:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:05:50.379021 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be97b86-a02a-4095-a081-cbb02b4b7ad4 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:50.412071 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09031a3a-8ab7-4d93-a38b-ab9a70481862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:50.412989 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09031a3a-8ab7-4d93-a38b-ab9a70481862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:50.413304 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09031a3a-8ab7-4d93-a38b-ab9a70481862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:50.413647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09031a3a-8ab7-4d93-a38b-ab9a70481862 admin admin] PATH_INFO: `/v3/projects/33f091f18edf4402bd1e81f64f97a7a0` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:50.415978 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09031a3a-8ab7-4d93-a38b-ab9a70481862 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33f091f18edf4402bd1e81f64f97a7a0)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:50.418021 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09031a3a-8ab7-4d93-a38b-ab9a70481862 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:50.551581 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:50.562949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-09031a3a-8ab7-4d93-a38b-ab9a70481862 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33f091f18edf4402bd1e81f64f97a7a0', 'request_id': 'req-09031a3a-8ab7-4d93-a38b-ab9a70481862'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:50.582199 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-09031a3a-8ab7-4d93-a38b-ab9a70481862 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33f091f18edf4402bd1e81f64f97a7a0', 'request_id': 'req-09031a3a-8ab7-4d93-a38b-ab9a70481862'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:50.594308 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-09031a3a-8ab7-4d93-a38b-ab9a70481862 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33f091f18edf4402bd1e81f64f97a7a0', 'request_id': 'req-09031a3a-8ab7-4d93-a38b-ab9a70481862'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:50.633464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-09031a3a-8ab7-4d93-a38b-ab9a70481862 admin admin] The token cache is being invalidate because project 33f091f18edf4402bd1e81f64f97a7a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:05:50.633980 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-09031a3a-8ab7-4d93-a38b-ab9a70481862 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:50.636007 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-09031a3a-8ab7-4d93-a38b-ab9a70481862 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:50.648759 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 873/1729] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:05:50 2022] DELETE /identity/v3/projects/33f091f18edf4402bd1e81f64f97a7a0 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:50.653432 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34001b67-834a-4471-a500-3a75e6cedea3 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:50.654211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34001b67-834a-4471-a500-3a75e6cedea3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:50.654211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34001b67-834a-4471-a500-3a75e6cedea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:50.691220 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-34001b67-834a-4471-a500-3a75e6cedea3 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:50.703344 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-34001b67-834a-4471-a500-3a75e6cedea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:50.893537 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe108d1-1645-4444-8ae0-fbed0271b0a3 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:50.893764 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe108d1-1645-4444-8ae0-fbed0271b0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:50.894050 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe108d1-1645-4444-8ae0-fbed0271b0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:50.896229 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 857/1730] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:50.947152 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9fe108d1-1645-4444-8ae0-fbed0271b0a3 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:50.955328 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9fe108d1-1645-4444-8ae0-fbed0271b0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:51.002570 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 874/1731] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:05:51.010206 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34001b67-834a-4471-a500-3a75e6cedea3 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:51.034732 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34001b67-834a-4471-a500-3a75e6cedea3 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:51.063492 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500e52b-05e0-4280-a4c2-d43ff7e81555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:51.065541 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500e52b-05e0-4280-a4c2-d43ff7e81555 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:51.065837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500e52b-05e0-4280-a4c2-d43ff7e81555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:51.066121 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500e52b-05e0-4280-a4c2-d43ff7e81555 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:51.066878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500e52b-05e0-4280-a4c2-d43ff7e81555 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:05:51.070723 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500e52b-05e0-4280-a4c2-d43ff7e81555 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:51.079185 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500e52b-05e0-4280-a4c2-d43ff7e81555 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:51.158238 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe108d1-1645-4444-8ae0-fbed0271b0a3 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:51.169044 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 858/1732] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:05:51.178534 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe108d1-1645-4444-8ae0-fbed0271b0a3 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:51.203385 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fefc4-95cb-464f-b5cc-30ba1fa2bb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:51.204632 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fefc4-95cb-464f-b5cc-30ba1fa2bb6b admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:51.205431 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fefc4-95cb-464f-b5cc-30ba1fa2bb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:51.207944 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fefc4-95cb-464f-b5cc-30ba1fa2bb6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:51.208943 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281fefc4-95cb-464f-b5cc-30ba1fa2bb6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:51.215846 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281fefc4-95cb-464f-b5cc-30ba1fa2bb6b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:51.306248 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 875/1733] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:05:51 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:05:51.310487 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500e52b-05e0-4280-a4c2-d43ff7e81555 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:51.348231 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500e52b-05e0-4280-a4c2-d43ff7e81555 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:51.376415 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:51.628780 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77519702-0ad1-470a-8224-70d47d413886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:51.630086 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77519702-0ad1-470a-8224-70d47d413886 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:51.631307 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77519702-0ad1-470a-8224-70d47d413886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:51.631595 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77519702-0ad1-470a-8224-70d47d413886 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:51.633501 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77519702-0ad1-470a-8224-70d47d413886 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:51.638270 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77519702-0ad1-470a-8224-70d47d413886 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:51.687380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 859/1734] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:05:51 2022] POST /identity/v3/users => generated 287 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:51.691869 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fefc4-95cb-464f-b5cc-30ba1fa2bb6b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:51.706250 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fefc4-95cb-464f-b5cc-30ba1fa2bb6b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:51.720595 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1c3c6-2bbc-4004-ada2-b55f6ca851e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:51.721741 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1c3c6-2bbc-4004-ada2-b55f6ca851e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:51.722026 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1c3c6-2bbc-4004-ada2-b55f6ca851e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:51.722304 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1c3c6-2bbc-4004-ada2-b55f6ca851e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:51.724232 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1c3c6-2bbc-4004-ada2-b55f6ca851e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:51.728385 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1c3c6-2bbc-4004-ada2-b55f6ca851e8 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:51.770888 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 876/1735] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:51.775323 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77519702-0ad1-470a-8224-70d47d413886 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:51.790251 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77519702-0ad1-470a-8224-70d47d413886 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:51.799369 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fb437-00ff-43a5-8bd7-7967467fee90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:51.800960 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fb437-00ff-43a5-8bd7-7967467fee90 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:51.802539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fb437-00ff-43a5-8bd7-7967467fee90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:51.803080 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fb437-00ff-43a5-8bd7-7967467fee90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:51.831078 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0fb437-00ff-43a5-8bd7-7967467fee90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:51.834379 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0fb437-00ff-43a5-8bd7-7967467fee90 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:51.851566 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 860/1736] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 15:05:51.855384 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1c3c6-2bbc-4004-ada2-b55f6ca851e8 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:51.884641 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fb437-00ff-43a5-8bd7-7967467fee90 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:51.887481 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1c3c6-2bbc-4004-ada2-b55f6ca851e8 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:51.891083 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7a0fb437-00ff-43a5-8bd7-7967467fee90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:51.903613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c025b19-c497-4047-be5a-47fc1ebb7598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:51.926871 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c025b19-c497-4047-be5a-47fc1ebb7598 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:51.929532 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c025b19-c497-4047-be5a-47fc1ebb7598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:51.931003 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c025b19-c497-4047-be5a-47fc1ebb7598 admin admin] PATH_INFO: `/v3/projects/39d695e996c945349b16ae8ffcfd9069/users/8355809cdda64843bfbdc18af1a598db/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:51.949069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fb437-00ff-43a5-8bd7-7967467fee90 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:51.974845 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687009f-78ba-4de7-8f8d-32c41c33c9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:51.978089 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687009f-78ba-4de7-8f8d-32c41c33c9e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:51.979179 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687009f-78ba-4de7-8f8d-32c41c33c9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:51.979857 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687009f-78ba-4de7-8f8d-32c41c33c9e9 admin admin] PATH_INFO: `/v3/projects/4cc5447e9dec427ab5383fe3b9addfd5` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:51.982178 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687009f-78ba-4de7-8f8d-32c41c33c9e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cc5447e9dec427ab5383fe3b9addfd5)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:51.987940 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c025b19-c497-4047-be5a-47fc1ebb7598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d695e996c945349b16ae8ffcfd9069, user_id=8355809cdda64843bfbdc18af1a598db, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:51.989399 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687009f-78ba-4de7-8f8d-32c41c33c9e9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:52.026762 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c025b19-c497-4047-be5a-47fc1ebb7598 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:52.071338 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 877/1737] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:05:51 2022] PUT /identity/v3/projects/39d695e996c945349b16ae8ffcfd9069/users/8355809cdda64843bfbdc18af1a598db/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:05:52.082832 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f52da-05eb-4db5-92a0-d4ce8c86c259 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:52.083441 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f52da-05eb-4db5-92a0-d4ce8c86c259 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:52.084102 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f52da-05eb-4db5-92a0-d4ce8c86c259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:52.160352 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e28f52da-05eb-4db5-92a0-d4ce8c86c259 None None] MFA Rules not processed for user `8355809cdda64843bfbdc18af1a598db`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:52.162599 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e28f52da-05eb-4db5-92a0-d4ce8c86c259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:52.181063 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7687009f-78ba-4de7-8f8d-32c41c33c9e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cc5447e9dec427ab5383fe3b9addfd5', 'request_id': 'req-7687009f-78ba-4de7-8f8d-32c41c33c9e9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:52.201096 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7687009f-78ba-4de7-8f8d-32c41c33c9e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cc5447e9dec427ab5383fe3b9addfd5', 'request_id': 'req-7687009f-78ba-4de7-8f8d-32c41c33c9e9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:52.214254 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7687009f-78ba-4de7-8f8d-32c41c33c9e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cc5447e9dec427ab5383fe3b9addfd5', 'request_id': 'req-7687009f-78ba-4de7-8f8d-32c41c33c9e9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:52.244910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7687009f-78ba-4de7-8f8d-32c41c33c9e9 admin admin] The token cache is being invalidate because project 4cc5447e9dec427ab5383fe3b9addfd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:05:52.245493 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7687009f-78ba-4de7-8f8d-32c41c33c9e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:52.249501 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7687009f-78ba-4de7-8f8d-32c41c33c9e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:52.259230 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 861/1738] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:05:51 2022] DELETE /identity/v3/projects/4cc5447e9dec427ab5383fe3b9addfd5 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:52.260156 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687009f-78ba-4de7-8f8d-32c41c33c9e9 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:52.261627 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7687009f-78ba-4de7-8f8d-32c41c33c9e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:52.351398 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 878/1739] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:52.354680 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f52da-05eb-4db5-92a0-d4ce8c86c259 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:52.360569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e28f52da-05eb-4db5-92a0-d4ce8c86c259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:52.440254 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687009f-78ba-4de7-8f8d-32c41c33c9e9 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:52.450430 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7920de-6f77-4e03-a9af-60251aa75304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:52.458811 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7920de-6f77-4e03-a9af-60251aa75304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:52.459166 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7920de-6f77-4e03-a9af-60251aa75304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:52.459501 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7920de-6f77-4e03-a9af-60251aa75304 admin admin] PATH_INFO: `/v3/projects/05811e82bc594b00820ca45b50c52fdd` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:52.461597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7920de-6f77-4e03-a9af-60251aa75304 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05811e82bc594b00820ca45b50c52fdd)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:52.468979 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7920de-6f77-4e03-a9af-60251aa75304 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:52.504937 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:52.509275 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:52.524723 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f52da-05eb-4db5-92a0-d4ce8c86c259 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:52.541575 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572968c-1b1e-4865-9cbd-0041da1871f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:52.542866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572968c-1b1e-4865-9cbd-0041da1871f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:52.543317 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572968c-1b1e-4865-9cbd-0041da1871f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:52.543831 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572968c-1b1e-4865-9cbd-0041da1871f2 admin admin] PATH_INFO: `/v3/users/d15081d681544172be93871f71124ca6` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:52.548529 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572968c-1b1e-4865-9cbd-0041da1871f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d15081d681544172be93871f71124ca6)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:52.550802 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572968c-1b1e-4865-9cbd-0041da1871f2 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:52.568122 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8c7920de-6f77-4e03-a9af-60251aa75304 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05811e82bc594b00820ca45b50c52fdd', 'request_id': 'req-8c7920de-6f77-4e03-a9af-60251aa75304'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:52.581688 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8c7920de-6f77-4e03-a9af-60251aa75304 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05811e82bc594b00820ca45b50c52fdd', 'request_id': 'req-8c7920de-6f77-4e03-a9af-60251aa75304'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:52.594606 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8c7920de-6f77-4e03-a9af-60251aa75304 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05811e82bc594b00820ca45b50c52fdd', 'request_id': 'req-8c7920de-6f77-4e03-a9af-60251aa75304'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:52.615807 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8c7920de-6f77-4e03-a9af-60251aa75304 admin admin] The token cache is being invalidate because project 05811e82bc594b00820ca45b50c52fdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:05:52.616184 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8c7920de-6f77-4e03-a9af-60251aa75304 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:52.617592 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8c7920de-6f77-4e03-a9af-60251aa75304 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:52.627033 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 862/1740] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:05:52 2022] DELETE /identity/v3/projects/05811e82bc594b00820ca45b50c52fdd => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:52.636943 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7920de-6f77-4e03-a9af-60251aa75304 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:52.649797 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8c7920de-6f77-4e03-a9af-60251aa75304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:52.665606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d572968c-1b1e-4865-9cbd-0041da1871f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd15081d681544172be93871f71124ca6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:52.666448 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d572968c-1b1e-4865-9cbd-0041da1871f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd15081d681544172be93871f71124ca6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:52.667258 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d572968c-1b1e-4865-9cbd-0041da1871f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd15081d681544172be93871f71124ca6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:52.691152 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d572968c-1b1e-4865-9cbd-0041da1871f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd15081d681544172be93871f71124ca6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:52.739456 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d572968c-1b1e-4865-9cbd-0041da1871f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd15081d681544172be93871f71124ca6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:52.786738 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 879/1741] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:05:52 2022] DELETE /identity/v3/users/d15081d681544172be93871f71124ca6 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:52.789482 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572968c-1b1e-4865-9cbd-0041da1871f2 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:52.792966 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d572968c-1b1e-4865-9cbd-0041da1871f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:52.951751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7920de-6f77-4e03-a9af-60251aa75304 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:53.082413 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572968c-1b1e-4865-9cbd-0041da1871f2 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:53.098556 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a167e-c4cc-41ca-b7b8-164d32dcda5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:53.100332 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a167e-c4cc-41ca-b7b8-164d32dcda5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:53.107175 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a167e-c4cc-41ca-b7b8-164d32dcda5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:53.107690 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a167e-c4cc-41ca-b7b8-164d32dcda5e admin admin] PATH_INFO: `/v3/users/50ee90839f8e47b0b8cffa049e5258dd` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:53.118480 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a167e-c4cc-41ca-b7b8-164d32dcda5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=50ee90839f8e47b0b8cffa049e5258dd)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:53.127741 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a167e-c4cc-41ca-b7b8-164d32dcda5e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:53.155850 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59d377-f4b6-418f-af54-65dfbb8055ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:53.157729 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59d377-f4b6-418f-af54-65dfbb8055ea service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:53.158021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59d377-f4b6-418f-af54-65dfbb8055ea service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:53.158305 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59d377-f4b6-418f-af54-65dfbb8055ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:53.166501 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2a59d377-f4b6-418f-af54-65dfbb8055ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:53.272012 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6a3a167e-c4cc-41ca-b7b8-164d32dcda5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50ee90839f8e47b0b8cffa049e5258dd'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:53.274451 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6a3a167e-c4cc-41ca-b7b8-164d32dcda5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50ee90839f8e47b0b8cffa049e5258dd'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:53.282603 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6a3a167e-c4cc-41ca-b7b8-164d32dcda5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50ee90839f8e47b0b8cffa049e5258dd'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:53.303406 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6a3a167e-c4cc-41ca-b7b8-164d32dcda5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50ee90839f8e47b0b8cffa049e5258dd'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:53.317284 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:53.349642 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6a3a167e-c4cc-41ca-b7b8-164d32dcda5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50ee90839f8e47b0b8cffa049e5258dd'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:53.365186 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:53.396959 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a59d377-f4b6-418f-af54-65dfbb8055ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:53.398227 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 880/1742] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:05:52 2022] DELETE /identity/v3/users/50ee90839f8e47b0b8cffa049e5258dd => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:53.399004 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a59d377-f4b6-418f-af54-65dfbb8055ea service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:53.410305 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db452f5d-93b6-4550-a137-29e551852111 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:53.412028 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db452f5d-93b6-4550-a137-29e551852111 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:53.412382 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db452f5d-93b6-4550-a137-29e551852111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:53.439299 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 863/1743] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:05:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 803 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:05:53.469243 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-db452f5d-93b6-4550-a137-29e551852111 None None] MFA Rules not processed for user `af7838e525a042dfa0357ad1fc58cf21`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:53.474403 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-db452f5d-93b6-4550-a137-29e551852111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:53.641684 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 881/1744] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:54.710812 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59d377-f4b6-418f-af54-65dfbb8055ea service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:54.713964 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2a59d377-f4b6-418f-af54-65dfbb8055ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:54.736269 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59d377-f4b6-418f-af54-65dfbb8055ea service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:54.864871 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89634803-4b3c-4d5d-b4a0-a9b40a2fff9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:54.867373 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89634803-4b3c-4d5d-b4a0-a9b40a2fff9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:54.867373 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89634803-4b3c-4d5d-b4a0-a9b40a2fff9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:54.867373 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89634803-4b3c-4d5d-b4a0-a9b40a2fff9a admin admin] PATH_INFO: `/v3/projects/489d04a97b6541239f213a7efd074bd3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:54.870405 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89634803-4b3c-4d5d-b4a0-a9b40a2fff9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=489d04a97b6541239f213a7efd074bd3)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:54.878353 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89634803-4b3c-4d5d-b4a0-a9b40a2fff9a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:54.952695 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-89634803-4b3c-4d5d-b4a0-a9b40a2fff9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '489d04a97b6541239f213a7efd074bd3', 'request_id': 'req-89634803-4b3c-4d5d-b4a0-a9b40a2fff9a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:54.971531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-89634803-4b3c-4d5d-b4a0-a9b40a2fff9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '489d04a97b6541239f213a7efd074bd3', 'request_id': 'req-89634803-4b3c-4d5d-b4a0-a9b40a2fff9a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:54.995374 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-89634803-4b3c-4d5d-b4a0-a9b40a2fff9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '489d04a97b6541239f213a7efd074bd3', 'request_id': 'req-89634803-4b3c-4d5d-b4a0-a9b40a2fff9a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:55.028167 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-89634803-4b3c-4d5d-b4a0-a9b40a2fff9a admin admin] The token cache is being invalidate because project 489d04a97b6541239f213a7efd074bd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:05:55.028611 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-89634803-4b3c-4d5d-b4a0-a9b40a2fff9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:55.030988 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-89634803-4b3c-4d5d-b4a0-a9b40a2fff9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:55.034203 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 864/1745] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:05:54 2022] DELETE /identity/v3/projects/489d04a97b6541239f213a7efd074bd3 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:55.038148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db452f5d-93b6-4550-a137-29e551852111 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:55.039800 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-db452f5d-93b6-4550-a137-29e551852111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:55.075544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db452f5d-93b6-4550-a137-29e551852111 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:55.225209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611cb3d-edab-4ed1-a42f-d6973e3832a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:55.225383 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611cb3d-edab-4ed1-a42f-d6973e3832a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:55.226653 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611cb3d-edab-4ed1-a42f-d6973e3832a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:55.227435 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611cb3d-edab-4ed1-a42f-d6973e3832a8 admin admin] PATH_INFO: `/v3/users/59f425ed72c346f6a0df0f1a604f35db` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:55.231215 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611cb3d-edab-4ed1-a42f-d6973e3832a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59f425ed72c346f6a0df0f1a604f35db)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:55.240387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611cb3d-edab-4ed1-a42f-d6973e3832a8 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:55.396400 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f611cb3d-edab-4ed1-a42f-d6973e3832a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59f425ed72c346f6a0df0f1a604f35db'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:55.397522 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f611cb3d-edab-4ed1-a42f-d6973e3832a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59f425ed72c346f6a0df0f1a604f35db'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:55.397893 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f611cb3d-edab-4ed1-a42f-d6973e3832a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59f425ed72c346f6a0df0f1a604f35db'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:55.412342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f611cb3d-edab-4ed1-a42f-d6973e3832a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59f425ed72c346f6a0df0f1a604f35db'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:55.430583 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f611cb3d-edab-4ed1-a42f-d6973e3832a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59f425ed72c346f6a0df0f1a604f35db'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:55.449604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 882/1746] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:05:55 2022] DELETE /identity/v3/users/59f425ed72c346f6a0df0f1a604f35db => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:55.484842 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89634803-4b3c-4d5d-b4a0-a9b40a2fff9a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:55.486384 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-89634803-4b3c-4d5d-b4a0-a9b40a2fff9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:55.505580 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89634803-4b3c-4d5d-b4a0-a9b40a2fff9a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:55.639943 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f23a4b-c2d2-4193-a5cc-19bcfc402145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:55.641737 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f23a4b-c2d2-4193-a5cc-19bcfc402145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:55.642190 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f23a4b-c2d2-4193-a5cc-19bcfc402145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:55.642647 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f23a4b-c2d2-4193-a5cc-19bcfc402145 admin admin] PATH_INFO: `/v3/projects/829153b474f448008890d05f1d1ef215` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:55.646463 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f23a4b-c2d2-4193-a5cc-19bcfc402145 admin admin] RBAC: Authorizing `identity:delete_project(project_id=829153b474f448008890d05f1d1ef215)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:55.652098 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f23a4b-c2d2-4193-a5cc-19bcfc402145 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:55.683750 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:55.755105 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-32f23a4b-c2d2-4193-a5cc-19bcfc402145 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '829153b474f448008890d05f1d1ef215', 'request_id': 'req-32f23a4b-c2d2-4193-a5cc-19bcfc402145'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:55.769474 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-32f23a4b-c2d2-4193-a5cc-19bcfc402145 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '829153b474f448008890d05f1d1ef215', 'request_id': 'req-32f23a4b-c2d2-4193-a5cc-19bcfc402145'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:55.777904 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-32f23a4b-c2d2-4193-a5cc-19bcfc402145 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '829153b474f448008890d05f1d1ef215', 'request_id': 'req-32f23a4b-c2d2-4193-a5cc-19bcfc402145'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:55.796139 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-32f23a4b-c2d2-4193-a5cc-19bcfc402145 admin admin] The token cache is being invalidate because project 829153b474f448008890d05f1d1ef215 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:05:55.796654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-32f23a4b-c2d2-4193-a5cc-19bcfc402145 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:55.797592 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-32f23a4b-c2d2-4193-a5cc-19bcfc402145 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:55.803378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 865/1747] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:05:55 2022] DELETE /identity/v3/projects/829153b474f448008890d05f1d1ef215 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:55.805631 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181496ad-8743-4e12-9561-55e90a64778a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:55.805924 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181496ad-8743-4e12-9561-55e90a64778a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:55.806202 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181496ad-8743-4e12-9561-55e90a64778a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:55.839078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-181496ad-8743-4e12-9561-55e90a64778a None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:55.840801 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-181496ad-8743-4e12-9561-55e90a64778a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:55.873372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:55.938763 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 883/1748] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:55.948041 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5616e89-58ef-4393-bfe1-eff638739972 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:55.948542 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5616e89-58ef-4393-bfe1-eff638739972 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:55.948929 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5616e89-58ef-4393-bfe1-eff638739972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:55.982192 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b5616e89-58ef-4393-bfe1-eff638739972 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:55.984231 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b5616e89-58ef-4393-bfe1-eff638739972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:56.002143 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 866/1749] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:56.002432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181496ad-8743-4e12-9561-55e90a64778a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:56.019669 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181496ad-8743-4e12-9561-55e90a64778a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:56.032472 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15380a43-7667-4e27-ab5e-a79264704960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:56.033172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15380a43-7667-4e27-ab5e-a79264704960 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:56.033455 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15380a43-7667-4e27-ab5e-a79264704960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:56.034246 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15380a43-7667-4e27-ab5e-a79264704960 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:56.035004 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15380a43-7667-4e27-ab5e-a79264704960 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:05:56.035386 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15380a43-7667-4e27-ab5e-a79264704960 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:56.037837 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15380a43-7667-4e27-ab5e-a79264704960 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:56.059305 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 884/1750] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:05:56.061141 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5616e89-58ef-4393-bfe1-eff638739972 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:56.076460 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5616e89-58ef-4393-bfe1-eff638739972 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:56.088380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ce745-2e0b-4384-8072-cbe895333b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:56.091273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ce745-2e0b-4384-8072-cbe895333b23 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:56.091684 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ce745-2e0b-4384-8072-cbe895333b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:56.092081 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ce745-2e0b-4384-8072-cbe895333b23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:56.092929 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ce745-2e0b-4384-8072-cbe895333b23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:56.099343 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ce745-2e0b-4384-8072-cbe895333b23 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:56.177358 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 867/1751] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:05:56 2022] POST /identity/v3/projects => generated 363 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:56.182463 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15380a43-7667-4e27-ab5e-a79264704960 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:56.193908 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15380a43-7667-4e27-ab5e-a79264704960 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:56.239846 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ce745-2e0b-4384-8072-cbe895333b23 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:56.241844 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4f7ce745-2e0b-4384-8072-cbe895333b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:56.341354 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6d128-3046-40b1-8729-b2dba5096080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:56.342340 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6d128-3046-40b1-8729-b2dba5096080 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:56.342630 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6d128-3046-40b1-8729-b2dba5096080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:56.342909 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6d128-3046-40b1-8729-b2dba5096080 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:56.348896 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6d128-3046-40b1-8729-b2dba5096080 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:56.351060 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6d128-3046-40b1-8729-b2dba5096080 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:56.412795 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 885/1752] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:05:56 2022] POST /identity/v3/users => generated 282 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:56.417368 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6d128-3046-40b1-8729-b2dba5096080 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:56.441579 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6d128-3046-40b1-8729-b2dba5096080 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:56.447044 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ce745-2e0b-4384-8072-cbe895333b23 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:56.455706 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbfcd88-2cb5-4383-af1c-c5a81f0fa052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:56.456570 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbfcd88-2cb5-4383-af1c-c5a81f0fa052 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:56.456963 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbfcd88-2cb5-4383-af1c-c5a81f0fa052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:56.457344 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbfcd88-2cb5-4383-af1c-c5a81f0fa052 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:56.458244 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbfcd88-2cb5-4383-af1c-c5a81f0fa052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:56.462204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbfcd88-2cb5-4383-af1c-c5a81f0fa052 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:56.465812 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0b856-2da4-43a8-9f41-d2831b0751c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:56.466718 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0b856-2da4-43a8-9f41-d2831b0751c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:56.467005 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0b856-2da4-43a8-9f41-d2831b0751c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:56.467310 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0b856-2da4-43a8-9f41-d2831b0751c5 admin admin] PATH_INFO: `/v3/users/8355809cdda64843bfbdc18af1a598db` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:56.468763 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0b856-2da4-43a8-9f41-d2831b0751c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8355809cdda64843bfbdc18af1a598db)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:56.470611 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0b856-2da4-43a8-9f41-d2831b0751c5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:56.515824 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 886/1753] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:56.517427 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbfcd88-2cb5-4383-af1c-c5a81f0fa052 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:56.557204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbfcd88-2cb5-4383-af1c-c5a81f0fa052 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:56.574797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443eb69d-5465-4a85-940e-107ea9b47ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:56.575704 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eb69d-5465-4a85-940e-107ea9b47ead admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:56.576106 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eb69d-5465-4a85-940e-107ea9b47ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:56.576477 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eb69d-5465-4a85-940e-107ea9b47ead admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:56.577357 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443eb69d-5465-4a85-940e-107ea9b47ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:56.579947 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443eb69d-5465-4a85-940e-107ea9b47ead admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:56.621506 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 887/1754] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:56.635544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443eb69d-5465-4a85-940e-107ea9b47ead admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:56.643094 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-443eb69d-5465-4a85-940e-107ea9b47ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:56.646025 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c0b0b856-2da4-43a8-9f41-d2831b0751c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8355809cdda64843bfbdc18af1a598db'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:56.674195 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443eb69d-5465-4a85-940e-107ea9b47ead admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:56.681228 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c0b0b856-2da4-43a8-9f41-d2831b0751c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8355809cdda64843bfbdc18af1a598db'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:56.681796 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323df16-dfd0-45ce-8074-aad8733697e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:56.682920 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323df16-dfd0-45ce-8074-aad8733697e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:56.683275 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323df16-dfd0-45ce-8074-aad8733697e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:56.683628 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323df16-dfd0-45ce-8074-aad8733697e9 admin admin] PATH_INFO: `/v3/projects/992e5db9a82242438791cf05877ec50d` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:56.685009 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323df16-dfd0-45ce-8074-aad8733697e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=992e5db9a82242438791cf05877ec50d)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:56.687572 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323df16-dfd0-45ce-8074-aad8733697e9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:56.706911 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:56.709241 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c0b0b856-2da4-43a8-9f41-d2831b0751c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8355809cdda64843bfbdc18af1a598db'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:56.711891 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c0b0b856-2da4-43a8-9f41-d2831b0751c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8355809cdda64843bfbdc18af1a598db'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:56.713000 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c0b0b856-2da4-43a8-9f41-d2831b0751c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8355809cdda64843bfbdc18af1a598db'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:56.757332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 868/1755] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:05:56 2022] DELETE /identity/v3/users/8355809cdda64843bfbdc18af1a598db => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:56.762026 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0b856-2da4-43a8-9f41-d2831b0751c5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:56.766101 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c0b0b856-2da4-43a8-9f41-d2831b0751c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:56.799321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c323df16-dfd0-45ce-8074-aad8733697e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '992e5db9a82242438791cf05877ec50d', 'request_id': 'req-c323df16-dfd0-45ce-8074-aad8733697e9'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:56.812315 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c323df16-dfd0-45ce-8074-aad8733697e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '992e5db9a82242438791cf05877ec50d', 'request_id': 'req-c323df16-dfd0-45ce-8074-aad8733697e9'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:56.830693 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c323df16-dfd0-45ce-8074-aad8733697e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '992e5db9a82242438791cf05877ec50d', 'request_id': 'req-c323df16-dfd0-45ce-8074-aad8733697e9'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:56.858345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:56.883025 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c323df16-dfd0-45ce-8074-aad8733697e9 admin admin] The token cache is being invalidate because project 992e5db9a82242438791cf05877ec50d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:05:56.884914 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c323df16-dfd0-45ce-8074-aad8733697e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:56.886534 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c323df16-dfd0-45ce-8074-aad8733697e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:56.893056 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 888/1756] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:05:56 2022] DELETE /identity/v3/projects/992e5db9a82242438791cf05877ec50d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:56.895704 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cce2e-ae15-49d8-9519-386222237b64 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:56.896561 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cce2e-ae15-49d8-9519-386222237b64 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:56.903348 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cce2e-ae15-49d8-9519-386222237b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:56.975792 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0b856-2da4-43a8-9f41-d2831b0751c5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:56.989095 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ec8cce2e-ae15-49d8-9519-386222237b64 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:56.991042 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ec8cce2e-ae15-49d8-9519-386222237b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:57.121816 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa846730-5701-4f3e-bc70-dd6f9137d5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:57.124434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa846730-5701-4f3e-bc70-dd6f9137d5c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:57.124831 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa846730-5701-4f3e-bc70-dd6f9137d5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:57.125091 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa846730-5701-4f3e-bc70-dd6f9137d5c4 admin admin] PATH_INFO: `/v3/projects/582f0c3defda4d828f48aa9aab57308e/users/ec77f097d6dd4355b7f27600dd237d49/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:57.148253 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 889/1757] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:57.150784 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69962538-6a08-4bb7-a9ac-6f56a21f5dec None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:57.151256 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69962538-6a08-4bb7-a9ac-6f56a21f5dec None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:57.152203 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69962538-6a08-4bb7-a9ac-6f56a21f5dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:57.169348 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa846730-5701-4f3e-bc70-dd6f9137d5c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=582f0c3defda4d828f48aa9aab57308e, user_id=ec77f097d6dd4355b7f27600dd237d49, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:57.176108 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa846730-5701-4f3e-bc70-dd6f9137d5c4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:57.183321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-69962538-6a08-4bb7-a9ac-6f56a21f5dec None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:57.185341 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-69962538-6a08-4bb7-a9ac-6f56a21f5dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:57.205404 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 869/1758] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:05:56 2022] PUT /identity/v3/projects/582f0c3defda4d828f48aa9aab57308e/users/ec77f097d6dd4355b7f27600dd237d49/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:57.206340 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa846730-5701-4f3e-bc70-dd6f9137d5c4 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:57.209210 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 890/1759] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:57.211366 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fa846730-5701-4f3e-bc70-dd6f9137d5c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:57.224026 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f4418-0340-473e-9446-b3335e9801de None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:57.224725 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f4418-0340-473e-9446-b3335e9801de None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:57.225013 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f4418-0340-473e-9446-b3335e9801de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:57.296481 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f65f4418-0340-473e-9446-b3335e9801de None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:57.297684 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f65f4418-0340-473e-9446-b3335e9801de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:57.357767 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa846730-5701-4f3e-bc70-dd6f9137d5c4 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:57.371651 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08485a7e-f07f-4c4d-8849-f3c80afc083f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:57.372773 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08485a7e-f07f-4c4d-8849-f3c80afc083f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:57.373146 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08485a7e-f07f-4c4d-8849-f3c80afc083f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:57.373338 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08485a7e-f07f-4c4d-8849-f3c80afc083f admin admin] PATH_INFO: `/v3/projects/f01e9a677c674e5ab7ce70657984652a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:57.385521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08485a7e-f07f-4c4d-8849-f3c80afc083f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f01e9a677c674e5ab7ce70657984652a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:57.385521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08485a7e-f07f-4c4d-8849-f3c80afc083f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:57.430897 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:57.471295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 891/1760] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:57.472989 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961087b8-eb28-4e31-bbbd-a3aef0d29f28 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:57.473279 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961087b8-eb28-4e31-bbbd-a3aef0d29f28 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:57.473558 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961087b8-eb28-4e31-bbbd-a3aef0d29f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:57.487654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-08485a7e-f07f-4c4d-8849-f3c80afc083f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f01e9a677c674e5ab7ce70657984652a', 'request_id': 'req-08485a7e-f07f-4c4d-8849-f3c80afc083f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:57.513673 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-08485a7e-f07f-4c4d-8849-f3c80afc083f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f01e9a677c674e5ab7ce70657984652a', 'request_id': 'req-08485a7e-f07f-4c4d-8849-f3c80afc083f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:57.533318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-08485a7e-f07f-4c4d-8849-f3c80afc083f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f01e9a677c674e5ab7ce70657984652a', 'request_id': 'req-08485a7e-f07f-4c4d-8849-f3c80afc083f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:57.540800 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-961087b8-eb28-4e31-bbbd-a3aef0d29f28 None None] MFA Rules not processed for user `ec77f097d6dd4355b7f27600dd237d49`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:57.545057 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-961087b8-eb28-4e31-bbbd-a3aef0d29f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:57.557794 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-08485a7e-f07f-4c4d-8849-f3c80afc083f admin admin] The token cache is being invalidate because project f01e9a677c674e5ab7ce70657984652a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:05:57.558004 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-08485a7e-f07f-4c4d-8849-f3c80afc083f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:57.559602 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-08485a7e-f07f-4c4d-8849-f3c80afc083f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:57.561741 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 870/1761] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:05:57 2022] DELETE /identity/v3/projects/f01e9a677c674e5ab7ce70657984652a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:57.572393 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08485a7e-f07f-4c4d-8849-f3c80afc083f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:57.575915 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-08485a7e-f07f-4c4d-8849-f3c80afc083f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:57.674595 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 892/1762] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:57 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:57.675112 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961087b8-eb28-4e31-bbbd-a3aef0d29f28 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:57.676812 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-961087b8-eb28-4e31-bbbd-a3aef0d29f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:57.686786 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08485a7e-f07f-4c4d-8849-f3c80afc083f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:57.697169 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b4f6b-8775-41cc-b329-c02159bccda0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:57.697863 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b4f6b-8775-41cc-b329-c02159bccda0 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:57.698406 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b4f6b-8775-41cc-b329-c02159bccda0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:57.698727 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b4f6b-8775-41cc-b329-c02159bccda0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:57.703646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2e3b4f6b-8775-41cc-b329-c02159bccda0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:57.747825 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:57.817384 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b4f6b-8775-41cc-b329-c02159bccda0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:57.824439 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b4f6b-8775-41cc-b329-c02159bccda0 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:57.841457 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961087b8-eb28-4e31-bbbd-a3aef0d29f28 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:57.846078 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 871/1763] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:05:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:05:57.848097 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d631d-a87d-47b3-8b76-0eab62355866 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:57.848952 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d631d-a87d-47b3-8b76-0eab62355866 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:57.851758 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d631d-a87d-47b3-8b76-0eab62355866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:57.856124 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6604c-c28a-45f7-8d4d-a8b8d1150138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:57.857077 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6604c-c28a-45f7-8d4d-a8b8d1150138 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:57.857512 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6604c-c28a-45f7-8d4d-a8b8d1150138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:57.858099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6604c-c28a-45f7-8d4d-a8b8d1150138 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:57.859145 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6604c-c28a-45f7-8d4d-a8b8d1150138 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:05:57.859633 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6604c-c28a-45f7-8d4d-a8b8d1150138 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:57.861506 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6604c-c28a-45f7-8d4d-a8b8d1150138 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:57.885895 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 893/1764] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:05:57.885895 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6604c-c28a-45f7-8d4d-a8b8d1150138 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:57.888918 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f4a6604c-c28a-45f7-8d4d-a8b8d1150138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:57.907640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-468d631d-a87d-47b3-8b76-0eab62355866 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:57.909883 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-468d631d-a87d-47b3-8b76-0eab62355866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:57.912613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6604c-c28a-45f7-8d4d-a8b8d1150138 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:57.933016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 872/1765] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:57.935449 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a82100-984a-4268-b7b3-f2a94648b15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:57.936836 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a82100-984a-4268-b7b3-f2a94648b15b admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:57.937279 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a82100-984a-4268-b7b3-f2a94648b15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:57.937715 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a82100-984a-4268-b7b3-f2a94648b15b admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:57.938573 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a82100-984a-4268-b7b3-f2a94648b15b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:57.939517 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d631d-a87d-47b3-8b76-0eab62355866 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:57.942784 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a82100-984a-4268-b7b3-f2a94648b15b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:57.973385 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d631d-a87d-47b3-8b76-0eab62355866 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:57.992291 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776d6e0-25eb-40f9-9e5a-10cc5865732e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:57.994320 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776d6e0-25eb-40f9-9e5a-10cc5865732e admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:57.994787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776d6e0-25eb-40f9-9e5a-10cc5865732e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:57.997938 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776d6e0-25eb-40f9-9e5a-10cc5865732e admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:57.998854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776d6e0-25eb-40f9-9e5a-10cc5865732e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:58.004633 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776d6e0-25eb-40f9-9e5a-10cc5865732e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:58.088304 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 894/1766] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:05:57 2022] POST /identity/v3/projects => generated 365 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:58.097086 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34724a-b2d6-4896-aef3-a26384c15632 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:58.097905 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34724a-b2d6-4896-aef3-a26384c15632 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:58.099462 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34724a-b2d6-4896-aef3-a26384c15632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:58.122520 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 873/1767] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:05:57 2022] POST /identity/v3/projects => generated 383 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:58.124125 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776d6e0-25eb-40f9-9e5a-10cc5865732e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:58.152434 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-4a34724a-b2d6-4896-aef3-a26384c15632 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:58.154002 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4a34724a-b2d6-4896-aef3-a26384c15632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:58.231410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:58.324325 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776d6e0-25eb-40f9-9e5a-10cc5865732e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:58.330308 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 895/1768] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:58.332407 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34724a-b2d6-4896-aef3-a26384c15632 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:58.338732 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b817078-90d9-4c58-9205-84e0c2d0754e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:58.339733 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b817078-90d9-4c58-9205-84e0c2d0754e admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:58.340029 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b817078-90d9-4c58-9205-84e0c2d0754e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:58.340775 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b817078-90d9-4c58-9205-84e0c2d0754e admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:58.342865 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b817078-90d9-4c58-9205-84e0c2d0754e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:58.347923 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b817078-90d9-4c58-9205-84e0c2d0754e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:58.355167 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34724a-b2d6-4896-aef3-a26384c15632 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:58.377398 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccd004-51a7-40a7-a1b2-e2443c2d6cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:58.377398 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccd004-51a7-40a7-a1b2-e2443c2d6cbb admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:58.377398 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccd004-51a7-40a7-a1b2-e2443c2d6cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:58.377398 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccd004-51a7-40a7-a1b2-e2443c2d6cbb admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:58.377859 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfccd004-51a7-40a7-a1b2-e2443c2d6cbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:58.380056 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfccd004-51a7-40a7-a1b2-e2443c2d6cbb admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:58.400867 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 874/1769] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:05:58 2022] POST /identity/v3/users => generated 289 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:58.404656 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b817078-90d9-4c58-9205-84e0c2d0754e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:58.463564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b817078-90d9-4c58-9205-84e0c2d0754e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:58.473847 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 896/1770] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:05:58 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:58.474825 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccd004-51a7-40a7-a1b2-e2443c2d6cbb admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:58.479484 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf8b19-4ff1-41c2-9dcb-e847e0b4c7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:58.483307 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf8b19-4ff1-41c2-9dcb-e847e0b4c7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:58.483625 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf8b19-4ff1-41c2-9dcb-e847e0b4c7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:58.483919 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf8b19-4ff1-41c2-9dcb-e847e0b4c7e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:58.484701 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf8b19-4ff1-41c2-9dcb-e847e0b4c7e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:05:58.485141 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf8b19-4ff1-41c2-9dcb-e847e0b4c7e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:58.504121 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf8b19-4ff1-41c2-9dcb-e847e0b4c7e4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:58.522959 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 875/1771] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:05:58.524500 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf8b19-4ff1-41c2-9dcb-e847e0b4c7e4 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:58.531779 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccd004-51a7-40a7-a1b2-e2443c2d6cbb admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:58.538586 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf8b19-4ff1-41c2-9dcb-e847e0b4c7e4 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:58.546266 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a1283-3c7a-456e-86ef-93cc86b1b929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:58.547169 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b86fe7-1cf0-42e6-a659-9c0994ab5473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:58.547866 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a1283-3c7a-456e-86ef-93cc86b1b929 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:58.548328 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a1283-3c7a-456e-86ef-93cc86b1b929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:58.548639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b86fe7-1cf0-42e6-a659-9c0994ab5473 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:58.548882 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a1283-3c7a-456e-86ef-93cc86b1b929 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:58.549266 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b86fe7-1cf0-42e6-a659-9c0994ab5473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:58.549689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b86fe7-1cf0-42e6-a659-9c0994ab5473 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:58.550396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a1283-3c7a-456e-86ef-93cc86b1b929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:58.550917 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b86fe7-1cf0-42e6-a659-9c0994ab5473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:58.552866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b86fe7-1cf0-42e6-a659-9c0994ab5473 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:58.553003 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a1283-3c7a-456e-86ef-93cc86b1b929 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:58.575604 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 876/1772] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:58.576019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a1283-3c7a-456e-86ef-93cc86b1b929 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:58.599047 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 897/1773] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:58.600143 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b86fe7-1cf0-42e6-a659-9c0994ab5473 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:58.610182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a1283-3c7a-456e-86ef-93cc86b1b929 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:58.621793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fbec7-41a0-4601-a0bd-de2fe9d0334c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:58.622556 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fbec7-41a0-4601-a0bd-de2fe9d0334c admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:58.622853 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fbec7-41a0-4601-a0bd-de2fe9d0334c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:58.623140 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fbec7-41a0-4601-a0bd-de2fe9d0334c admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:58.623909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fbec7-41a0-4601-a0bd-de2fe9d0334c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:58.626739 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fbec7-41a0-4601-a0bd-de2fe9d0334c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:58.634622 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b86fe7-1cf0-42e6-a659-9c0994ab5473 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:58.641387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025688e2-5ef9-428b-adc8-7a0c5677efc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:58.641992 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025688e2-5ef9-428b-adc8-7a0c5677efc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:58.642288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025688e2-5ef9-428b-adc8-7a0c5677efc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:58.643188 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025688e2-5ef9-428b-adc8-7a0c5677efc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:58.644097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025688e2-5ef9-428b-adc8-7a0c5677efc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:58.645819 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025688e2-5ef9-428b-adc8-7a0c5677efc0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:58.662298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 898/1774] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:58.663810 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025688e2-5ef9-428b-adc8-7a0c5677efc0 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:58.675447 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025688e2-5ef9-428b-adc8-7a0c5677efc0 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:58.682592 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a7dbc-6433-4042-9ac6-a79e8e1886be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:58.683543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a7dbc-6433-4042-9ac6-a79e8e1886be admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:58.683828 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a7dbc-6433-4042-9ac6-a79e8e1886be admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:58.684105 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a7dbc-6433-4042-9ac6-a79e8e1886be admin admin] PATH_INFO: `/v3/projects/fd0de2ad8f624748bd6950291d54acfa/users/5353802df2684c909d9edf257fbc3bfa/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:58.685481 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 877/1775] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:05:58 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:58.686432 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fbec7-41a0-4601-a0bd-de2fe9d0334c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:58.689829 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-491fbec7-41a0-4601-a0bd-de2fe9d0334c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:58.704206 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a7dbc-6433-4042-9ac6-a79e8e1886be admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd0de2ad8f624748bd6950291d54acfa, user_id=5353802df2684c909d9edf257fbc3bfa, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:58.707779 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a7dbc-6433-4042-9ac6-a79e8e1886be admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:58.731248 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 899/1776] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:05:58 2022] PUT /identity/v3/projects/fd0de2ad8f624748bd6950291d54acfa/users/5353802df2684c909d9edf257fbc3bfa/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:58.732331 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a7dbc-6433-4042-9ac6-a79e8e1886be admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:58.798556 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:58.803170 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fbec7-41a0-4601-a0bd-de2fe9d0334c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:58.851639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a7dbc-6433-4042-9ac6-a79e8e1886be admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:58.864413 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6495101-5447-42c3-bc59-164abde9a729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:58.865699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6495101-5447-42c3-bc59-164abde9a729 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:58.866735 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6495101-5447-42c3-bc59-164abde9a729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:58.868528 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6495101-5447-42c3-bc59-164abde9a729 admin admin] PATH_INFO: `/v3/projects/720cf9e8a4d043dfbd2e93cfbbb0eef2/users/6a2522811e66499ab27efd13f2a3f05a/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:58.894927 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6495101-5447-42c3-bc59-164abde9a729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=720cf9e8a4d043dfbd2e93cfbbb0eef2, user_id=6a2522811e66499ab27efd13f2a3f05a, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:58.898235 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6495101-5447-42c3-bc59-164abde9a729 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:58.923466 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 900/1777] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:05:58 2022] PUT /identity/v3/projects/720cf9e8a4d043dfbd2e93cfbbb0eef2/users/6a2522811e66499ab27efd13f2a3f05a/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:58.924715 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6495101-5447-42c3-bc59-164abde9a729 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:59.061612 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4312d77-5e22-41be-a66d-7843bf0ee112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:59.067621 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4312d77-5e22-41be-a66d-7843bf0ee112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:59.068600 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4312d77-5e22-41be-a66d-7843bf0ee112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:59.070030 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4312d77-5e22-41be-a66d-7843bf0ee112 admin admin] PATH_INFO: `/v3/projects/39d695e996c945349b16ae8ffcfd9069` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:59.077366 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4312d77-5e22-41be-a66d-7843bf0ee112 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39d695e996c945349b16ae8ffcfd9069)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:59.082406 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4312d77-5e22-41be-a66d-7843bf0ee112 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:59.148331 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:59.217751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b4312d77-5e22-41be-a66d-7843bf0ee112 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39d695e996c945349b16ae8ffcfd9069', 'request_id': 'req-b4312d77-5e22-41be-a66d-7843bf0ee112'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:59.242471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6495101-5447-42c3-bc59-164abde9a729 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:59.248488 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b4312d77-5e22-41be-a66d-7843bf0ee112 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39d695e996c945349b16ae8ffcfd9069', 'request_id': 'req-b4312d77-5e22-41be-a66d-7843bf0ee112'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:59.264965 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b4312d77-5e22-41be-a66d-7843bf0ee112 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39d695e996c945349b16ae8ffcfd9069', 'request_id': 'req-b4312d77-5e22-41be-a66d-7843bf0ee112'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:59.297098 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b4312d77-5e22-41be-a66d-7843bf0ee112 admin admin] The token cache is being invalidate because project 39d695e996c945349b16ae8ffcfd9069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:05:59.297508 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b4312d77-5e22-41be-a66d-7843bf0ee112 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:59.332305 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-b4312d77-5e22-41be-a66d-7843bf0ee112 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:05:59.336807 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 878/1778] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:05:58 2022] DELETE /identity/v3/projects/39d695e996c945349b16ae8ffcfd9069 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:59.348347 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4312d77-5e22-41be-a66d-7843bf0ee112 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:59.352357 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b4312d77-5e22-41be-a66d-7843bf0ee112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:59.431980 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd600f0b-5cfd-49c7-a58b-7d3689201828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:59.432840 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd600f0b-5cfd-49c7-a58b-7d3689201828 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:59.433258 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd600f0b-5cfd-49c7-a58b-7d3689201828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:59.433646 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd600f0b-5cfd-49c7-a58b-7d3689201828 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:59.434621 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd600f0b-5cfd-49c7-a58b-7d3689201828 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:59.440295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd600f0b-5cfd-49c7-a58b-7d3689201828 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:59.470026 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4312d77-5e22-41be-a66d-7843bf0ee112 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:59.477292 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0b1d4-2363-4cd1-89a3-72cab6ca245a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:59.478286 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0b1d4-2363-4cd1-89a3-72cab6ca245a admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:59.478848 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0b1d4-2363-4cd1-89a3-72cab6ca245a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:59.479302 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0b1d4-2363-4cd1-89a3-72cab6ca245a admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:59.480426 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0b1d4-2363-4cd1-89a3-72cab6ca245a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:59.482714 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 901/1779] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:05:58 2022] POST /identity/v3/users => generated 289 bytes in 558 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:59.483094 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0b1d4-2363-4cd1-89a3-72cab6ca245a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:59.484093 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210312a5-3916-44b2-858c-d63f31f394c9 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:59.484489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210312a5-3916-44b2-858c-d63f31f394c9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:59.484894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210312a5-3916-44b2-858c-d63f31f394c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:59.497677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 879/1780] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:59.499468 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd86c44-17bd-40cf-855f-bb0884092bc2 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:59.501008 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd86c44-17bd-40cf-855f-bb0884092bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:59.501523 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd86c44-17bd-40cf-855f-bb0884092bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:59.551082 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-3bd86c44-17bd-40cf-855f-bb0884092bc2 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:59.552375 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3bd86c44-17bd-40cf-855f-bb0884092bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:59.557112 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-210312a5-3916-44b2-858c-d63f31f394c9 None None] MFA Rules not processed for user `6a2522811e66499ab27efd13f2a3f05a`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:59.558435 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-210312a5-3916-44b2-858c-d63f31f394c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:59.579479 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 880/1781] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:59.579479 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd86c44-17bd-40cf-855f-bb0884092bc2 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:59.581463 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3bd86c44-17bd-40cf-855f-bb0884092bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:59.607884 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:59.611071 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd86c44-17bd-40cf-855f-bb0884092bc2 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:59.624294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac86ba-1f2c-418e-a98d-3a082a44b631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:59.626149 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac86ba-1f2c-418e-a98d-3a082a44b631 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:59.626548 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac86ba-1f2c-418e-a98d-3a082a44b631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:59.627288 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac86ba-1f2c-418e-a98d-3a082a44b631 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:59.628326 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac86ba-1f2c-418e-a98d-3a082a44b631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:59.633770 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac86ba-1f2c-418e-a98d-3a082a44b631 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:59.653499 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 881/1782] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:59.659191 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 902/1783] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:59.659191 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210312a5-3916-44b2-858c-d63f31f394c9 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:59.659551 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b0ebf-bc85-444f-8633-54b106d06bf6 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:59.659980 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b0ebf-bc85-444f-8633-54b106d06bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:59.660892 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b0ebf-bc85-444f-8633-54b106d06bf6 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:59.666532 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 882/1784] 10.222.0.24 () {54 vars in 921 bytes} [Thu May 19 15:05:59 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 15:05:59.667974 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21093a28-c9b5-4e42-b9a7-90920f5cd200 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:59.670154 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21093a28-c9b5-4e42-b9a7-90920f5cd200 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:59.670566 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21093a28-c9b5-4e42-b9a7-90920f5cd200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:59.679387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210312a5-3916-44b2-858c-d63f31f394c9 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:59.689354 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73a5fb-5e67-48e3-8cb0-f4aad6cd2bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:59.692875 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73a5fb-5e67-48e3-8cb0-f4aad6cd2bb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:59.695443 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73a5fb-5e67-48e3-8cb0-f4aad6cd2bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:59.695837 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73a5fb-5e67-48e3-8cb0-f4aad6cd2bb6 admin admin] PATH_INFO: `/v3/projects/fd0de2ad8f624748bd6950291d54acfa/users/5353802df2684c909d9edf257fbc3bfa/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:59.699682 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73a5fb-5e67-48e3-8cb0-f4aad6cd2bb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd0de2ad8f624748bd6950291d54acfa, user_id=5353802df2684c909d9edf257fbc3bfa, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:59.704787 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73a5fb-5e67-48e3-8cb0-f4aad6cd2bb6 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:59.705475 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-21093a28-c9b5-4e42-b9a7-90920f5cd200 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:59.706776 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-21093a28-c9b5-4e42-b9a7-90920f5cd200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:59.731433 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 883/1785] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:05:59.732442 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21093a28-c9b5-4e42-b9a7-90920f5cd200 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:59.753582 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21093a28-c9b5-4e42-b9a7-90920f5cd200 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:59.762480 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 903/1786] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:05:59 2022] PUT /identity/v3/projects/fd0de2ad8f624748bd6950291d54acfa/users/5353802df2684c909d9edf257fbc3bfa/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:05:59.763524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73a5fb-5e67-48e3-8cb0-f4aad6cd2bb6 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:59.765235 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7c73a5fb-5e67-48e3-8cb0-f4aad6cd2bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:59.831345 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d16dd0-8b3f-466d-81a5-0ebafff19b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:59.832033 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d16dd0-8b3f-466d-81a5-0ebafff19b77 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:59.832320 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d16dd0-8b3f-466d-81a5-0ebafff19b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:59.832600 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d16dd0-8b3f-466d-81a5-0ebafff19b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:59.834086 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d16dd0-8b3f-466d-81a5-0ebafff19b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:59.835801 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d16dd0-8b3f-466d-81a5-0ebafff19b77 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:59.847409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 884/1787] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:05:59.848178 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d16dd0-8b3f-466d-81a5-0ebafff19b77 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:05:59.860667 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d16dd0-8b3f-466d-81a5-0ebafff19b77 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:59.861878 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73a5fb-5e67-48e3-8cb0-f4aad6cd2bb6 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:05:59.865857 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b81f9-0165-47b8-a0ca-296bea563bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:59.867076 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b81f9-0165-47b8-a0ca-296bea563bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:59.867402 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b81f9-0165-47b8-a0ca-296bea563bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:59.867778 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b81f9-0165-47b8-a0ca-296bea563bb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:59.868246 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c0285-df0e-4e20-b13c-93744b657da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:05:59.868523 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b81f9-0165-47b8-a0ca-296bea563bb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:05:59.868839 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b81f9-0165-47b8-a0ca-296bea563bb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:59.869131 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c0285-df0e-4e20-b13c-93744b657da5 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:59.869488 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c0285-df0e-4e20-b13c-93744b657da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:59.869838 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c0285-df0e-4e20-b13c-93744b657da5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:59.870476 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b81f9-0165-47b8-a0ca-296bea563bb4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:59.870618 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c0285-df0e-4e20-b13c-93744b657da5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:05:59.873301 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c0285-df0e-4e20-b13c-93744b657da5 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:05:59.889489 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 885/1788] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:05:59.891074 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d542c79-e8a5-43b3-b4ec-7e1c1464f3b3 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:59.891990 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d542c79-e8a5-43b3-b4ec-7e1c1464f3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:59.892426 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d542c79-e8a5-43b3-b4ec-7e1c1464f3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:59.908097 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:59.911010 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 904/1789] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:05:59 2022] POST /identity/v3/projects => generated 381 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:05:59.914067 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d963e63-b833-4fff-bc25-a649adebf675 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:05:59.914639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d963e63-b833-4fff-bc25-a649adebf675 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:05:59.915309 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d963e63-b833-4fff-bc25-a649adebf675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:05:59.918648 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1d542c79-e8a5-43b3-b4ec-7e1c1464f3b3 None None] MFA Rules not processed for user `06fb8bb5aeb143ad95f33c3b43dbd346`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:59.920244 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1d542c79-e8a5-43b3-b4ec-7e1c1464f3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:05:59.982226 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-8d963e63-b833-4fff-bc25-a649adebf675 None None] MFA Rules not processed for user `5353802df2684c909d9edf257fbc3bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:05:59.983922 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8d963e63-b833-4fff-bc25-a649adebf675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:00.023991 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 886/1790] 10.222.0.24 () {58 vars in 1018 bytes} [Thu May 19 15:05:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:00.025135 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d542c79-e8a5-43b3-b4ec-7e1c1464f3b3 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:00.097902 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 905/1791] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:05:59 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:00.099242 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d963e63-b833-4fff-bc25-a649adebf675 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:00.180920 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:00.185197 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d542c79-e8a5-43b3-b4ec-7e1c1464f3b3 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:00.191646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51891ec8-2e98-481a-a509-e395fd46ca6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:00.193111 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51891ec8-2e98-481a-a509-e395fd46ca6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:00.193402 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51891ec8-2e98-481a-a509-e395fd46ca6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:00.193687 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51891ec8-2e98-481a-a509-e395fd46ca6a admin admin] PATH_INFO: `/v3/projects/0eaceba4a952435ba0fef07cceb9e5db/users/ac5426e3747048019e4c3c54c8ec274e/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:00.208813 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d963e63-b833-4fff-bc25-a649adebf675 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:00.215391 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3b7a9-6785-470a-ad97-6d086ec9be31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:00.216180 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3b7a9-6785-470a-ad97-6d086ec9be31 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:00.216478 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51891ec8-2e98-481a-a509-e395fd46ca6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eaceba4a952435ba0fef07cceb9e5db, user_id=ac5426e3747048019e4c3c54c8ec274e, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:00.216607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3b7a9-6785-470a-ad97-6d086ec9be31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:00.216940 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3b7a9-6785-470a-ad97-6d086ec9be31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:00.217923 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd3b7a9-6785-470a-ad97-6d086ec9be31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:00.219490 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51891ec8-2e98-481a-a509-e395fd46ca6a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:00.220333 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd3b7a9-6785-470a-ad97-6d086ec9be31 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:00.240726 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 887/1792] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:00 2022] PUT /identity/v3/projects/0eaceba4a952435ba0fef07cceb9e5db/users/ac5426e3747048019e4c3c54c8ec274e/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:00.244278 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51891ec8-2e98-481a-a509-e395fd46ca6a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:00.271828 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 906/1793] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:06:00 2022] POST /identity/v3/projects => generated 371 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:00.278658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3b7a9-6785-470a-ad97-6d086ec9be31 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:00.282971 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8cd3b7a9-6785-470a-ad97-6d086ec9be31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:00.391978 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3b7a9-6785-470a-ad97-6d086ec9be31 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:00.398755 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a1964-ef3e-4022-9b29-1e69cc2977a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:00.399917 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a1964-ef3e-4022-9b29-1e69cc2977a0 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:00.400049 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51891ec8-2e98-481a-a509-e395fd46ca6a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:00.400525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a1964-ef3e-4022-9b29-1e69cc2977a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:00.401060 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a1964-ef3e-4022-9b29-1e69cc2977a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:00.412733 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a1964-ef3e-4022-9b29-1e69cc2977a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:00.415523 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a1964-ef3e-4022-9b29-1e69cc2977a0 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:00.428167 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 907/1794] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:00.429481 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a1964-ef3e-4022-9b29-1e69cc2977a0 service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:00.431242 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-389a1964-ef3e-4022-9b29-1e69cc2977a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:00.456893 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:00.504347 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a1964-ef3e-4022-9b29-1e69cc2977a0 service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:00.509133 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eefee1d-ae66-47e5-b5eb-0fcafd180649 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:00.511243 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefee1d-ae66-47e5-b5eb-0fcafd180649 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:00.511649 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefee1d-ae66-47e5-b5eb-0fcafd180649 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:00.512026 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefee1d-ae66-47e5-b5eb-0fcafd180649 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:00.520241 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6d3b4-8428-4c20-9182-3df50fea6eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:00.520936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6d3b4-8428-4c20-9182-3df50fea6eda admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:00.521224 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6d3b4-8428-4c20-9182-3df50fea6eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:00.521502 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6d3b4-8428-4c20-9182-3df50fea6eda admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:00.522557 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6d3b4-8428-4c20-9182-3df50fea6eda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:00.524383 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6d3b4-8428-4c20-9182-3df50fea6eda admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:00.570206 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 888/1795] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:06:00 2022] POST /identity/v3/users => generated 297 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:00.571628 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565eb45-adcb-4e6c-8a31-109447507803 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:00.572114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565eb45-adcb-4e6c-8a31-109447507803 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:00.572441 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565eb45-adcb-4e6c-8a31-109447507803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:00.605176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-6565eb45-adcb-4e6c-8a31-109447507803 None None] MFA Rules not processed for user `ac5426e3747048019e4c3c54c8ec274e`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:00.607104 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6565eb45-adcb-4e6c-8a31-109447507803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:00.610688 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eefee1d-ae66-47e5-b5eb-0fcafd180649 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:00.612302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eefee1d-ae66-47e5-b5eb-0fcafd180649 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:00.623059 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:00.641639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 908/1796] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:00 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:00.642856 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eefee1d-ae66-47e5-b5eb-0fcafd180649 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:00.664882 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eefee1d-ae66-47e5-b5eb-0fcafd180649 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:00.677083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b6cea-fcc5-42f6-bb8a-7574d297c69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:00.678165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b6cea-fcc5-42f6-bb8a-7574d297c69b admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:00.679229 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b6cea-fcc5-42f6-bb8a-7574d297c69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:00.679746 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b6cea-fcc5-42f6-bb8a-7574d297c69b admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:00.682462 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b6cea-fcc5-42f6-bb8a-7574d297c69b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:00.684659 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b6cea-fcc5-42f6-bb8a-7574d297c69b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:00.737871 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 909/1797] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:06:00 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:00.737871 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e465f-f363-4df3-afdc-ca6a1050c2dc None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:00.737871 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e465f-f363-4df3-afdc-ca6a1050c2dc None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:00.737871 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e465f-f363-4df3-afdc-ca6a1050c2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:00.765256 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 889/1798] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:00.767001 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565eb45-adcb-4e6c-8a31-109447507803 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:00.794126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565eb45-adcb-4e6c-8a31-109447507803 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:00.802697 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-493e465f-f363-4df3-afdc-ca6a1050c2dc None None] MFA Rules not processed for user `644abe5583e94049abd23e4ca050a066`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:00.812431 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a17cc3-9a13-4172-a96b-67722f445533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:00.812548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-493e465f-f363-4df3-afdc-ca6a1050c2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:00.812657 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a17cc3-9a13-4172-a96b-67722f445533 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:00.822480 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a17cc3-9a13-4172-a96b-67722f445533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:00.823055 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a17cc3-9a13-4172-a96b-67722f445533 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:00.824044 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a17cc3-9a13-4172-a96b-67722f445533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:00.826030 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a17cc3-9a13-4172-a96b-67722f445533 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:00.865511 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 890/1799] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:00.867438 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920aa76-fbab-44a8-8a1b-18d7c8507aea None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:00.868319 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920aa76-fbab-44a8-8a1b-18d7c8507aea None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:00.869347 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920aa76-fbab-44a8-8a1b-18d7c8507aea None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:00.874030 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 891/1800] 10.222.0.24 () {54 vars in 921 bytes} [Thu May 19 15:06:00 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 15:06:00.874945 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920aa76-fbab-44a8-8a1b-18d7c8507aea None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:00.905294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920aa76-fbab-44a8-8a1b-18d7c8507aea None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:00.911752 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc4b5b-4ca9-4e06-ba29-2724166468b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:00.912745 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc4b5b-4ca9-4e06-ba29-2724166468b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:00.913715 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc4b5b-4ca9-4e06-ba29-2724166468b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:00.914138 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc4b5b-4ca9-4e06-ba29-2724166468b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:00.915836 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc4b5b-4ca9-4e06-ba29-2724166468b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:00.917514 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc4b5b-4ca9-4e06-ba29-2724166468b7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:00.945209 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 892/1801] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:00.946875 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc4b5b-4ca9-4e06-ba29-2724166468b7 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:00.953124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-89dc4b5b-4ca9-4e06-ba29-2724166468b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:00.962765 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 910/1802] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:00.963678 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e465f-f363-4df3-afdc-ca6a1050c2dc None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:00.980308 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e465f-f363-4df3-afdc-ca6a1050c2dc None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:00.985275 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35fe1d-b198-4d85-a26c-7535a3a6d877 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:00.986073 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35fe1d-b198-4d85-a26c-7535a3a6d877 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:00.986568 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35fe1d-b198-4d85-a26c-7535a3a6d877 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:00.986918 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35fe1d-b198-4d85-a26c-7535a3a6d877 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:00.989145 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ba35fe1d-b198-4d85-a26c-7535a3a6d877 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:01.064433 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc4b5b-4ca9-4e06-ba29-2724166468b7 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:01.069192 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894e692-1042-4284-a9a2-1a3110783b64 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1dc1d74631b4d69a3094e4e1e2a0ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:01.069993 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894e692-1042-4284-a9a2-1a3110783b64 service glance] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:01.070393 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894e692-1042-4284-a9a2-1a3110783b64 service glance] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:01.070863 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894e692-1042-4284-a9a2-1a3110783b64 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:01.084750 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7894e692-1042-4284-a9a2-1a3110783b64 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:01.086347 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7894e692-1042-4284-a9a2-1a3110783b64 service glance] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:01.087750 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35fe1d-b198-4d85-a26c-7535a3a6d877 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:01.089889 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba35fe1d-b198-4d85-a26c-7535a3a6d877 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:01.100824 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 893/1803] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:01.101925 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894e692-1042-4284-a9a2-1a3110783b64 service glance] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:01.112419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 911/1804] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:00 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:01.113653 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc74702-4ad0-4ddc-9234-75399b224c77 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:01.113771 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894e692-1042-4284-a9a2-1a3110783b64 service glance] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:01.113886 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc74702-4ad0-4ddc-9234-75399b224c77 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:01.114430 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc74702-4ad0-4ddc-9234-75399b224c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:01.119569 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20dd7e-ba68-467c-af92-d3e15bf67699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:01.121832 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20dd7e-ba68-467c-af92-d3e15bf67699 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:01.122141 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20dd7e-ba68-467c-af92-d3e15bf67699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:01.122557 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20dd7e-ba68-467c-af92-d3e15bf67699 admin admin] PATH_INFO: `/v3/projects/46b2774b92a4423ebc86470f8bc222e8/users/5e253064394d4088b226f2741c45f885/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:01.155637 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20dd7e-ba68-467c-af92-d3e15bf67699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46b2774b92a4423ebc86470f8bc222e8, user_id=5e253064394d4088b226f2741c45f885, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:01.158539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20dd7e-ba68-467c-af92-d3e15bf67699 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:01.177601 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7fc74702-4ad0-4ddc-9234-75399b224c77 None None] MFA Rules not processed for user `06fb8bb5aeb143ad95f33c3b43dbd346`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:01.179867 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7fc74702-4ad0-4ddc-9234-75399b224c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:01.202611 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 894/1805] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:01 2022] PUT /identity/v3/projects/46b2774b92a4423ebc86470f8bc222e8/users/5e253064394d4088b226f2741c45f885/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:01.204039 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20dd7e-ba68-467c-af92-d3e15bf67699 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:01.214840 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 912/1806] 10.222.0.24 () {58 vars in 1018 bytes} [Thu May 19 15:06:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:01.215720 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc74702-4ad0-4ddc-9234-75399b224c77 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:01.219519 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:01.233927 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc74702-4ad0-4ddc-9234-75399b224c77 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:01.357133 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20dd7e-ba68-467c-af92-d3e15bf67699 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:01.377710 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01950dfc-fdee-4792-88ef-2196b2a9660b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:01.378416 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01950dfc-fdee-4792-88ef-2196b2a9660b admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:01.379514 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01950dfc-fdee-4792-88ef-2196b2a9660b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:01.379514 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01950dfc-fdee-4792-88ef-2196b2a9660b admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:01.379776 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01950dfc-fdee-4792-88ef-2196b2a9660b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:01.383914 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473824ba-0f93-44f2-b32a-303277a9751f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:01.384815 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473824ba-0f93-44f2-b32a-303277a9751f admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:01.385117 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473824ba-0f93-44f2-b32a-303277a9751f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:01.386484 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473824ba-0f93-44f2-b32a-303277a9751f admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:01.387278 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473824ba-0f93-44f2-b32a-303277a9751f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:01.387915 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01950dfc-fdee-4792-88ef-2196b2a9660b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:01.391840 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473824ba-0f93-44f2-b32a-303277a9751f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:01.416841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 895/1807] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:01.417758 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01950dfc-fdee-4792-88ef-2196b2a9660b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:01.428821 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01950dfc-fdee-4792-88ef-2196b2a9660b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:01.434376 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 913/1808] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:01.436286 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473824ba-0f93-44f2-b32a-303277a9751f admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:01.437855 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886e1ea-0a06-4a47-8ec0-33c087e5f039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:01.438770 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886e1ea-0a06-4a47-8ec0-33c087e5f039 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:01.439062 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886e1ea-0a06-4a47-8ec0-33c087e5f039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:01.439386 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886e1ea-0a06-4a47-8ec0-33c087e5f039 admin admin] PATH_INFO: `/v3/projects/ac7472a3fcdb4c07a4dccee37d43aa36/users/9fa2870c6d344c1ea0dfa10ae7fc80a8/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:01.468713 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886e1ea-0a06-4a47-8ec0-33c087e5f039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac7472a3fcdb4c07a4dccee37d43aa36, user_id=9fa2870c6d344c1ea0dfa10ae7fc80a8, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:01.469694 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473824ba-0f93-44f2-b32a-303277a9751f admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:01.473166 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886e1ea-0a06-4a47-8ec0-33c087e5f039 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:01.485773 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d7a65-42af-44e7-b6bb-e60e1460c7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:01.487126 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d7a65-42af-44e7-b6bb-e60e1460c7a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:01.487453 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d7a65-42af-44e7-b6bb-e60e1460c7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:01.487742 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d7a65-42af-44e7-b6bb-e60e1460c7a6 admin admin] PATH_INFO: `/v3/projects/46b2774b92a4423ebc86470f8bc222e8/users/5e253064394d4088b226f2741c45f885/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:01.493449 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d7a65-42af-44e7-b6bb-e60e1460c7a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46b2774b92a4423ebc86470f8bc222e8, user_id=5e253064394d4088b226f2741c45f885, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:01.501457 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d7a65-42af-44e7-b6bb-e60e1460c7a6 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:01.533333 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 896/1809] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:01 2022] PUT /identity/v3/projects/ac7472a3fcdb4c07a4dccee37d43aa36/users/9fa2870c6d344c1ea0dfa10ae7fc80a8/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:01.535291 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f381d0-d4c5-4c73-bb8f-88f9b2460473 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:01.535598 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f381d0-d4c5-4c73-bb8f-88f9b2460473 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:01.535882 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f381d0-d4c5-4c73-bb8f-88f9b2460473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:01.539112 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:01.554045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 914/1810] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:01 2022] PUT /identity/v3/projects/46b2774b92a4423ebc86470f8bc222e8/users/5e253064394d4088b226f2741c45f885/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:01.567600 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fe2e5-053a-49d3-aef6-2a763e1403d5 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:01.567970 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fe2e5-053a-49d3-aef6-2a763e1403d5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:01.568164 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fe2e5-053a-49d3-aef6-2a763e1403d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:01.605362 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-80f381d0-d4c5-4c73-bb8f-88f9b2460473 None None] MFA Rules not processed for user `9fa2870c6d344c1ea0dfa10ae7fc80a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:01.606802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-80f381d0-d4c5-4c73-bb8f-88f9b2460473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:01.622857 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-905fe2e5-053a-49d3-aef6-2a763e1403d5 None None] MFA Rules not processed for user `5e253064394d4088b226f2741c45f885`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:01.624167 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-905fe2e5-053a-49d3-aef6-2a763e1403d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:01.687359 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 897/1811] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:06:01.691705 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f381d0-d4c5-4c73-bb8f-88f9b2460473 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:01.718481 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 915/1812] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:01.734213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fe2e5-053a-49d3-aef6-2a763e1403d5 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:01.820814 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fe2e5-053a-49d3-aef6-2a763e1403d5 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:01.825307 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc012297-06e0-4ecc-ae8a-7800a3676eeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:01.826071 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc012297-06e0-4ecc-ae8a-7800a3676eeb service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:01.826355 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc012297-06e0-4ecc-ae8a-7800a3676eeb service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:01.826635 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc012297-06e0-4ecc-ae8a-7800a3676eeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:01.832179 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f381d0-d4c5-4c73-bb8f-88f9b2460473 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:01.839609 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a176f-f011-4df0-979f-3702988036c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:01.839769 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc012297-06e0-4ecc-ae8a-7800a3676eeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:01.840451 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a176f-f011-4df0-979f-3702988036c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:01.841076 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a176f-f011-4df0-979f-3702988036c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:01.841375 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a176f-f011-4df0-979f-3702988036c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:01.841477 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc012297-06e0-4ecc-ae8a-7800a3676eeb service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:01.842084 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a176f-f011-4df0-979f-3702988036c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:01.844273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a176f-f011-4df0-979f-3702988036c2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:01.859227 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:01.863260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 916/1813] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 15:06:01.864945 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc012297-06e0-4ecc-ae8a-7800a3676eeb service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:01.904203 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 898/1814] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:06:01 2022] POST /identity/v3/projects => generated 373 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:01.905780 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a176f-f011-4df0-979f-3702988036c2 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:02.063813 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc012297-06e0-4ecc-ae8a-7800a3676eeb service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:02.088257 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a176f-f011-4df0-979f-3702988036c2 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:02.102990 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eed4a0-0c0d-4ca2-8279-eaa3da8b3669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:02.103779 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eed4a0-0c0d-4ca2-8279-eaa3da8b3669 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:02.104107 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eed4a0-0c0d-4ca2-8279-eaa3da8b3669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:02.104387 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eed4a0-0c0d-4ca2-8279-eaa3da8b3669 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:02.105134 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eed4a0-0c0d-4ca2-8279-eaa3da8b3669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:02.109967 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eed4a0-0c0d-4ca2-8279-eaa3da8b3669 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:02.123025 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:02.157066 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 899/1815] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:06:01 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:02.157066 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eed4a0-0c0d-4ca2-8279-eaa3da8b3669 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:02.214427 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f9187-7beb-4eec-936a-892b088318b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:02.215470 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f9187-7beb-4eec-936a-892b088318b5 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:02.215861 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f9187-7beb-4eec-936a-892b088318b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:02.216208 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f9187-7beb-4eec-936a-892b088318b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:02.234134 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f9187-7beb-4eec-936a-892b088318b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:02.240151 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f9187-7beb-4eec-936a-892b088318b5 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:02.263730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 917/1816] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:02.264686 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f9187-7beb-4eec-936a-892b088318b5 service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:02.269606 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eed4a0-0c0d-4ca2-8279-eaa3da8b3669 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:02.276626 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f9187-7beb-4eec-936a-892b088318b5 service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:02.280243 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7c38b-dc3f-4f06-8175-108e87be7686 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:02.281035 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7c38b-dc3f-4f06-8175-108e87be7686 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:02.281323 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7c38b-dc3f-4f06-8175-108e87be7686 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:02.281666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7c38b-dc3f-4f06-8175-108e87be7686 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:02.281948 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6bc94-0e1e-46ef-a8f9-706369d4e3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:02.282688 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6bc94-0e1e-46ef-a8f9-706369d4e3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:02.283049 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6bc94-0e1e-46ef-a8f9-706369d4e3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:02.283476 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6bc94-0e1e-46ef-a8f9-706369d4e3a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:02.284418 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6bc94-0e1e-46ef-a8f9-706369d4e3a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:02.286311 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6bc94-0e1e-46ef-a8f9-706369d4e3a1 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:02.301837 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 918/1817] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:02.307518 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6bc94-0e1e-46ef-a8f9-706369d4e3a1 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:02.327811 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6bc94-0e1e-46ef-a8f9-706369d4e3a1 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:02.337094 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dacd96-1911-465a-96aa-65e284112c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:02.338441 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dacd96-1911-465a-96aa-65e284112c34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:02.339671 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dacd96-1911-465a-96aa-65e284112c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:02.342520 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dacd96-1911-465a-96aa-65e284112c34 admin admin] PATH_INFO: `/v3/projects/cb3b074fded444a080215452627dd699/users/1341caee08c94a28bed02985443c42bb/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:02.423310 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dacd96-1911-465a-96aa-65e284112c34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb3b074fded444a080215452627dd699, user_id=1341caee08c94a28bed02985443c42bb, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:02.427501 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dacd96-1911-465a-96aa-65e284112c34 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:02.456696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7c38b-dc3f-4f06-8175-108e87be7686 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:02.458738 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7c38b-dc3f-4f06-8175-108e87be7686 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:02.460620 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 919/1818] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:02 2022] PUT /identity/v3/projects/cb3b074fded444a080215452627dd699/users/1341caee08c94a28bed02985443c42bb/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:02.464994 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dacd96-1911-465a-96aa-65e284112c34 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:02.504448 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 900/1819] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:02.650352 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dacd96-1911-465a-96aa-65e284112c34 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:02.676498 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632918c2-71a9-4804-b921-b8f13c88349d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:02.677490 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632918c2-71a9-4804-b921-b8f13c88349d admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:02.677974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632918c2-71a9-4804-b921-b8f13c88349d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:02.678449 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632918c2-71a9-4804-b921-b8f13c88349d admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:02.680364 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632918c2-71a9-4804-b921-b8f13c88349d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:02.682538 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632918c2-71a9-4804-b921-b8f13c88349d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:02.723088 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 920/1820] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:02.725527 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7c38b-dc3f-4f06-8175-108e87be7686 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:02.745491 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7c38b-dc3f-4f06-8175-108e87be7686 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:02.766600 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235cf56-e2fb-45df-afba-1b6f76219816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:02.786866 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235cf56-e2fb-45df-afba-1b6f76219816 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:02.787171 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235cf56-e2fb-45df-afba-1b6f76219816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:02.789142 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235cf56-e2fb-45df-afba-1b6f76219816 admin admin] PATH_INFO: `/v3/projects/cb3b074fded444a080215452627dd699/users/1341caee08c94a28bed02985443c42bb/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:02.793543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235cf56-e2fb-45df-afba-1b6f76219816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb3b074fded444a080215452627dd699, user_id=1341caee08c94a28bed02985443c42bb, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:02.801094 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235cf56-e2fb-45df-afba-1b6f76219816 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:02.827271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 901/1821] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:02 2022] PUT /identity/v3/projects/cb3b074fded444a080215452627dd699/users/1341caee08c94a28bed02985443c42bb/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:02.831167 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d95091-7528-4b57-8f3b-4cb7ef580c48 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:02.836104 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d95091-7528-4b57-8f3b-4cb7ef580c48 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:02.836989 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d95091-7528-4b57-8f3b-4cb7ef580c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:02.918575 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a2d95091-7528-4b57-8f3b-4cb7ef580c48 None None] MFA Rules not processed for user `1341caee08c94a28bed02985443c42bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:02.923480 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a2d95091-7528-4b57-8f3b-4cb7ef580c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:03.261089 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:03.276099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 921/1822] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 446 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:03.531991 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235cf56-e2fb-45df-afba-1b6f76219816 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:03.544985 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b235cf56-e2fb-45df-afba-1b6f76219816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:03.618769 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:03.692085 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235cf56-e2fb-45df-afba-1b6f76219816 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:03.697882 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a983108-31b7-4315-a546-8adb88e2fdee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:03.698468 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a983108-31b7-4315-a546-8adb88e2fdee service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:03.698744 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a983108-31b7-4315-a546-8adb88e2fdee service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:03.699062 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a983108-31b7-4315-a546-8adb88e2fdee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:03.720352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a983108-31b7-4315-a546-8adb88e2fdee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:03.721301 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a983108-31b7-4315-a546-8adb88e2fdee service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:03.734088 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 902/1823] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:03 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:04.274287 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d95091-7528-4b57-8f3b-4cb7ef580c48 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:04.366818 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d95091-7528-4b57-8f3b-4cb7ef580c48 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:04.372883 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd3a23-a648-40a4-beab-bcc286175721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:04.375562 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd3a23-a648-40a4-beab-bcc286175721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:04.376229 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd3a23-a648-40a4-beab-bcc286175721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:04.376750 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd3a23-a648-40a4-beab-bcc286175721 admin admin] PATH_INFO: `/v3/users/9fa2870c6d344c1ea0dfa10ae7fc80a8` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:04.379127 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd3a23-a648-40a4-beab-bcc286175721 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fa2870c6d344c1ea0dfa10ae7fc80a8)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:04.381773 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd3a23-a648-40a4-beab-bcc286175721 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:04.464950 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9dfd3a23-a648-40a4-beab-bcc286175721 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fa2870c6d344c1ea0dfa10ae7fc80a8'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:04.465946 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9dfd3a23-a648-40a4-beab-bcc286175721 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fa2870c6d344c1ea0dfa10ae7fc80a8'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:04.466727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9dfd3a23-a648-40a4-beab-bcc286175721 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fa2870c6d344c1ea0dfa10ae7fc80a8'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:04.477318 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9dfd3a23-a648-40a4-beab-bcc286175721 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fa2870c6d344c1ea0dfa10ae7fc80a8'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:04.492264 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9dfd3a23-a648-40a4-beab-bcc286175721 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fa2870c6d344c1ea0dfa10ae7fc80a8'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:04.507005 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 922/1824] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:06:04 2022] DELETE /identity/v3/users/9fa2870c6d344c1ea0dfa10ae7fc80a8 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:04.512326 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368721f1-1157-4bbe-a3c2-ac3799a61924 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:04.512629 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368721f1-1157-4bbe-a3c2-ac3799a61924 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:04.512919 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368721f1-1157-4bbe-a3c2-ac3799a61924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:04.535463 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-368721f1-1157-4bbe-a3c2-ac3799a61924 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:04.536672 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-368721f1-1157-4bbe-a3c2-ac3799a61924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:04.635011 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 903/1825] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:04.640370 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd3a23-a648-40a4-beab-bcc286175721 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:04.641506 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9dfd3a23-a648-40a4-beab-bcc286175721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:04.742664 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd3a23-a648-40a4-beab-bcc286175721 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:04.747883 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d9459-a548-4aa0-bd95-5e4fcde49223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:04.748626 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d9459-a548-4aa0-bd95-5e4fcde49223 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:04.749027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d9459-a548-4aa0-bd95-5e4fcde49223 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:04.750038 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d9459-a548-4aa0-bd95-5e4fcde49223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:04.768797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d9459-a548-4aa0-bd95-5e4fcde49223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:04.770960 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d9459-a548-4aa0-bd95-5e4fcde49223 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:04.795828 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 923/1826] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:05.073997 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368721f1-1157-4bbe-a3c2-ac3799a61924 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:05.075603 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-368721f1-1157-4bbe-a3c2-ac3799a61924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:05.091828 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368721f1-1157-4bbe-a3c2-ac3799a61924 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:05.098936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3faaf6-01ae-4ee5-bd11-36f713c920e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:05.100777 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3faaf6-01ae-4ee5-bd11-36f713c920e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:05.101993 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3faaf6-01ae-4ee5-bd11-36f713c920e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:05.102341 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3faaf6-01ae-4ee5-bd11-36f713c920e1 admin admin] PATH_INFO: `/v3/users/ec77f097d6dd4355b7f27600dd237d49` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:05.105568 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3faaf6-01ae-4ee5-bd11-36f713c920e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec77f097d6dd4355b7f27600dd237d49)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:05.109157 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3faaf6-01ae-4ee5-bd11-36f713c920e1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:05.175266 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ed3faaf6-01ae-4ee5-bd11-36f713c920e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec77f097d6dd4355b7f27600dd237d49'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:05.183152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ed3faaf6-01ae-4ee5-bd11-36f713c920e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec77f097d6dd4355b7f27600dd237d49'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:05.208738 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ed3faaf6-01ae-4ee5-bd11-36f713c920e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec77f097d6dd4355b7f27600dd237d49'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:05.210415 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ed3faaf6-01ae-4ee5-bd11-36f713c920e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec77f097d6dd4355b7f27600dd237d49'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:05.211249 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ed3faaf6-01ae-4ee5-bd11-36f713c920e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec77f097d6dd4355b7f27600dd237d49'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:05.234382 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 904/1827] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:06:05 2022] DELETE /identity/v3/users/ec77f097d6dd4355b7f27600dd237d49 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:06:05.239089 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f18b29-c139-4938-b19f-8fcbf6f840ae None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:05.239416 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f18b29-c139-4938-b19f-8fcbf6f840ae None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:05.239701 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f18b29-c139-4938-b19f-8fcbf6f840ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:05.250755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3faaf6-01ae-4ee5-bd11-36f713c920e1 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:05.252201 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ed3faaf6-01ae-4ee5-bd11-36f713c920e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:05.259164 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b5f18b29-c139-4938-b19f-8fcbf6f840ae None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:05.260478 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b5f18b29-c139-4938-b19f-8fcbf6f840ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:05.294338 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:05.326006 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:05.352751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3faaf6-01ae-4ee5-bd11-36f713c920e1 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:05.357863 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11558b4-cbbf-46e1-bcb4-c590fec33831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:05.359141 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11558b4-cbbf-46e1-bcb4-c590fec33831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:05.359524 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11558b4-cbbf-46e1-bcb4-c590fec33831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:05.359894 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11558b4-cbbf-46e1-bcb4-c590fec33831 admin admin] PATH_INFO: `/v3/projects/ac7472a3fcdb4c07a4dccee37d43aa36` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:05.361127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11558b4-cbbf-46e1-bcb4-c590fec33831 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac7472a3fcdb4c07a4dccee37d43aa36)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:05.361845 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 924/1828] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:05.365074 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11558b4-cbbf-46e1-bcb4-c590fec33831 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:05.372582 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f18b29-c139-4938-b19f-8fcbf6f840ae None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:05.374017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b5f18b29-c139-4938-b19f-8fcbf6f840ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:05.418205 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c11558b4-cbbf-46e1-bcb4-c590fec33831 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac7472a3fcdb4c07a4dccee37d43aa36', 'request_id': 'req-c11558b4-cbbf-46e1-bcb4-c590fec33831'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:05.427214 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c11558b4-cbbf-46e1-bcb4-c590fec33831 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac7472a3fcdb4c07a4dccee37d43aa36', 'request_id': 'req-c11558b4-cbbf-46e1-bcb4-c590fec33831'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:05.434102 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c11558b4-cbbf-46e1-bcb4-c590fec33831 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac7472a3fcdb4c07a4dccee37d43aa36', 'request_id': 'req-c11558b4-cbbf-46e1-bcb4-c590fec33831'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:05.435637 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f18b29-c139-4938-b19f-8fcbf6f840ae None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:05.448361 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c11558b4-cbbf-46e1-bcb4-c590fec33831 admin admin] The token cache is being invalidate because project ac7472a3fcdb4c07a4dccee37d43aa36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:06:05.449977 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c11558b4-cbbf-46e1-bcb4-c590fec33831 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:05.450299 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c11558b4-cbbf-46e1-bcb4-c590fec33831 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:05.452264 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 905/1829] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:06:05 2022] DELETE /identity/v3/projects/ac7472a3fcdb4c07a4dccee37d43aa36 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:06:05.456559 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11558b4-cbbf-46e1-bcb4-c590fec33831 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:05.457682 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c11558b4-cbbf-46e1-bcb4-c590fec33831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:05.507501 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e95a6b-af60-4126-8c73-5b9299130287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:05.508159 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e95a6b-af60-4126-8c73-5b9299130287 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:05.508476 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e95a6b-af60-4126-8c73-5b9299130287 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:05.508757 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e95a6b-af60-4126-8c73-5b9299130287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:05.510575 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e6e95a6b-af60-4126-8c73-5b9299130287 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:05.533003 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11558b4-cbbf-46e1-bcb4-c590fec33831 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:05.537698 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede14ce-4c98-444a-9123-b0a580acad26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:05.538578 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede14ce-4c98-444a-9123-b0a580acad26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:05.538863 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede14ce-4c98-444a-9123-b0a580acad26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:05.539144 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede14ce-4c98-444a-9123-b0a580acad26 admin admin] PATH_INFO: `/v3/users/1341caee08c94a28bed02985443c42bb` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:05.540488 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede14ce-4c98-444a-9123-b0a580acad26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1341caee08c94a28bed02985443c42bb)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:05.542472 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede14ce-4c98-444a-9123-b0a580acad26 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:05.585264 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e95a6b-af60-4126-8c73-5b9299130287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:05.586701 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e95a6b-af60-4126-8c73-5b9299130287 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:05.590280 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-dede14ce-4c98-444a-9123-b0a580acad26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1341caee08c94a28bed02985443c42bb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:05.597053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-dede14ce-4c98-444a-9123-b0a580acad26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1341caee08c94a28bed02985443c42bb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:05.598260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 925/1830] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 15:06:05.608048 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:05.610302 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-dede14ce-4c98-444a-9123-b0a580acad26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1341caee08c94a28bed02985443c42bb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:05.611470 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-dede14ce-4c98-444a-9123-b0a580acad26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1341caee08c94a28bed02985443c42bb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:05.612366 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-dede14ce-4c98-444a-9123-b0a580acad26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1341caee08c94a28bed02985443c42bb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:05.630849 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 906/1831] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:06:05 2022] DELETE /identity/v3/users/1341caee08c94a28bed02985443c42bb => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:06:05.907469 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e95a6b-af60-4126-8c73-5b9299130287 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:05.909220 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e6e95a6b-af60-4126-8c73-5b9299130287 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:05.939575 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede14ce-4c98-444a-9123-b0a580acad26 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:05.941263 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-dede14ce-4c98-444a-9123-b0a580acad26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:05.960782 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e95a6b-af60-4126-8c73-5b9299130287 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:06.050266 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:06.099963 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede14ce-4c98-444a-9123-b0a580acad26 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:06.105748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10c8a5-da8f-47f1-911a-62b10efd1611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:06.107604 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10c8a5-da8f-47f1-911a-62b10efd1611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:06.107999 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10c8a5-da8f-47f1-911a-62b10efd1611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:06.109319 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10c8a5-da8f-47f1-911a-62b10efd1611 admin admin] PATH_INFO: `/v3/users/6a2522811e66499ab27efd13f2a3f05a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:06.120370 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a67f0a-bf35-4de7-837e-6712b1f22d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:06.121239 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10c8a5-da8f-47f1-911a-62b10efd1611 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a2522811e66499ab27efd13f2a3f05a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:06.123042 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a67f0a-bf35-4de7-837e-6712b1f22d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:06.123411 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10c8a5-da8f-47f1-911a-62b10efd1611 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:06.124620 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a67f0a-bf35-4de7-837e-6712b1f22d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:06.125208 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a67f0a-bf35-4de7-837e-6712b1f22d73 admin admin] PATH_INFO: `/v3/projects/582f0c3defda4d828f48aa9aab57308e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:06.128753 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a67f0a-bf35-4de7-837e-6712b1f22d73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=582f0c3defda4d828f48aa9aab57308e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:06.135356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a67f0a-bf35-4de7-837e-6712b1f22d73 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:06.198073 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c1a67f0a-bf35-4de7-837e-6712b1f22d73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '582f0c3defda4d828f48aa9aab57308e', 'request_id': 'req-c1a67f0a-bf35-4de7-837e-6712b1f22d73'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:06.200510 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ec10c8a5-da8f-47f1-911a-62b10efd1611 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a2522811e66499ab27efd13f2a3f05a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:06.204041 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c1a67f0a-bf35-4de7-837e-6712b1f22d73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '582f0c3defda4d828f48aa9aab57308e', 'request_id': 'req-c1a67f0a-bf35-4de7-837e-6712b1f22d73'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:06.214338 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c1a67f0a-bf35-4de7-837e-6712b1f22d73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '582f0c3defda4d828f48aa9aab57308e', 'request_id': 'req-c1a67f0a-bf35-4de7-837e-6712b1f22d73'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:06.227805 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ec10c8a5-da8f-47f1-911a-62b10efd1611 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a2522811e66499ab27efd13f2a3f05a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:06.249724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c1a67f0a-bf35-4de7-837e-6712b1f22d73 admin admin] The token cache is being invalidate because project 582f0c3defda4d828f48aa9aab57308e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:06:06.250110 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c1a67f0a-bf35-4de7-837e-6712b1f22d73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:06.252029 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c1a67f0a-bf35-4de7-837e-6712b1f22d73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:06.257185 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 926/1832] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:06:05 2022] DELETE /identity/v3/projects/582f0c3defda4d828f48aa9aab57308e => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:06.257185 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a67f0a-bf35-4de7-837e-6712b1f22d73 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:06.261138 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ec10c8a5-da8f-47f1-911a-62b10efd1611 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a2522811e66499ab27efd13f2a3f05a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:06.262237 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ec10c8a5-da8f-47f1-911a-62b10efd1611 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a2522811e66499ab27efd13f2a3f05a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:06.262728 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c1a67f0a-bf35-4de7-837e-6712b1f22d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:06.262851 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ec10c8a5-da8f-47f1-911a-62b10efd1611 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a2522811e66499ab27efd13f2a3f05a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:06.295725 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 907/1833] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:06:05 2022] DELETE /identity/v3/users/6a2522811e66499ab27efd13f2a3f05a => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:06:06.296927 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10c8a5-da8f-47f1-911a-62b10efd1611 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:06.298588 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ec10c8a5-da8f-47f1-911a-62b10efd1611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:06.376910 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a67f0a-bf35-4de7-837e-6712b1f22d73 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:06.403945 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10c8a5-da8f-47f1-911a-62b10efd1611 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:06.411636 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47782c5-9a9b-43e4-8f17-ad6acab16cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:06.413138 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47782c5-9a9b-43e4-8f17-ad6acab16cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:06.413457 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47782c5-9a9b-43e4-8f17-ad6acab16cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:06.413803 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47782c5-9a9b-43e4-8f17-ad6acab16cd4 admin admin] PATH_INFO: `/v3/users/5353802df2684c909d9edf257fbc3bfa` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:06.415083 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47782c5-9a9b-43e4-8f17-ad6acab16cd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5353802df2684c909d9edf257fbc3bfa)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:06.417877 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47782c5-9a9b-43e4-8f17-ad6acab16cd4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:06.424857 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:06.460921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a5088-8421-429b-89c9-ac39ddfa1991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:06.461803 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a5088-8421-429b-89c9-ac39ddfa1991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:06.462355 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a5088-8421-429b-89c9-ac39ddfa1991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:06.462355 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a5088-8421-429b-89c9-ac39ddfa1991 admin admin] PATH_INFO: `/v3/projects/cb3b074fded444a080215452627dd699` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:06.463594 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a5088-8421-429b-89c9-ac39ddfa1991 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb3b074fded444a080215452627dd699)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:06.465693 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a5088-8421-429b-89c9-ac39ddfa1991 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:06.472627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:06.479789 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f47782c5-9a9b-43e4-8f17-ad6acab16cd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5353802df2684c909d9edf257fbc3bfa'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:06.488716 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f47782c5-9a9b-43e4-8f17-ad6acab16cd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5353802df2684c909d9edf257fbc3bfa'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:06.506072 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f47782c5-9a9b-43e4-8f17-ad6acab16cd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5353802df2684c909d9edf257fbc3bfa'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:06.506932 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f47782c5-9a9b-43e4-8f17-ad6acab16cd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5353802df2684c909d9edf257fbc3bfa'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:06.507625 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f47782c5-9a9b-43e4-8f17-ad6acab16cd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5353802df2684c909d9edf257fbc3bfa'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:06.567254 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 908/1834] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:06:06 2022] DELETE /identity/v3/users/5353802df2684c909d9edf257fbc3bfa => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:06.567873 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c27a5088-8421-429b-89c9-ac39ddfa1991 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb3b074fded444a080215452627dd699', 'request_id': 'req-c27a5088-8421-429b-89c9-ac39ddfa1991'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:06.567954 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26444d-cbd2-4f16-abdc-95d61cbb3a7d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:06.568593 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26444d-cbd2-4f16-abdc-95d61cbb3a7d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:06.568929 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26444d-cbd2-4f16-abdc-95d61cbb3a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:06.581748 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c27a5088-8421-429b-89c9-ac39ddfa1991 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb3b074fded444a080215452627dd699', 'request_id': 'req-c27a5088-8421-429b-89c9-ac39ddfa1991'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:06.593528 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c27a5088-8421-429b-89c9-ac39ddfa1991 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb3b074fded444a080215452627dd699', 'request_id': 'req-c27a5088-8421-429b-89c9-ac39ddfa1991'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:06.626563 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c27a5088-8421-429b-89c9-ac39ddfa1991 admin admin] The token cache is being invalidate because project cb3b074fded444a080215452627dd699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:06:06.627257 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c27a5088-8421-429b-89c9-ac39ddfa1991 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:06.628128 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c27a5088-8421-429b-89c9-ac39ddfa1991 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:06.630801 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 927/1835] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:06:06 2022] DELETE /identity/v3/projects/cb3b074fded444a080215452627dd699 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:06.635762 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e0f09-b19a-4cc6-8821-514304c03875 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:06.636302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e0f09-b19a-4cc6-8821-514304c03875 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:06.636808 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e0f09-b19a-4cc6-8821-514304c03875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:06.641614 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9d26444d-cbd2-4f16-abdc-95d61cbb3a7d None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:06.645331 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9d26444d-cbd2-4f16-abdc-95d61cbb3a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:06.666048 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-af6e0f09-b19a-4cc6-8821-514304c03875 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:06.667438 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-af6e0f09-b19a-4cc6-8821-514304c03875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:06.739533 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 909/1836] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:06.773978 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 928/1837] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:06.780749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26444d-cbd2-4f16-abdc-95d61cbb3a7d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:06.783584 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9d26444d-cbd2-4f16-abdc-95d61cbb3a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:06.788716 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869778b-9b59-4aef-ba2f-6563126d5ea6 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:06.789280 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869778b-9b59-4aef-ba2f-6563126d5ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:06.791217 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869778b-9b59-4aef-ba2f-6563126d5ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:06.850357 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e869778b-9b59-4aef-ba2f-6563126d5ea6 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:06.856744 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e869778b-9b59-4aef-ba2f-6563126d5ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:06.879675 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 929/1838] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:06.887116 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869778b-9b59-4aef-ba2f-6563126d5ea6 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:06.901402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869778b-9b59-4aef-ba2f-6563126d5ea6 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:06.909429 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b540ff-f0aa-4951-aae2-412bf85053ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:06.910263 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b540ff-f0aa-4951-aae2-412bf85053ca admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:06.910557 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b540ff-f0aa-4951-aae2-412bf85053ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:06.910908 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b540ff-f0aa-4951-aae2-412bf85053ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:06.912067 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b540ff-f0aa-4951-aae2-412bf85053ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:06:06.912372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b540ff-f0aa-4951-aae2-412bf85053ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:06.915148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b540ff-f0aa-4951-aae2-412bf85053ca admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:06.934541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 930/1839] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:06:06.938992 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b540ff-f0aa-4951-aae2-412bf85053ca admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:06.955054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26444d-cbd2-4f16-abdc-95d61cbb3a7d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:06.958511 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b540ff-f0aa-4951-aae2-412bf85053ca admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:06.963366 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535a169-7f96-4f17-9f8e-3d2bb35488b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:06.964185 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535a169-7f96-4f17-9f8e-3d2bb35488b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:06.964483 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535a169-7f96-4f17-9f8e-3d2bb35488b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:06.964766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535a169-7f96-4f17-9f8e-3d2bb35488b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:06.973289 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127998d-eea7-40eb-8bf7-fb323544886a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:06.973967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127998d-eea7-40eb-8bf7-fb323544886a admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:06.974884 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127998d-eea7-40eb-8bf7-fb323544886a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:06.977642 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127998d-eea7-40eb-8bf7-fb323544886a admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:06.978376 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127998d-eea7-40eb-8bf7-fb323544886a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:06.984389 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127998d-eea7-40eb-8bf7-fb323544886a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:06.993294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535a169-7f96-4f17-9f8e-3d2bb35488b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:06.998771 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535a169-7f96-4f17-9f8e-3d2bb35488b5 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:07.023703 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 910/1840] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:07.105263 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 931/1841] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:06:06 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:07.109198 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535a169-7f96-4f17-9f8e-3d2bb35488b5 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:07.129049 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535a169-7f96-4f17-9f8e-3d2bb35488b5 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:07.199402 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:07.277715 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2edcc-9d4e-4390-a518-e5c039f9f3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:07.278429 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2edcc-9d4e-4390-a518-e5c039f9f3e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:07.279911 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2edcc-9d4e-4390-a518-e5c039f9f3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:07.280015 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2edcc-9d4e-4390-a518-e5c039f9f3e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:07.281583 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2edcc-9d4e-4390-a518-e5c039f9f3e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:07.287628 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2edcc-9d4e-4390-a518-e5c039f9f3e5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:07.329799 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 911/1842] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:06:07 2022] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:07.331636 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2edcc-9d4e-4390-a518-e5c039f9f3e5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:07.331757 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127998d-eea7-40eb-8bf7-fb323544886a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:07.333735 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1127998d-eea7-40eb-8bf7-fb323544886a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:07.344242 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2edcc-9d4e-4390-a518-e5c039f9f3e5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:07.348892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127998d-eea7-40eb-8bf7-fb323544886a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:07.351842 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f801e8-bf9c-47c5-853c-b434219f6e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:07.352812 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f801e8-bf9c-47c5-853c-b434219f6e3a admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:07.353043 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f801e8-bf9c-47c5-853c-b434219f6e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:07.353424 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f801e8-bf9c-47c5-853c-b434219f6e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:07.354266 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f801e8-bf9c-47c5-853c-b434219f6e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:07.354752 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafa981-08e8-42a0-941e-4f74d2fd0c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:07.356624 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafa981-08e8-42a0-941e-4f74d2fd0c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:07.356758 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f801e8-bf9c-47c5-853c-b434219f6e3a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:07.356849 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafa981-08e8-42a0-941e-4f74d2fd0c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:07.356849 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafa981-08e8-42a0-941e-4f74d2fd0c9e admin admin] PATH_INFO: `/v3/projects/fd0de2ad8f624748bd6950291d54acfa` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:07.358102 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fafa981-08e8-42a0-941e-4f74d2fd0c9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd0de2ad8f624748bd6950291d54acfa)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:07.360111 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fafa981-08e8-42a0-941e-4f74d2fd0c9e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:07.372728 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 912/1843] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:07.373785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f801e8-bf9c-47c5-853c-b434219f6e3a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:07.386737 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f801e8-bf9c-47c5-853c-b434219f6e3a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:07.394250 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0b1c9-e189-4443-b874-1069c7955cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:07.395375 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0b1c9-e189-4443-b874-1069c7955cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:07.395858 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0b1c9-e189-4443-b874-1069c7955cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:07.396144 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0b1c9-e189-4443-b874-1069c7955cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:07.397831 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0b1c9-e189-4443-b874-1069c7955cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:07.399775 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0b1c9-e189-4443-b874-1069c7955cb1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:07.419050 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 913/1844] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:07 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:07.420282 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0b1c9-e189-4443-b874-1069c7955cb1 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:07.433077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0b1c9-e189-4443-b874-1069c7955cb1 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:07.443135 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-2fafa981-08e8-42a0-941e-4f74d2fd0c9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd0de2ad8f624748bd6950291d54acfa', 'request_id': 'req-2fafa981-08e8-42a0-941e-4f74d2fd0c9e'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:07.449715 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:07.450683 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-2fafa981-08e8-42a0-941e-4f74d2fd0c9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd0de2ad8f624748bd6950291d54acfa', 'request_id': 'req-2fafa981-08e8-42a0-941e-4f74d2fd0c9e'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:07.458838 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-2fafa981-08e8-42a0-941e-4f74d2fd0c9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd0de2ad8f624748bd6950291d54acfa', 'request_id': 'req-2fafa981-08e8-42a0-941e-4f74d2fd0c9e'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:07.485071 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-2fafa981-08e8-42a0-941e-4f74d2fd0c9e admin admin] The token cache is being invalidate because project fd0de2ad8f624748bd6950291d54acfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:06:07.485656 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-2fafa981-08e8-42a0-941e-4f74d2fd0c9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:07.487091 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-2fafa981-08e8-42a0-941e-4f74d2fd0c9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:07.497899 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 932/1845] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:06:07 2022] DELETE /identity/v3/projects/fd0de2ad8f624748bd6950291d54acfa => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:07.499603 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89828175-5522-47cd-9217-e601daf6b628 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:07.500418 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89828175-5522-47cd-9217-e601daf6b628 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:07.500418 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89828175-5522-47cd-9217-e601daf6b628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:07.521715 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-89828175-5522-47cd-9217-e601daf6b628 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:07.523882 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-89828175-5522-47cd-9217-e601daf6b628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:07.546059 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a74d31-7ab6-455a-a474-d1575d4bde48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:07.548443 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a74d31-7ab6-455a-a474-d1575d4bde48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:07.549801 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a74d31-7ab6-455a-a474-d1575d4bde48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:07.550239 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a74d31-7ab6-455a-a474-d1575d4bde48 admin admin] PATH_INFO: `/v3/projects/09934739fcba45c5b073533272405739/users/d462c697dbf34eec9397a8b33ea24e73/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:07.576366 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a74d31-7ab6-455a-a474-d1575d4bde48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09934739fcba45c5b073533272405739, user_id=d462c697dbf34eec9397a8b33ea24e73, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:07.579838 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a74d31-7ab6-455a-a474-d1575d4bde48 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:07.616540 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 914/1846] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:07 2022] PUT /identity/v3/projects/09934739fcba45c5b073533272405739/users/d462c697dbf34eec9397a8b33ea24e73/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:06:07.628652 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8436f2f-3c2a-4ffc-bc83-d4f67b014830 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:07.629107 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8436f2f-3c2a-4ffc-bc83-d4f67b014830 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:07.630633 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8436f2f-3c2a-4ffc-bc83-d4f67b014830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:07.680782 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e8436f2f-3c2a-4ffc-bc83-d4f67b014830 None None] MFA Rules not processed for user `d462c697dbf34eec9397a8b33ea24e73`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:07.680782 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e8436f2f-3c2a-4ffc-bc83-d4f67b014830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:07.684940 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 933/1847] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:07.686811 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd776c-d497-42ad-840a-ad39f1b1e6b9 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:07.687334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd776c-d497-42ad-840a-ad39f1b1e6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:07.687831 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd776c-d497-42ad-840a-ad39f1b1e6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:07.712193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ffcd776c-d497-42ad-840a-ad39f1b1e6b9 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:07.714328 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ffcd776c-d497-42ad-840a-ad39f1b1e6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:07.777146 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 915/1848] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:06:07.788611 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8436f2f-3c2a-4ffc-bc83-d4f67b014830 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:07.792166 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e8436f2f-3c2a-4ffc-bc83-d4f67b014830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:07.821490 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:07.826356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 934/1849] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:07.830314 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd776c-d497-42ad-840a-ad39f1b1e6b9 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:07.849511 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd776c-d497-42ad-840a-ad39f1b1e6b9 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:07.855749 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a776e3a-2c99-4304-a941-a55a6748ac25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:07.856984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a776e3a-2c99-4304-a941-a55a6748ac25 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:07.857342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a776e3a-2c99-4304-a941-a55a6748ac25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:07.857968 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a776e3a-2c99-4304-a941-a55a6748ac25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:07.858911 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a776e3a-2c99-4304-a941-a55a6748ac25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:06:07.859257 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a776e3a-2c99-4304-a941-a55a6748ac25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:07.862076 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a776e3a-2c99-4304-a941-a55a6748ac25 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:07.880530 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 935/1850] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:06:07.881948 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a776e3a-2c99-4304-a941-a55a6748ac25 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:07.883930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6a776e3a-2c99-4304-a941-a55a6748ac25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:07.903227 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a776e3a-2c99-4304-a941-a55a6748ac25 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:07.919076 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df74560-7a38-417c-b2b4-020a6951780a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:07.919076 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df74560-7a38-417c-b2b4-020a6951780a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:07.919076 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df74560-7a38-417c-b2b4-020a6951780a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:07.919076 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df74560-7a38-417c-b2b4-020a6951780a admin admin] PATH_INFO: `/v3/projects/720cf9e8a4d043dfbd2e93cfbbb0eef2` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:07.920035 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df74560-7a38-417c-b2b4-020a6951780a admin admin] RBAC: Authorizing `identity:delete_project(project_id=720cf9e8a4d043dfbd2e93cfbbb0eef2)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:07.920035 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df74560-7a38-417c-b2b4-020a6951780a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:07.945534 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8436f2f-3c2a-4ffc-bc83-d4f67b014830 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:07.952490 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ecc72-fe0c-4253-a204-777fff01c11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:07.953449 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ecc72-fe0c-4253-a204-777fff01c11d admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:07.955410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ecc72-fe0c-4253-a204-777fff01c11d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:07.955410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ecc72-fe0c-4253-a204-777fff01c11d admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:07.956395 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ecc72-fe0c-4253-a204-777fff01c11d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:07.960557 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ecc72-fe0c-4253-a204-777fff01c11d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:07.999520 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3df74560-7a38-417c-b2b4-020a6951780a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '720cf9e8a4d043dfbd2e93cfbbb0eef2', 'request_id': 'req-3df74560-7a38-417c-b2b4-020a6951780a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:08.008776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3df74560-7a38-417c-b2b4-020a6951780a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '720cf9e8a4d043dfbd2e93cfbbb0eef2', 'request_id': 'req-3df74560-7a38-417c-b2b4-020a6951780a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:08.011456 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:08.026265 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 916/1851] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:06:07 2022] POST /identity/v3/projects => generated 381 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:08.026265 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ecc72-fe0c-4253-a204-777fff01c11d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:08.028713 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3df74560-7a38-417c-b2b4-020a6951780a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '720cf9e8a4d043dfbd2e93cfbbb0eef2', 'request_id': 'req-3df74560-7a38-417c-b2b4-020a6951780a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:08.058528 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3df74560-7a38-417c-b2b4-020a6951780a admin admin] The token cache is being invalidate because project 720cf9e8a4d043dfbd2e93cfbbb0eef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:06:08.058830 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3df74560-7a38-417c-b2b4-020a6951780a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:08.059827 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-3df74560-7a38-417c-b2b4-020a6951780a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:08.061794 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 936/1852] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:06:07 2022] DELETE /identity/v3/projects/720cf9e8a4d043dfbd2e93cfbbb0eef2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:08.062721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df74560-7a38-417c-b2b4-020a6951780a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:08.064142 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3df74560-7a38-417c-b2b4-020a6951780a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:08.176575 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ecc72-fe0c-4253-a204-777fff01c11d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:08.188723 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35012fa3-fd1e-494a-82b9-9379715d6ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:08.189420 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35012fa3-fd1e-494a-82b9-9379715d6ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:08.189920 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35012fa3-fd1e-494a-82b9-9379715d6ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:08.190027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35012fa3-fd1e-494a-82b9-9379715d6ca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:08.190795 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35012fa3-fd1e-494a-82b9-9379715d6ca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:08.192811 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35012fa3-fd1e-494a-82b9-9379715d6ca5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:08.221605 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df74560-7a38-417c-b2b4-020a6951780a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:08.228359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a2037-6625-4c28-9746-06c098be9a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:08.229136 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a2037-6625-4c28-9746-06c098be9a4c admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:08.229677 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a2037-6625-4c28-9746-06c098be9a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:08.230051 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a2037-6625-4c28-9746-06c098be9a4c admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:08.231028 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a2037-6625-4c28-9746-06c098be9a4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:08.233567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a2037-6625-4c28-9746-06c098be9a4c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:08.249126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 917/1853] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:06:08 2022] POST /identity/v3/projects => generated 385 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:08.252288 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35012fa3-fd1e-494a-82b9-9379715d6ca5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:08.254813 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-35012fa3-fd1e-494a-82b9-9379715d6ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:08.276800 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 937/1854] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:06:08 2022] POST /identity/v3/users => generated 297 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:08.277727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a2037-6625-4c28-9746-06c098be9a4c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:08.287437 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1e7a2037-6625-4c28-9746-06c098be9a4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:08.325242 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a2037-6625-4c28-9746-06c098be9a4c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:08.368338 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35012fa3-fd1e-494a-82b9-9379715d6ca5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:08.383218 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb20547-92a7-4efc-b634-b466aa249753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:08.384055 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb20547-92a7-4efc-b634-b466aa249753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:08.384346 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb20547-92a7-4efc-b634-b466aa249753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:08.384628 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb20547-92a7-4efc-b634-b466aa249753 admin admin] PATH_INFO: `/v3/users/5e253064394d4088b226f2741c45f885` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:08.387806 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb20547-92a7-4efc-b634-b466aa249753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e253064394d4088b226f2741c45f885)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:08.389778 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb20547-92a7-4efc-b634-b466aa249753 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:08.431858 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d6372-3c5b-4ba9-b674-82ae35f0de99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:08.433545 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d6372-3c5b-4ba9-b674-82ae35f0de99 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:08.433810 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d6372-3c5b-4ba9-b674-82ae35f0de99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:08.434089 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d6372-3c5b-4ba9-b674-82ae35f0de99 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:08.434188 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:08.437258 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d6372-3c5b-4ba9-b674-82ae35f0de99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:08.443279 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d6372-3c5b-4ba9-b674-82ae35f0de99 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:08.472740 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 938/1855] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:06:08 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:08.476586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d6372-3c5b-4ba9-b674-82ae35f0de99 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:08.486835 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bbb20547-92a7-4efc-b634-b466aa249753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e253064394d4088b226f2741c45f885'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:08.489593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d6372-3c5b-4ba9-b674-82ae35f0de99 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:08.499424 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ae8d4-d650-44b0-bb49-e557106fad6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:08.500504 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ae8d4-d650-44b0-bb49-e557106fad6c admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:08.500968 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ae8d4-d650-44b0-bb49-e557106fad6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:08.501308 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ae8d4-d650-44b0-bb49-e557106fad6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:08.503399 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ae8d4-d650-44b0-bb49-e557106fad6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:08.503546 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bbb20547-92a7-4efc-b634-b466aa249753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e253064394d4088b226f2741c45f885'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:08.504734 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ae8d4-d650-44b0-bb49-e557106fad6c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:08.519166 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 939/1856] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:08.520000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ae8d4-d650-44b0-bb49-e557106fad6c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:08.528628 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bbb20547-92a7-4efc-b634-b466aa249753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e253064394d4088b226f2741c45f885'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:08.529402 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bbb20547-92a7-4efc-b634-b466aa249753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e253064394d4088b226f2741c45f885'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:08.530125 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bbb20547-92a7-4efc-b634-b466aa249753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e253064394d4088b226f2741c45f885'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:08.538909 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ae8d4-d650-44b0-bb49-e557106fad6c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:08.547930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3a916-a36e-4824-bcd9-fd96b1b801f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:08.549414 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3a916-a36e-4824-bcd9-fd96b1b801f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:08.549777 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3a916-a36e-4824-bcd9-fd96b1b801f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:08.550132 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3a916-a36e-4824-bcd9-fd96b1b801f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:08.551046 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3a916-a36e-4824-bcd9-fd96b1b801f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:08.572450 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 918/1857] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:06:08 2022] DELETE /identity/v3/users/5e253064394d4088b226f2741c45f885 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:08.574167 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3a916-a36e-4824-bcd9-fd96b1b801f9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:08.574357 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb20547-92a7-4efc-b634-b466aa249753 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:08.578663 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bbb20547-92a7-4efc-b634-b466aa249753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:08.624191 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 940/1858] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:08.625418 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3a916-a36e-4824-bcd9-fd96b1b801f9 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:08.627556 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e8f3a916-a36e-4824-bcd9-fd96b1b801f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:08.642619 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3a916-a36e-4824-bcd9-fd96b1b801f9 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:08.716679 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:08.749691 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb20547-92a7-4efc-b634-b466aa249753 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:08.757435 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb7034-4fd0-4d14-b9e1-f8b291ccc739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:08.757771 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af0705-663e-4c7f-aaf9-563f2004742e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:08.758750 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af0705-663e-4c7f-aaf9-563f2004742e admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:08.759021 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb7034-4fd0-4d14-b9e1-f8b291ccc739 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:08.759166 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af0705-663e-4c7f-aaf9-563f2004742e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:08.759456 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb7034-4fd0-4d14-b9e1-f8b291ccc739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:08.759555 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af0705-663e-4c7f-aaf9-563f2004742e admin admin] PATH_INFO: `/v3/projects/652440f8df89433cb37decc0ae078b82/users/e5537aa5470a40dfa782a2b7f12d84c3/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:08.759738 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb7034-4fd0-4d14-b9e1-f8b291ccc739 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:08.760477 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb7034-4fd0-4d14-b9e1-f8b291ccc739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:08.762258 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb7034-4fd0-4d14-b9e1-f8b291ccc739 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:08.779388 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 941/1859] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:08.783146 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb7034-4fd0-4d14-b9e1-f8b291ccc739 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:08.786125 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af0705-663e-4c7f-aaf9-563f2004742e admin admin] RBAC: Authorizing `identity:create_grant(project_id=652440f8df89433cb37decc0ae078b82, user_id=e5537aa5470a40dfa782a2b7f12d84c3, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:08.790404 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af0705-663e-4c7f-aaf9-563f2004742e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:08.796481 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb7034-4fd0-4d14-b9e1-f8b291ccc739 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:08.801871 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdfa36-9861-4e34-86d5-fd8ad5c528ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:08.803369 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdfa36-9861-4e34-86d5-fd8ad5c528ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:08.807881 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdfa36-9861-4e34-86d5-fd8ad5c528ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:08.808221 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdfa36-9861-4e34-86d5-fd8ad5c528ae admin admin] PATH_INFO: `/v3/projects/3c20d703e5174e118bf2e95ea1586d3d/users/cea36dd47f9945f4a86500324c6666f9/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:08.828122 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 919/1860] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:08 2022] PUT /identity/v3/projects/652440f8df89433cb37decc0ae078b82/users/e5537aa5470a40dfa782a2b7f12d84c3/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:08.832182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdfa36-9861-4e34-86d5-fd8ad5c528ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c20d703e5174e118bf2e95ea1586d3d, user_id=cea36dd47f9945f4a86500324c6666f9, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:08.832672 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af0705-663e-4c7f-aaf9-563f2004742e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:08.835930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdfa36-9861-4e34-86d5-fd8ad5c528ae admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:08.866768 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 942/1861] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:08 2022] PUT /identity/v3/projects/3c20d703e5174e118bf2e95ea1586d3d/users/cea36dd47f9945f4a86500324c6666f9/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:06:08.886641 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d6aa0-7326-4039-b501-fb27d57076a2 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:08.888822 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d6aa0-7326-4039-b501-fb27d57076a2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:08.890748 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d6aa0-7326-4039-b501-fb27d57076a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:09.010808 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-441d6aa0-7326-4039-b501-fb27d57076a2 None None] MFA Rules not processed for user `cea36dd47f9945f4a86500324c6666f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:09.012105 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-441d6aa0-7326-4039-b501-fb27d57076a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:09.013430 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af0705-663e-4c7f-aaf9-563f2004742e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:09.050614 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:09.107561 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44f008-3da5-4bec-9ce4-e8ba3ef95e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:09.108486 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44f008-3da5-4bec-9ce4-e8ba3ef95e3b admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:09.108904 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44f008-3da5-4bec-9ce4-e8ba3ef95e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:09.109274 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44f008-3da5-4bec-9ce4-e8ba3ef95e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:09.110541 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44f008-3da5-4bec-9ce4-e8ba3ef95e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:09.112964 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44f008-3da5-4bec-9ce4-e8ba3ef95e3b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:09.153175 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 920/1862] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 15:06:09.154846 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44f008-3da5-4bec-9ce4-e8ba3ef95e3b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:09.157546 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-da44f008-3da5-4bec-9ce4-e8ba3ef95e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:09.174501 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44f008-3da5-4bec-9ce4-e8ba3ef95e3b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:09.182921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf0777-0d85-4c5b-9fbd-f12011da9c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:09.184007 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf0777-0d85-4c5b-9fbd-f12011da9c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:09.185602 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf0777-0d85-4c5b-9fbd-f12011da9c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:09.185602 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf0777-0d85-4c5b-9fbd-f12011da9c97 admin admin] PATH_INFO: `/v3/projects/46b2774b92a4423ebc86470f8bc222e8` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:09.187010 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf0777-0d85-4c5b-9fbd-f12011da9c97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46b2774b92a4423ebc86470f8bc222e8)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:09.189895 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 943/1863] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:09.190906 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d6aa0-7326-4039-b501-fb27d57076a2 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:09.191436 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf0777-0d85-4c5b-9fbd-f12011da9c97 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:09.211927 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d6aa0-7326-4039-b501-fb27d57076a2 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:09.217601 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9685f23-cc01-4e5b-8b14-f839a1edf1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:09.218617 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9685f23-cc01-4e5b-8b14-f839a1edf1a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:09.218960 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9685f23-cc01-4e5b-8b14-f839a1edf1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:09.219372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9685f23-cc01-4e5b-8b14-f839a1edf1a9 admin admin] PATH_INFO: `/v3/projects/652440f8df89433cb37decc0ae078b82/users/e5537aa5470a40dfa782a2b7f12d84c3/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:09.223229 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9685f23-cc01-4e5b-8b14-f839a1edf1a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=652440f8df89433cb37decc0ae078b82, user_id=e5537aa5470a40dfa782a2b7f12d84c3, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:09.229600 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9685f23-cc01-4e5b-8b14-f839a1edf1a9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:09.249718 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 944/1864] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:09 2022] PUT /identity/v3/projects/652440f8df89433cb37decc0ae078b82/users/e5537aa5470a40dfa782a2b7f12d84c3/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:09.251086 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9685f23-cc01-4e5b-8b14-f839a1edf1a9 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:09.319802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-68cf0777-0d85-4c5b-9fbd-f12011da9c97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46b2774b92a4423ebc86470f8bc222e8', 'request_id': 'req-68cf0777-0d85-4c5b-9fbd-f12011da9c97'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:09.338966 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-68cf0777-0d85-4c5b-9fbd-f12011da9c97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46b2774b92a4423ebc86470f8bc222e8', 'request_id': 'req-68cf0777-0d85-4c5b-9fbd-f12011da9c97'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:09.355977 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-68cf0777-0d85-4c5b-9fbd-f12011da9c97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46b2774b92a4423ebc86470f8bc222e8', 'request_id': 'req-68cf0777-0d85-4c5b-9fbd-f12011da9c97'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:09.369001 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-68cf0777-0d85-4c5b-9fbd-f12011da9c97 admin admin] The token cache is being invalidate because project 46b2774b92a4423ebc86470f8bc222e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:06:09.369299 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-68cf0777-0d85-4c5b-9fbd-f12011da9c97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:09.372522 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-68cf0777-0d85-4c5b-9fbd-f12011da9c97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:09.392837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 921/1865] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:06:09 2022] DELETE /identity/v3/projects/46b2774b92a4423ebc86470f8bc222e8 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:09.392837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31bb8e-9d97-430c-99fb-fd5e3d588041 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:09.392837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31bb8e-9d97-430c-99fb-fd5e3d588041 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:09.392837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31bb8e-9d97-430c-99fb-fd5e3d588041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:09.413313 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9685f23-cc01-4e5b-8b14-f839a1edf1a9 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:09.445345 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ba31bb8e-9d97-430c-99fb-fd5e3d588041 None None] MFA Rules not processed for user `e5537aa5470a40dfa782a2b7f12d84c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:09.446576 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ba31bb8e-9d97-430c-99fb-fd5e3d588041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:09.504598 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:09.565303 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045654d-10de-4117-a224-4382103db9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:09.566060 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045654d-10de-4117-a224-4382103db9c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:09.566375 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045654d-10de-4117-a224-4382103db9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:09.566738 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045654d-10de-4117-a224-4382103db9c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:09.567543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045654d-10de-4117-a224-4382103db9c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:09.577054 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045654d-10de-4117-a224-4382103db9c2 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:09.596743 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 922/1866] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:09.612180 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16e291-1716-429e-a26f-2a465d59cd3a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:09.612490 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16e291-1716-429e-a26f-2a465d59cd3a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:09.612739 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16e291-1716-429e-a26f-2a465d59cd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:09.624528 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 945/1867] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:06:09 2022] POST /identity/v3/projects => generated 387 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:09.628229 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045654d-10de-4117-a224-4382103db9c2 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:09.633328 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d045654d-10de-4117-a224-4382103db9c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:09.646496 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ab16e291-1716-429e-a26f-2a465d59cd3a None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:09.648040 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ab16e291-1716-429e-a26f-2a465d59cd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:09.695927 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:09.789753 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 923/1868] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:09.789753 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16e291-1716-429e-a26f-2a465d59cd3a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:09.789753 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ab16e291-1716-429e-a26f-2a465d59cd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:09.815482 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16e291-1716-429e-a26f-2a465d59cd3a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:09.825384 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff522c-bec6-460d-a323-9e3800b4d2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:09.826472 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff522c-bec6-460d-a323-9e3800b4d2ef admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:09.826766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff522c-bec6-460d-a323-9e3800b4d2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:09.827123 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff522c-bec6-460d-a323-9e3800b4d2ef admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:09.827749 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045654d-10de-4117-a224-4382103db9c2 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:09.828202 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff522c-bec6-460d-a323-9e3800b4d2ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:09.835363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff522c-bec6-460d-a323-9e3800b4d2ef admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:09.854791 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e479d87-343d-45d3-a713-be268c8e4bba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:09.855754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e479d87-343d-45d3-a713-be268c8e4bba service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:09.856637 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e479d87-343d-45d3-a713-be268c8e4bba service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:09.857545 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e479d87-343d-45d3-a713-be268c8e4bba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:09.888801 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 924/1869] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:06:09 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:09.890166 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc073d53-6269-41e0-bf01-e2fb62602f62 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:09.890330 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc073d53-6269-41e0-bf01-e2fb62602f62 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:09.890729 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc073d53-6269-41e0-bf01-e2fb62602f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:09.914834 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-cc073d53-6269-41e0-bf01-e2fb62602f62 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:09.916191 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-cc073d53-6269-41e0-bf01-e2fb62602f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:09.926257 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 925/1870] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:09.927382 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc073d53-6269-41e0-bf01-e2fb62602f62 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:09.960804 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc073d53-6269-41e0-bf01-e2fb62602f62 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:09.976449 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4717e-021c-4e92-b071-4946de258c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:09.977923 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4717e-021c-4e92-b071-4946de258c95 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:09.978332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4717e-021c-4e92-b071-4946de258c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:09.978699 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4717e-021c-4e92-b071-4946de258c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:09.979817 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4717e-021c-4e92-b071-4946de258c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:09.981832 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4717e-021c-4e92-b071-4946de258c95 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:10.012676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 926/1871] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:10.014015 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4717e-021c-4e92-b071-4946de258c95 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:10.029921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e479d87-343d-45d3-a713-be268c8e4bba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:10.032398 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e479d87-343d-45d3-a713-be268c8e4bba service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:10.044287 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4717e-021c-4e92-b071-4946de258c95 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:10.051639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 946/1872] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:10.052944 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e479d87-343d-45d3-a713-be268c8e4bba service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:10.055564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e860dfb-f4af-4eaa-8eb8-8b7f14adca6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:10.056353 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e860dfb-f4af-4eaa-8eb8-8b7f14adca6a admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:10.056761 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e860dfb-f4af-4eaa-8eb8-8b7f14adca6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:10.057141 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e860dfb-f4af-4eaa-8eb8-8b7f14adca6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:10.058079 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e860dfb-f4af-4eaa-8eb8-8b7f14adca6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:06:10.058655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e860dfb-f4af-4eaa-8eb8-8b7f14adca6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:10.063256 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e860dfb-f4af-4eaa-8eb8-8b7f14adca6a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:10.069841 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e479d87-343d-45d3-a713-be268c8e4bba service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:10.080591 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72451f4-afe2-4b4a-b5c2-165adf6f0e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:10.082206 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72451f4-afe2-4b4a-b5c2-165adf6f0e0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:10.082569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72451f4-afe2-4b4a-b5c2-165adf6f0e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:10.083127 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72451f4-afe2-4b4a-b5c2-165adf6f0e0a admin admin] PATH_INFO: `/v3/projects/13bfa512bf1c467c8142546c8cf2df57/users/0401a3326839444fafff71c80dca857c/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:10.087373 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 927/1873] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:06:10.094199 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e860dfb-f4af-4eaa-8eb8-8b7f14adca6a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:10.120148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72451f4-afe2-4b4a-b5c2-165adf6f0e0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=13bfa512bf1c467c8142546c8cf2df57, user_id=0401a3326839444fafff71c80dca857c, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:10.120256 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e860dfb-f4af-4eaa-8eb8-8b7f14adca6a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:10.120371 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72451f4-afe2-4b4a-b5c2-165adf6f0e0a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:10.123070 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7ec9d-fb1b-404f-854c-ca83d97afe9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:10.123949 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7ec9d-fb1b-404f-854c-ca83d97afe9a admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:10.124243 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7ec9d-fb1b-404f-854c-ca83d97afe9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:10.124917 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7ec9d-fb1b-404f-854c-ca83d97afe9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:10.125929 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7ec9d-fb1b-404f-854c-ca83d97afe9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:10.129271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7ec9d-fb1b-404f-854c-ca83d97afe9a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:10.160097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 947/1874] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:10 2022] PUT /identity/v3/projects/13bfa512bf1c467c8142546c8cf2df57/users/0401a3326839444fafff71c80dca857c/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:10.161438 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72451f4-afe2-4b4a-b5c2-165adf6f0e0a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:10.211527 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 928/1875] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:06:10 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:10.213605 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7ec9d-fb1b-404f-854c-ca83d97afe9a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:10.258849 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:10.291008 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72451f4-afe2-4b4a-b5c2-165adf6f0e0a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:10.390908 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7ec9d-fb1b-404f-854c-ca83d97afe9a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:10.398031 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec93b8-069c-4481-be5c-32974d10c8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:10.398740 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec93b8-069c-4481-be5c-32974d10c8b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:10.399408 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec93b8-069c-4481-be5c-32974d10c8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:10.400573 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec93b8-069c-4481-be5c-32974d10c8b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:10.401415 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec93b8-069c-4481-be5c-32974d10c8b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:10.403669 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec93b8-069c-4481-be5c-32974d10c8b7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:10.456648 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 929/1876] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:06:10 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:10.461174 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec93b8-069c-4481-be5c-32974d10c8b7 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:10.483238 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec93b8-069c-4481-be5c-32974d10c8b7 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:10.501197 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c642ab-f2c9-4c81-992e-f273d2af83b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:10.502943 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c642ab-f2c9-4c81-992e-f273d2af83b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:10.505343 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c642ab-f2c9-4c81-992e-f273d2af83b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:10.506049 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c642ab-f2c9-4c81-992e-f273d2af83b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:10.507521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c642ab-f2c9-4c81-992e-f273d2af83b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:10.510685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c642ab-f2c9-4c81-992e-f273d2af83b3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:10.520456 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0bef7-ad4c-4bec-9554-822926fe20af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:10.521308 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0bef7-ad4c-4bec-9554-822926fe20af admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:10.521590 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0bef7-ad4c-4bec-9554-822926fe20af admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:10.522366 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0bef7-ad4c-4bec-9554-822926fe20af admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:10.526638 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0bef7-ad4c-4bec-9554-822926fe20af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:10.534933 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0bef7-ad4c-4bec-9554-822926fe20af admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:10.547141 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 930/1877] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:10.549856 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c642ab-f2c9-4c81-992e-f273d2af83b3 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:10.554712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 948/1878] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:10.560944 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0bef7-ad4c-4bec-9554-822926fe20af admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:10.562487 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c642ab-f2c9-4c81-992e-f273d2af83b3 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:10.568433 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbac04b-bed1-472b-aa13-7506507acf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:10.569435 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbac04b-bed1-472b-aa13-7506507acf23 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:10.569734 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbac04b-bed1-472b-aa13-7506507acf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:10.570036 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbac04b-bed1-472b-aa13-7506507acf23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:10.570753 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbac04b-bed1-472b-aa13-7506507acf23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:10.572587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbac04b-bed1-472b-aa13-7506507acf23 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:10.589823 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0bef7-ad4c-4bec-9554-822926fe20af admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:10.593683 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 931/1879] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:10.595508 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbac04b-bed1-472b-aa13-7506507acf23 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:10.605262 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cd158-9357-490a-87af-eb2a0cc231a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:10.606522 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cd158-9357-490a-87af-eb2a0cc231a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:10.607137 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cd158-9357-490a-87af-eb2a0cc231a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:10.620206 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cd158-9357-490a-87af-eb2a0cc231a7 admin admin] PATH_INFO: `/v3/projects/13bfa512bf1c467c8142546c8cf2df57/users/0401a3326839444fafff71c80dca857c/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:10.622458 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbac04b-bed1-472b-aa13-7506507acf23 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:10.627025 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1cd158-9357-490a-87af-eb2a0cc231a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13bfa512bf1c467c8142546c8cf2df57, user_id=0401a3326839444fafff71c80dca857c, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:10.630705 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1cd158-9357-490a-87af-eb2a0cc231a7 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:10.645923 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7544be4-58f8-4703-965d-e46a688493bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:10.647318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7544be4-58f8-4703-965d-e46a688493bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:10.647604 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7544be4-58f8-4703-965d-e46a688493bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:10.647888 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7544be4-58f8-4703-965d-e46a688493bc admin admin] PATH_INFO: `/v3/projects/a6c53b857a01451f95ad1cfa7ade0338/users/072b17e4340a4959934595ddf0077884/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:10.680833 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 949/1880] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:10 2022] PUT /identity/v3/projects/13bfa512bf1c467c8142546c8cf2df57/users/0401a3326839444fafff71c80dca857c/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:10.682679 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f9f8a-f560-4bb6-b52b-cc6d02bc0752 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:10.682973 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f9f8a-f560-4bb6-b52b-cc6d02bc0752 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:10.683280 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f9f8a-f560-4bb6-b52b-cc6d02bc0752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:10.689565 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7544be4-58f8-4703-965d-e46a688493bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6c53b857a01451f95ad1cfa7ade0338, user_id=072b17e4340a4959934595ddf0077884, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:10.695153 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7544be4-58f8-4703-965d-e46a688493bc admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:10.736587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 932/1881] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:10 2022] PUT /identity/v3/projects/a6c53b857a01451f95ad1cfa7ade0338/users/072b17e4340a4959934595ddf0077884/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:10.749365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7ea53-fee9-497b-b840-2e28f92d934b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:10.749707 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7ea53-fee9-497b-b840-2e28f92d934b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:10.749986 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7ea53-fee9-497b-b840-2e28f92d934b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:10.762065 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-814f9f8a-f560-4bb6-b52b-cc6d02bc0752 None None] MFA Rules not processed for user `0401a3326839444fafff71c80dca857c`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:10.763427 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-814f9f8a-f560-4bb6-b52b-cc6d02bc0752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:10.772178 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:10.812570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-40a7ea53-fee9-497b-b840-2e28f92d934b None None] MFA Rules not processed for user `072b17e4340a4959934595ddf0077884`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:10.814062 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-40a7ea53-fee9-497b-b840-2e28f92d934b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:10.914662 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 950/1882] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:06:10.915743 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f9f8a-f560-4bb6-b52b-cc6d02bc0752 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:10.943162 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 933/1883] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:10.943162 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7ea53-fee9-497b-b840-2e28f92d934b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:10.948756 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-40a7ea53-fee9-497b-b840-2e28f92d934b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:11.078298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f9f8a-f560-4bb6-b52b-cc6d02bc0752 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:11.084998 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83a804-fcf0-4349-816f-67c457fb447d tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5537aa5470a40dfa782a2b7f12d84c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '652440f8df89433cb37decc0ae078b82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:11.085949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83a804-fcf0-4349-816f-67c457fb447d tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:11.086464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83a804-fcf0-4349-816f-67c457fb447d tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:11.086810 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83a804-fcf0-4349-816f-67c457fb447d tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:11.087666 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83a804-fcf0-4349-816f-67c457fb447d tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:06:11.088559 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83a804-fcf0-4349-816f-67c457fb447d tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:11.090006 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83a804-fcf0-4349-816f-67c457fb447d tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:11.092724 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7ea53-fee9-497b-b840-2e28f92d934b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:11.096427 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82396d4-9189-401a-92fe-c4ff1f0a2a8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:11.097083 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82396d4-9189-401a-92fe-c4ff1f0a2a8d service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:11.097709 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82396d4-9189-401a-92fe-c4ff1f0a2a8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:11.097709 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82396d4-9189-401a-92fe-c4ff1f0a2a8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:11.099352 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:11.103776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 951/1884] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:06:11.104833 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83a804-fcf0-4349-816f-67c457fb447d tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:11.108649 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82396d4-9189-401a-92fe-c4ff1f0a2a8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:11.110213 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82396d4-9189-401a-92fe-c4ff1f0a2a8d service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:11.123732 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 934/1885] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:11.124513 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82396d4-9189-401a-92fe-c4ff1f0a2a8d service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:11.135240 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82396d4-9189-401a-92fe-c4ff1f0a2a8d service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:11.140762 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff7e68-fc96-4a04-81a8-193b47cffaeb tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5537aa5470a40dfa782a2b7f12d84c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '652440f8df89433cb37decc0ae078b82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:11.141605 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff7e68-fc96-4a04-81a8-193b47cffaeb tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:11.141969 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff7e68-fc96-4a04-81a8-193b47cffaeb tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:11.142420 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff7e68-fc96-4a04-81a8-193b47cffaeb tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:11.143215 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff7e68-fc96-4a04-81a8-193b47cffaeb tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:11.152308 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff7e68-fc96-4a04-81a8-193b47cffaeb tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:11.191909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 935/1886] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:06:11 2022] POST /identity/v3/projects => generated 354 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:11.196612 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff7e68-fc96-4a04-81a8-193b47cffaeb tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:11.211817 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83a804-fcf0-4349-816f-67c457fb447d tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:11.280471 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff7e68-fc96-4a04-81a8-193b47cffaeb tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:11.281289 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467c02d-c2ee-4772-84d2-c6ff11200d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:11.282069 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467c02d-c2ee-4772-84d2-c6ff11200d49 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:11.282391 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467c02d-c2ee-4772-84d2-c6ff11200d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:11.282679 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467c02d-c2ee-4772-84d2-c6ff11200d49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:11.283710 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467c02d-c2ee-4772-84d2-c6ff11200d49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:11.286684 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467c02d-c2ee-4772-84d2-c6ff11200d49 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:11.290934 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c6bc5-c99e-45c7-a96d-4196ca0763d9 tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5537aa5470a40dfa782a2b7f12d84c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '652440f8df89433cb37decc0ae078b82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:11.291830 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c6bc5-c99e-45c7-a96d-4196ca0763d9 tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:11.292300 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c6bc5-c99e-45c7-a96d-4196ca0763d9 tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:11.292588 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c6bc5-c99e-45c7-a96d-4196ca0763d9 tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:11.293326 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c6bc5-c99e-45c7-a96d-4196ca0763d9 tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:06:11.294250 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c6bc5-c99e-45c7-a96d-4196ca0763d9 tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:11.296461 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c6bc5-c99e-45c7-a96d-4196ca0763d9 tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:11.309453 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 936/1887] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:06:11.310533 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c6bc5-c99e-45c7-a96d-4196ca0763d9 tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:11.332942 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 952/1888] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:06:11 2022] POST /identity/v3/projects => generated 387 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:11.333883 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c6bc5-c99e-45c7-a96d-4196ca0763d9 tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:11.337813 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467c02d-c2ee-4772-84d2-c6ff11200d49 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:11.343871 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:11.415665 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467c02d-c2ee-4772-84d2-c6ff11200d49 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:11.418361 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02706ee7-c0f0-4bb4-adcb-c327389dec8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:11.419351 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02706ee7-c0f0-4bb4-adcb-c327389dec8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:11.419699 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02706ee7-c0f0-4bb4-adcb-c327389dec8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:11.420057 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02706ee7-c0f0-4bb4-adcb-c327389dec8b admin admin] PATH_INFO: `/v3/users/cea36dd47f9945f4a86500324c6666f9` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:11.420810 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29a32b-0082-4056-921d-a8a4429c3f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:11.421234 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02706ee7-c0f0-4bb4-adcb-c327389dec8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cea36dd47f9945f4a86500324c6666f9)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:11.421482 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29a32b-0082-4056-921d-a8a4429c3f31 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:11.421771 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29a32b-0082-4056-921d-a8a4429c3f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:11.422074 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29a32b-0082-4056-921d-a8a4429c3f31 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:11.422781 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29a32b-0082-4056-921d-a8a4429c3f31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:11.423216 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02706ee7-c0f0-4bb4-adcb-c327389dec8b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:11.424753 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29a32b-0082-4056-921d-a8a4429c3f31 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:11.445107 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 953/1889] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:06:11 2022] POST /identity/v3/users => generated 300 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:11.446194 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29a32b-0082-4056-921d-a8a4429c3f31 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:11.474093 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:11.474299 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-02706ee7-c0f0-4bb4-adcb-c327389dec8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cea36dd47f9945f4a86500324c6666f9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:11.481686 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-02706ee7-c0f0-4bb4-adcb-c327389dec8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cea36dd47f9945f4a86500324c6666f9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:11.495171 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-02706ee7-c0f0-4bb4-adcb-c327389dec8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cea36dd47f9945f4a86500324c6666f9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:11.496201 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-02706ee7-c0f0-4bb4-adcb-c327389dec8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cea36dd47f9945f4a86500324c6666f9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:11.496841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-02706ee7-c0f0-4bb4-adcb-c327389dec8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cea36dd47f9945f4a86500324c6666f9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:11.511125 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 937/1890] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:06:11 2022] DELETE /identity/v3/users/cea36dd47f9945f4a86500324c6666f9 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:11.512103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02706ee7-c0f0-4bb4-adcb-c327389dec8b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:11.513650 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-02706ee7-c0f0-4bb4-adcb-c327389dec8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:11.517328 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29a32b-0082-4056-921d-a8a4429c3f31 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:11.580901 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a141db-269e-41ad-8e73-bc20524c3f42 tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5537aa5470a40dfa782a2b7f12d84c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '652440f8df89433cb37decc0ae078b82', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:11.581897 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a141db-269e-41ad-8e73-bc20524c3f42 tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:11.582203 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a141db-269e-41ad-8e73-bc20524c3f42 tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:11.582478 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a141db-269e-41ad-8e73-bc20524c3f42 tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] PATH_INFO: `/v3/projects/dd801113eb2d4d3cb17bdfb6bb9efc12` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:11.583690 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a141db-269e-41ad-8e73-bc20524c3f42 tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dd801113eb2d4d3cb17bdfb6bb9efc12)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:11.585168 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02706ee7-c0f0-4bb4-adcb-c327389dec8b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:11.586216 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a141db-269e-41ad-8e73-bc20524c3f42 tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:11.590137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63558e32-c679-4485-86be-4c1ec6f7b2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:11.590809 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63558e32-c679-4485-86be-4c1ec6f7b2dc admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:11.591099 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63558e32-c679-4485-86be-4c1ec6f7b2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:11.591409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63558e32-c679-4485-86be-4c1ec6f7b2dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:11.592144 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63558e32-c679-4485-86be-4c1ec6f7b2dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:11.593770 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63558e32-c679-4485-86be-4c1ec6f7b2dc admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:11.603703 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 938/1891] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:11.604905 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de63394-695c-4534-a6c8-896d4c672002 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:11.605199 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de63394-695c-4534-a6c8-896d4c672002 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:11.605488 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de63394-695c-4534-a6c8-896d4c672002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:11.626977 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-6de63394-695c-4534-a6c8-896d4c672002 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:11.628204 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6de63394-695c-4534-a6c8-896d4c672002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:11.637241 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e6a141db-269e-41ad-8e73-bc20524c3f42 tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd801113eb2d4d3cb17bdfb6bb9efc12', 'request_id': 'req-e6a141db-269e-41ad-8e73-bc20524c3f42'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:11.642875 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e6a141db-269e-41ad-8e73-bc20524c3f42 tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd801113eb2d4d3cb17bdfb6bb9efc12', 'request_id': 'req-e6a141db-269e-41ad-8e73-bc20524c3f42'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:11.650099 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:11.650331 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e6a141db-269e-41ad-8e73-bc20524c3f42 tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd801113eb2d4d3cb17bdfb6bb9efc12', 'request_id': 'req-e6a141db-269e-41ad-8e73-bc20524c3f42'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:11.663370 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e6a141db-269e-41ad-8e73-bc20524c3f42 tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] The token cache is being invalidate because project dd801113eb2d4d3cb17bdfb6bb9efc12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:06:11.663665 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e6a141db-269e-41ad-8e73-bc20524c3f42 tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:11.664306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e6a141db-269e-41ad-8e73-bc20524c3f42 tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:11.665854 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 954/1892] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:06:11 2022] DELETE /identity/v3/projects/dd801113eb2d4d3cb17bdfb6bb9efc12 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:11.666792 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a141db-269e-41ad-8e73-bc20524c3f42 tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:11.668108 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e6a141db-269e-41ad-8e73-bc20524c3f42 tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:11.699964 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 939/1893] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:11.706537 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de63394-695c-4534-a6c8-896d4c672002 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:11.708011 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6de63394-695c-4534-a6c8-896d4c672002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:11.748298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a141db-269e-41ad-8e73-bc20524c3f42 tempest-VolumeQuotaClassesTest-1205178261 tempest-VolumeQuotaClassesTest-1205178261-project-admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:11.753100 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e88a2-a8b3-451e-a9ad-2f8a25fd3c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:11.754004 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e88a2-a8b3-451e-a9ad-2f8a25fd3c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:11.754293 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e88a2-a8b3-451e-a9ad-2f8a25fd3c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:11.754569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e88a2-a8b3-451e-a9ad-2f8a25fd3c74 admin admin] PATH_INFO: `/v3/projects/4a277b2375034d0a9c4606b12f96da1e/users/f304acd878e94d7888a1fe05884c3443/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:11.757743 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:11.774727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e88a2-a8b3-451e-a9ad-2f8a25fd3c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a277b2375034d0a9c4606b12f96da1e, user_id=f304acd878e94d7888a1fe05884c3443, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:11.776264 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de63394-695c-4534-a6c8-896d4c672002 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:11.777740 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e88a2-a8b3-451e-a9ad-2f8a25fd3c74 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:11.780600 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfc074-f71d-42da-a667-7689788d47af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:11.781270 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfc074-f71d-42da-a667-7689788d47af service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:11.781550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfc074-f71d-42da-a667-7689788d47af service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:11.781909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfc074-f71d-42da-a667-7689788d47af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:11.793205 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 955/1894] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:11 2022] PUT /identity/v3/projects/4a277b2375034d0a9c4606b12f96da1e/users/f304acd878e94d7888a1fe05884c3443/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:11.794767 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdfc074-f71d-42da-a667-7689788d47af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:11.796591 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdfc074-f71d-42da-a667-7689788d47af service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:11.797013 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e88a2-a8b3-451e-a9ad-2f8a25fd3c74 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:11.808655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 940/1895] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:11.893356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e88a2-a8b3-451e-a9ad-2f8a25fd3c74 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:11.904533 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2ddda-4a47-4600-a5f6-cb499737395b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:11.905217 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2ddda-4a47-4600-a5f6-cb499737395b admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:11.905505 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2ddda-4a47-4600-a5f6-cb499737395b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:11.905780 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2ddda-4a47-4600-a5f6-cb499737395b admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:11.906522 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2ddda-4a47-4600-a5f6-cb499737395b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:11.908363 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2ddda-4a47-4600-a5f6-cb499737395b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:11.927258 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 956/1896] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 15:06:11.930924 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfc074-f71d-42da-a667-7689788d47af service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:11.941001 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2ddda-4a47-4600-a5f6-cb499737395b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:11.943054 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-27d2ddda-4a47-4600-a5f6-cb499737395b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:11.955984 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfc074-f71d-42da-a667-7689788d47af service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:11.957811 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2ddda-4a47-4600-a5f6-cb499737395b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:11.962529 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5a007-a871-4e38-ac7d-dfeae515a8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:11.963406 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d92c50-5f85-492e-9b16-9e6914789924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:11.963551 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5a007-a871-4e38-ac7d-dfeae515a8f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:11.963739 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5a007-a871-4e38-ac7d-dfeae515a8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:11.964017 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5a007-a871-4e38-ac7d-dfeae515a8f9 admin admin] PATH_INFO: `/v3/projects/4a277b2375034d0a9c4606b12f96da1e/users/f304acd878e94d7888a1fe05884c3443/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:11.964535 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d92c50-5f85-492e-9b16-9e6914789924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:11.964889 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d92c50-5f85-492e-9b16-9e6914789924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:11.965238 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d92c50-5f85-492e-9b16-9e6914789924 admin admin] PATH_INFO: `/v3/users/d462c697dbf34eec9397a8b33ea24e73` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:11.966531 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d92c50-5f85-492e-9b16-9e6914789924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d462c697dbf34eec9397a8b33ea24e73)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:11.966647 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5a007-a871-4e38-ac7d-dfeae515a8f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a277b2375034d0a9c4606b12f96da1e, user_id=f304acd878e94d7888a1fe05884c3443, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:11.968634 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d92c50-5f85-492e-9b16-9e6914789924 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:11.969399 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5a007-a871-4e38-ac7d-dfeae515a8f9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:11.999966 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 941/1897] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:11 2022] PUT /identity/v3/projects/4a277b2375034d0a9c4606b12f96da1e/users/f304acd878e94d7888a1fe05884c3443/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:06:12.011903 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e58691-a86d-4bc4-b547-b5a732399739 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:12.012613 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e58691-a86d-4bc4-b547-b5a732399739 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:12.012966 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e58691-a86d-4bc4-b547-b5a732399739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:12.051816 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-17e58691-a86d-4bc4-b547-b5a732399739 None None] MFA Rules not processed for user `f304acd878e94d7888a1fe05884c3443`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:12.053911 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-17e58691-a86d-4bc4-b547-b5a732399739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:12.097022 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-43d92c50-5f85-492e-9b16-9e6914789924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd462c697dbf34eec9397a8b33ea24e73'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:12.099768 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-43d92c50-5f85-492e-9b16-9e6914789924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd462c697dbf34eec9397a8b33ea24e73'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:12.103339 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-43d92c50-5f85-492e-9b16-9e6914789924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd462c697dbf34eec9397a8b33ea24e73'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:12.114740 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-43d92c50-5f85-492e-9b16-9e6914789924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd462c697dbf34eec9397a8b33ea24e73'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:12.149735 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-43d92c50-5f85-492e-9b16-9e6914789924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd462c697dbf34eec9397a8b33ea24e73'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:12.174133 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 957/1898] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:06:11 2022] DELETE /identity/v3/users/d462c697dbf34eec9397a8b33ea24e73 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:12.177020 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 942/1899] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:12.179078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4951ff-394f-4497-a306-6ad9dbc45a8a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:12.179408 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4951ff-394f-4497-a306-6ad9dbc45a8a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:12.179690 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4951ff-394f-4497-a306-6ad9dbc45a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:12.190677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e58691-a86d-4bc4-b547-b5a732399739 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:12.192526 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-17e58691-a86d-4bc4-b547-b5a732399739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:12.201219 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-aa4951ff-394f-4497-a306-6ad9dbc45a8a None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:12.202708 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-aa4951ff-394f-4497-a306-6ad9dbc45a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:12.269299 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:12.288081 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e58691-a86d-4bc4-b547-b5a732399739 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:12.290911 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:12.324831 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 958/1900] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:12.353745 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4951ff-394f-4497-a306-6ad9dbc45a8a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:12.355289 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-aa4951ff-394f-4497-a306-6ad9dbc45a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:12.384795 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5bd48-87ac-4104-bd52-5a564992bca6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:12.386009 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5bd48-87ac-4104-bd52-5a564992bca6 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:12.390950 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5bd48-87ac-4104-bd52-5a564992bca6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:12.391355 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5bd48-87ac-4104-bd52-5a564992bca6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:12.439448 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4951ff-394f-4497-a306-6ad9dbc45a8a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:12.445219 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c76ea-b11f-44d4-9d87-be0fde335e16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:12.446205 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c76ea-b11f-44d4-9d87-be0fde335e16 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:12.446591 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c76ea-b11f-44d4-9d87-be0fde335e16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:12.446966 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c76ea-b11f-44d4-9d87-be0fde335e16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:12.464974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c76ea-b11f-44d4-9d87-be0fde335e16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:12.467222 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c76ea-b11f-44d4-9d87-be0fde335e16 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:12.481533 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 959/1901] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:12.495874 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5bd48-87ac-4104-bd52-5a564992bca6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:12.499082 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5bd48-87ac-4104-bd52-5a564992bca6 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:12.514339 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 943/1902] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:12.762852 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c76ea-b11f-44d4-9d87-be0fde335e16 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:12.764800 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-596c76ea-b11f-44d4-9d87-be0fde335e16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:12.788212 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c76ea-b11f-44d4-9d87-be0fde335e16 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:12.799064 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed4566-fc5a-4dec-bc93-7a9aef842a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:12.800091 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed4566-fc5a-4dec-bc93-7a9aef842a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:12.800403 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed4566-fc5a-4dec-bc93-7a9aef842a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:12.800577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed4566-fc5a-4dec-bc93-7a9aef842a53 admin admin] PATH_INFO: `/v3/projects/3c20d703e5174e118bf2e95ea1586d3d` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:12.812184 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed4566-fc5a-4dec-bc93-7a9aef842a53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c20d703e5174e118bf2e95ea1586d3d)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:12.814354 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed4566-fc5a-4dec-bc93-7a9aef842a53 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:12.904807 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-04ed4566-fc5a-4dec-bc93-7a9aef842a53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c20d703e5174e118bf2e95ea1586d3d', 'request_id': 'req-04ed4566-fc5a-4dec-bc93-7a9aef842a53'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:12.910808 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-04ed4566-fc5a-4dec-bc93-7a9aef842a53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c20d703e5174e118bf2e95ea1586d3d', 'request_id': 'req-04ed4566-fc5a-4dec-bc93-7a9aef842a53'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:12.924814 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-04ed4566-fc5a-4dec-bc93-7a9aef842a53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c20d703e5174e118bf2e95ea1586d3d', 'request_id': 'req-04ed4566-fc5a-4dec-bc93-7a9aef842a53'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:12.951531 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-04ed4566-fc5a-4dec-bc93-7a9aef842a53 admin admin] The token cache is being invalidate because project 3c20d703e5174e118bf2e95ea1586d3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:06:12.952121 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-04ed4566-fc5a-4dec-bc93-7a9aef842a53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:12.957188 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-04ed4566-fc5a-4dec-bc93-7a9aef842a53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:12.960386 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 960/1903] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:06:12 2022] DELETE /identity/v3/projects/3c20d703e5174e118bf2e95ea1586d3d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:06:12.964126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5bd48-87ac-4104-bd52-5a564992bca6 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:12.977231 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5bd48-87ac-4104-bd52-5a564992bca6 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:13.053243 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937ec7e-f5b7-4c5f-82f3-bc86834cc15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:13.054205 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937ec7e-f5b7-4c5f-82f3-bc86834cc15b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:13.054888 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937ec7e-f5b7-4c5f-82f3-bc86834cc15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:13.054888 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937ec7e-f5b7-4c5f-82f3-bc86834cc15b admin admin] PATH_INFO: `/v3/users/0401a3326839444fafff71c80dca857c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:13.056207 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937ec7e-f5b7-4c5f-82f3-bc86834cc15b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0401a3326839444fafff71c80dca857c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:13.058361 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937ec7e-f5b7-4c5f-82f3-bc86834cc15b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:13.143135 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed4566-fc5a-4dec-bc93-7a9aef842a53 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:13.148416 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-04ed4566-fc5a-4dec-bc93-7a9aef842a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:13.191361 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed4566-fc5a-4dec-bc93-7a9aef842a53 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:13.202296 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3937ec7e-f5b7-4c5f-82f3-bc86834cc15b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0401a3326839444fafff71c80dca857c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:13.204610 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b531b4-6f0f-4b44-b740-46a746314a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:13.205245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:13.207232 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b531b4-6f0f-4b44-b740-46a746314a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:13.207604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b531b4-6f0f-4b44-b740-46a746314a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:13.208122 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b531b4-6f0f-4b44-b740-46a746314a30 admin admin] PATH_INFO: `/v3/projects/09934739fcba45c5b073533272405739` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:13.211193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b531b4-6f0f-4b44-b740-46a746314a30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09934739fcba45c5b073533272405739)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:13.215504 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b531b4-6f0f-4b44-b740-46a746314a30 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:13.228053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3937ec7e-f5b7-4c5f-82f3-bc86834cc15b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0401a3326839444fafff71c80dca857c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:13.266880 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3937ec7e-f5b7-4c5f-82f3-bc86834cc15b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0401a3326839444fafff71c80dca857c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:13.269168 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3937ec7e-f5b7-4c5f-82f3-bc86834cc15b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0401a3326839444fafff71c80dca857c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:13.271505 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-3937ec7e-f5b7-4c5f-82f3-bc86834cc15b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0401a3326839444fafff71c80dca857c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:13.303424 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 944/1904] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:06:12 2022] DELETE /identity/v3/users/0401a3326839444fafff71c80dca857c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:13.337825 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f4b531b4-6f0f-4b44-b740-46a746314a30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09934739fcba45c5b073533272405739', 'request_id': 'req-f4b531b4-6f0f-4b44-b740-46a746314a30'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:13.349241 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f4b531b4-6f0f-4b44-b740-46a746314a30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09934739fcba45c5b073533272405739', 'request_id': 'req-f4b531b4-6f0f-4b44-b740-46a746314a30'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:13.358076 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f4b531b4-6f0f-4b44-b740-46a746314a30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09934739fcba45c5b073533272405739', 'request_id': 'req-f4b531b4-6f0f-4b44-b740-46a746314a30'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:13.371459 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:13.376281 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f4b531b4-6f0f-4b44-b740-46a746314a30 admin admin] The token cache is being invalidate because project 09934739fcba45c5b073533272405739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:06:13.376602 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f4b531b4-6f0f-4b44-b740-46a746314a30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:13.377885 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f4b531b4-6f0f-4b44-b740-46a746314a30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:13.383213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 961/1905] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:06:13 2022] DELETE /identity/v3/projects/09934739fcba45c5b073533272405739 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:13.384709 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937ec7e-f5b7-4c5f-82f3-bc86834cc15b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:13.386529 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3937ec7e-f5b7-4c5f-82f3-bc86834cc15b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:13.471684 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b531b4-6f0f-4b44-b740-46a746314a30 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:13.473402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f4b531b4-6f0f-4b44-b740-46a746314a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:13.492652 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937ec7e-f5b7-4c5f-82f3-bc86834cc15b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:13.565606 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc2182-11ae-4708-bc3d-104b83a4ce4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:13.566859 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc2182-11ae-4708-bc3d-104b83a4ce4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:13.567164 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc2182-11ae-4708-bc3d-104b83a4ce4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:13.567472 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc2182-11ae-4708-bc3d-104b83a4ce4d admin admin] PATH_INFO: `/v3/users/e5537aa5470a40dfa782a2b7f12d84c3` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:13.571182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc2182-11ae-4708-bc3d-104b83a4ce4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5537aa5470a40dfa782a2b7f12d84c3)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:13.573213 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc2182-11ae-4708-bc3d-104b83a4ce4d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:13.574521 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b531b4-6f0f-4b44-b740-46a746314a30 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:13.579802 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321662d8-eaec-4550-933b-5efe5c1127a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:13.580690 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321662d8-eaec-4550-933b-5efe5c1127a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:13.580970 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321662d8-eaec-4550-933b-5efe5c1127a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:13.581251 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321662d8-eaec-4550-933b-5efe5c1127a4 admin admin] PATH_INFO: `/v3/users/072b17e4340a4959934595ddf0077884` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:13.582584 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321662d8-eaec-4550-933b-5efe5c1127a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=072b17e4340a4959934595ddf0077884)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:13.584604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321662d8-eaec-4550-933b-5efe5c1127a4 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:13.652785 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-321662d8-eaec-4550-933b-5efe5c1127a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '072b17e4340a4959934595ddf0077884'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:13.653203 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-41fc2182-11ae-4708-bc3d-104b83a4ce4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5537aa5470a40dfa782a2b7f12d84c3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:13.653486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-321662d8-eaec-4550-933b-5efe5c1127a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '072b17e4340a4959934595ddf0077884'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:13.654120 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-321662d8-eaec-4550-933b-5efe5c1127a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '072b17e4340a4959934595ddf0077884'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:13.663081 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-41fc2182-11ae-4708-bc3d-104b83a4ce4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5537aa5470a40dfa782a2b7f12d84c3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:13.667874 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-321662d8-eaec-4550-933b-5efe5c1127a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '072b17e4340a4959934595ddf0077884'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:13.682094 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-41fc2182-11ae-4708-bc3d-104b83a4ce4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5537aa5470a40dfa782a2b7f12d84c3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:13.682869 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-41fc2182-11ae-4708-bc3d-104b83a4ce4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5537aa5470a40dfa782a2b7f12d84c3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:13.683542 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-41fc2182-11ae-4708-bc3d-104b83a4ce4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5537aa5470a40dfa782a2b7f12d84c3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:13.687494 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:13.693533 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-321662d8-eaec-4550-933b-5efe5c1127a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '072b17e4340a4959934595ddf0077884'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:13.710642 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 945/1906] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:06:13 2022] DELETE /identity/v3/users/e5537aa5470a40dfa782a2b7f12d84c3 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:13.711931 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 962/1907] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:06:13 2022] DELETE /identity/v3/users/072b17e4340a4959934595ddf0077884 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:13.716741 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4433e-6d95-4aa8-bcc7-9dd95cafff8c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:13.717065 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4433e-6d95-4aa8-bcc7-9dd95cafff8c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:13.717369 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4433e-6d95-4aa8-bcc7-9dd95cafff8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:13.738607 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-daf4433e-6d95-4aa8-bcc7-9dd95cafff8c None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:13.748575 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-daf4433e-6d95-4aa8-bcc7-9dd95cafff8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:13.831617 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 946/1908] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:06:13.850928 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321662d8-eaec-4550-933b-5efe5c1127a4 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:13.852606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-321662d8-eaec-4550-933b-5efe5c1127a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:13.878115 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4433e-6d95-4aa8-bcc7-9dd95cafff8c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:13.879761 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-daf4433e-6d95-4aa8-bcc7-9dd95cafff8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:13.894846 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4433e-6d95-4aa8-bcc7-9dd95cafff8c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:13.900906 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503a83c-7e31-4642-8700-b99da82f1f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:13.901970 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503a83c-7e31-4642-8700-b99da82f1f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:13.902333 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503a83c-7e31-4642-8700-b99da82f1f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:13.902524 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503a83c-7e31-4642-8700-b99da82f1f5b admin admin] PATH_INFO: `/v3/projects/13bfa512bf1c467c8142546c8cf2df57` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:13.903829 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a503a83c-7e31-4642-8700-b99da82f1f5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=13bfa512bf1c467c8142546c8cf2df57)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:13.905751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a503a83c-7e31-4642-8700-b99da82f1f5b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:13.976630 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321662d8-eaec-4550-933b-5efe5c1127a4 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:13.979967 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a503a83c-7e31-4642-8700-b99da82f1f5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13bfa512bf1c467c8142546c8cf2df57', 'request_id': 'req-a503a83c-7e31-4642-8700-b99da82f1f5b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:13.992000 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a503a83c-7e31-4642-8700-b99da82f1f5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13bfa512bf1c467c8142546c8cf2df57', 'request_id': 'req-a503a83c-7e31-4642-8700-b99da82f1f5b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:14.005703 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a503a83c-7e31-4642-8700-b99da82f1f5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13bfa512bf1c467c8142546c8cf2df57', 'request_id': 'req-a503a83c-7e31-4642-8700-b99da82f1f5b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:14.028666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a503a83c-7e31-4642-8700-b99da82f1f5b admin admin] The token cache is being invalidate because project 13bfa512bf1c467c8142546c8cf2df57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:06:14.028940 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a503a83c-7e31-4642-8700-b99da82f1f5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:14.030830 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a503a83c-7e31-4642-8700-b99da82f1f5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:14.034122 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 947/1909] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:06:13 2022] DELETE /identity/v3/projects/13bfa512bf1c467c8142546c8cf2df57 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:06:14.040620 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ca98e-1b7f-47a5-a420-1cfb96cd44a2 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:14.043868 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ca98e-1b7f-47a5-a420-1cfb96cd44a2 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:14.044046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ca98e-1b7f-47a5-a420-1cfb96cd44a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:14.067420 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:14.080612 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-463ca98e-1b7f-47a5-a420-1cfb96cd44a2 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:14.083483 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-463ca98e-1b7f-47a5-a420-1cfb96cd44a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:14.120110 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68d6a4-14c5-4075-90ce-a35c1c0ee584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:14.121699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68d6a4-14c5-4075-90ce-a35c1c0ee584 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:14.122183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68d6a4-14c5-4075-90ce-a35c1c0ee584 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:14.122814 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68d6a4-14c5-4075-90ce-a35c1c0ee584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:14.124911 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1b68d6a4-14c5-4075-90ce-a35c1c0ee584 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:14.167250 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 948/1910] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:14.167250 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ca98e-1b7f-47a5-a420-1cfb96cd44a2 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:14.167250 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-463ca98e-1b7f-47a5-a420-1cfb96cd44a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:14.182530 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ca98e-1b7f-47a5-a420-1cfb96cd44a2 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:14.187735 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10bd28-c20f-4776-97b7-de98ab56abb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:14.189691 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10bd28-c20f-4776-97b7-de98ab56abb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:14.190151 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10bd28-c20f-4776-97b7-de98ab56abb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:14.190410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10bd28-c20f-4776-97b7-de98ab56abb5 admin admin] PATH_INFO: `/v3/projects/652440f8df89433cb37decc0ae078b82` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:14.191628 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10bd28-c20f-4776-97b7-de98ab56abb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=652440f8df89433cb37decc0ae078b82)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:14.193731 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10bd28-c20f-4776-97b7-de98ab56abb5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:14.202358 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68d6a4-14c5-4075-90ce-a35c1c0ee584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:14.203989 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68d6a4-14c5-4075-90ce-a35c1c0ee584 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:14.205773 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:14.231005 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 963/1911] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:14.232699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb38642-1f37-429a-8d80-c8961d86e8ca None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:14.233071 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb38642-1f37-429a-8d80-c8961d86e8ca None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:14.233433 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb38642-1f37-429a-8d80-c8961d86e8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:14.259005 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5a10bd28-c20f-4776-97b7-de98ab56abb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '652440f8df89433cb37decc0ae078b82', 'request_id': 'req-5a10bd28-c20f-4776-97b7-de98ab56abb5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:14.269468 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-5cb38642-1f37-429a-8d80-c8961d86e8ca None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:14.270705 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5cb38642-1f37-429a-8d80-c8961d86e8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:14.279320 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5a10bd28-c20f-4776-97b7-de98ab56abb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '652440f8df89433cb37decc0ae078b82', 'request_id': 'req-5a10bd28-c20f-4776-97b7-de98ab56abb5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:14.298936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5a10bd28-c20f-4776-97b7-de98ab56abb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '652440f8df89433cb37decc0ae078b82', 'request_id': 'req-5a10bd28-c20f-4776-97b7-de98ab56abb5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:14.341118 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5a10bd28-c20f-4776-97b7-de98ab56abb5 admin admin] The token cache is being invalidate because project 652440f8df89433cb37decc0ae078b82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:06:14.341635 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5a10bd28-c20f-4776-97b7-de98ab56abb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:14.342983 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5a10bd28-c20f-4776-97b7-de98ab56abb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:14.344895 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 949/1912] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:06:14 2022] DELETE /identity/v3/projects/652440f8df89433cb37decc0ae078b82 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:14.354412 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28de85-a314-45c5-9ff9-835bbd4fd83a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:14.354717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28de85-a314-45c5-9ff9-835bbd4fd83a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:14.355095 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28de85-a314-45c5-9ff9-835bbd4fd83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:14.398841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1d28de85-a314-45c5-9ff9-835bbd4fd83a None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:14.400162 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1d28de85-a314-45c5-9ff9-835bbd4fd83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:14.406716 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 964/1913] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:14.407694 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb38642-1f37-429a-8d80-c8961d86e8ca None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:14.415248 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 950/1914] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:06:14.417338 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb38642-1f37-429a-8d80-c8961d86e8ca None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:14.420819 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaade66b-9d0c-4e0f-bc6e-f68fe4e5022f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:14.421290 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaade66b-9d0c-4e0f-bc6e-f68fe4e5022f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:14.421906 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaade66b-9d0c-4e0f-bc6e-f68fe4e5022f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:14.422465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b749c5f-eb99-4ad6-8bc1-bee214dbdf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:14.423233 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b749c5f-eb99-4ad6-8bc1-bee214dbdf76 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:14.423587 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b749c5f-eb99-4ad6-8bc1-bee214dbdf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:14.423873 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b749c5f-eb99-4ad6-8bc1-bee214dbdf76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:14.424609 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b749c5f-eb99-4ad6-8bc1-bee214dbdf76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:06:14.424922 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b749c5f-eb99-4ad6-8bc1-bee214dbdf76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:14.426730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b749c5f-eb99-4ad6-8bc1-bee214dbdf76 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:14.440613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 965/1915] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:06:14.446364 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b749c5f-eb99-4ad6-8bc1-bee214dbdf76 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:14.457668 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-eaade66b-9d0c-4e0f-bc6e-f68fe4e5022f None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:14.457858 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b749c5f-eb99-4ad6-8bc1-bee214dbdf76 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:14.460010 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-eaade66b-9d0c-4e0f-bc6e-f68fe4e5022f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:14.464062 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0573d-a3ed-4e6b-8199-3891f88dc346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:14.464733 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0573d-a3ed-4e6b-8199-3891f88dc346 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:14.465020 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0573d-a3ed-4e6b-8199-3891f88dc346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:14.465302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0573d-a3ed-4e6b-8199-3891f88dc346 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:14.466940 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0573d-a3ed-4e6b-8199-3891f88dc346 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:14.468931 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0573d-a3ed-4e6b-8199-3891f88dc346 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:14.472585 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 951/1916] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:14.476362 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaade66b-9d0c-4e0f-bc6e-f68fe4e5022f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:14.489456 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaade66b-9d0c-4e0f-bc6e-f68fe4e5022f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:14.495097 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed406a-6972-4ed8-9eeb-68035ca5db48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:14.496098 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed406a-6972-4ed8-9eeb-68035ca5db48 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:14.496448 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed406a-6972-4ed8-9eeb-68035ca5db48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:14.496727 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed406a-6972-4ed8-9eeb-68035ca5db48 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:14.497512 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed406a-6972-4ed8-9eeb-68035ca5db48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:06:14.497974 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed406a-6972-4ed8-9eeb-68035ca5db48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:14.499782 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed406a-6972-4ed8-9eeb-68035ca5db48 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:14.503252 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 966/1917] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:06:14 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:14.504698 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0573d-a3ed-4e6b-8199-3891f88dc346 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:14.517919 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 952/1918] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:06:14.523029 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed406a-6972-4ed8-9eeb-68035ca5db48 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:14.536687 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed406a-6972-4ed8-9eeb-68035ca5db48 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:14.591820 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:14.605886 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0573d-a3ed-4e6b-8199-3891f88dc346 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:14.611670 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e47d9-06ca-40d5-84a7-9f85bd8ef447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:14.612023 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e47d9-06ca-40d5-84a7-9f85bd8ef447 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:14.612309 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e47d9-06ca-40d5-84a7-9f85bd8ef447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:14.612588 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e47d9-06ca-40d5-84a7-9f85bd8ef447 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:14.613295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e47d9-06ca-40d5-84a7-9f85bd8ef447 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:14.615552 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e47d9-06ca-40d5-84a7-9f85bd8ef447 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:14.637431 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d769d-caa6-4298-ac75-1a8aedd451a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:14.638219 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d769d-caa6-4298-ac75-1a8aedd451a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:14.638601 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d769d-caa6-4298-ac75-1a8aedd451a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:14.639130 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d769d-caa6-4298-ac75-1a8aedd451a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:14.639317 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 967/1919] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:06:14 2022] POST /identity/v3/users => generated 284 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:14.643427 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d769d-caa6-4298-ac75-1a8aedd451a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:14.643557 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e47d9-06ca-40d5-84a7-9f85bd8ef447 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:14.645588 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d769d-caa6-4298-ac75-1a8aedd451a6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:14.655650 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e47d9-06ca-40d5-84a7-9f85bd8ef447 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:14.663150 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6edf44-dc93-499b-bdeb-d1de1c920992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:14.663847 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6edf44-dc93-499b-bdeb-d1de1c920992 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:14.664137 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6edf44-dc93-499b-bdeb-d1de1c920992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:14.664708 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6edf44-dc93-499b-bdeb-d1de1c920992 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:14.665201 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6edf44-dc93-499b-bdeb-d1de1c920992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:14.666903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6edf44-dc93-499b-bdeb-d1de1c920992 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:14.678197 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 968/1920] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 15:06:14.681725 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6edf44-dc93-499b-bdeb-d1de1c920992 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:14.682971 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 953/1921] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:06:14 2022] POST /identity/v3/projects => generated 387 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:14.684002 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d769d-caa6-4298-ac75-1a8aedd451a6 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:14.694074 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6edf44-dc93-499b-bdeb-d1de1c920992 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:14.753969 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d769d-caa6-4298-ac75-1a8aedd451a6 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:14.759312 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bea7cf-a04b-47f7-a0fb-2ffe2c53ecdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:14.759992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bea7cf-a04b-47f7-a0fb-2ffe2c53ecdd admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:14.760284 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bea7cf-a04b-47f7-a0fb-2ffe2c53ecdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:14.760757 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bea7cf-a04b-47f7-a0fb-2ffe2c53ecdd admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:14.761413 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bea7cf-a04b-47f7-a0fb-2ffe2c53ecdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:14.763425 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bea7cf-a04b-47f7-a0fb-2ffe2c53ecdd admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:14.770431 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:14.778290 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec59498-497a-40fc-aa6c-818684adba00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:14.779132 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec59498-497a-40fc-aa6c-818684adba00 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:14.779596 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec59498-497a-40fc-aa6c-818684adba00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:14.780027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec59498-497a-40fc-aa6c-818684adba00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:14.780640 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec59498-497a-40fc-aa6c-818684adba00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:14.782285 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec59498-497a-40fc-aa6c-818684adba00 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:14.794504 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 954/1922] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:06:14 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:14.795465 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bea7cf-a04b-47f7-a0fb-2ffe2c53ecdd admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:14.798611 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 969/1923] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 15:06:14.798611 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec59498-497a-40fc-aa6c-818684adba00 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:14.799867 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f3bea7cf-a04b-47f7-a0fb-2ffe2c53ecdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:14.807795 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec59498-497a-40fc-aa6c-818684adba00 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:14.813957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47906c33-67d1-43dc-a31f-7271d18ca86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:14.814757 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47906c33-67d1-43dc-a31f-7271d18ca86c admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:14.815547 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47906c33-67d1-43dc-a31f-7271d18ca86c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:14.815657 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bea7cf-a04b-47f7-a0fb-2ffe2c53ecdd admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:14.815737 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47906c33-67d1-43dc-a31f-7271d18ca86c admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:14.816151 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47906c33-67d1-43dc-a31f-7271d18ca86c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:14.817905 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47906c33-67d1-43dc-a31f-7271d18ca86c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:14.822404 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49842c68-435f-4575-bb23-42e37b6c2d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:14.825387 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49842c68-435f-4575-bb23-42e37b6c2d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:14.825744 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49842c68-435f-4575-bb23-42e37b6c2d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:14.825979 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49842c68-435f-4575-bb23-42e37b6c2d30 admin admin] PATH_INFO: `/v3/projects/a6c53b857a01451f95ad1cfa7ade0338` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:14.828126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49842c68-435f-4575-bb23-42e37b6c2d30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6c53b857a01451f95ad1cfa7ade0338)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:14.831182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49842c68-435f-4575-bb23-42e37b6c2d30 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:14.836251 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 970/1924] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:14.836251 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47906c33-67d1-43dc-a31f-7271d18ca86c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:14.853916 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47906c33-67d1-43dc-a31f-7271d18ca86c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:14.859442 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5c106-81d3-4ecd-a19b-28576dd60bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:14.860343 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5c106-81d3-4ecd-a19b-28576dd60bf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:14.860625 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5c106-81d3-4ecd-a19b-28576dd60bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:14.860915 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5c106-81d3-4ecd-a19b-28576dd60bf5 admin admin] PATH_INFO: `/v3/projects/d1b180f339154875ac1d6f6ae5e79b57/users/6fd4224fba43405cb6b2432b97d516d5/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:14.880989 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5c106-81d3-4ecd-a19b-28576dd60bf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1b180f339154875ac1d6f6ae5e79b57, user_id=6fd4224fba43405cb6b2432b97d516d5, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:14.884555 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5c106-81d3-4ecd-a19b-28576dd60bf5 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:14.899570 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 971/1925] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:14 2022] PUT /identity/v3/projects/d1b180f339154875ac1d6f6ae5e79b57/users/6fd4224fba43405cb6b2432b97d516d5/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:14.904077 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5c106-81d3-4ecd-a19b-28576dd60bf5 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:14.927065 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-49842c68-435f-4575-bb23-42e37b6c2d30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6c53b857a01451f95ad1cfa7ade0338', 'request_id': 'req-49842c68-435f-4575-bb23-42e37b6c2d30'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:14.952691 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-49842c68-435f-4575-bb23-42e37b6c2d30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6c53b857a01451f95ad1cfa7ade0338', 'request_id': 'req-49842c68-435f-4575-bb23-42e37b6c2d30'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:14.963876 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-49842c68-435f-4575-bb23-42e37b6c2d30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6c53b857a01451f95ad1cfa7ade0338', 'request_id': 'req-49842c68-435f-4575-bb23-42e37b6c2d30'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:14.979944 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-49842c68-435f-4575-bb23-42e37b6c2d30 admin admin] The token cache is being invalidate because project a6c53b857a01451f95ad1cfa7ade0338 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:06:14.980267 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-49842c68-435f-4575-bb23-42e37b6c2d30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:14.981277 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-49842c68-435f-4575-bb23-42e37b6c2d30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:14.983370 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 955/1926] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:06:14 2022] DELETE /identity/v3/projects/a6c53b857a01451f95ad1cfa7ade0338 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:14.986564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759350e7-1f71-4a97-a5b4-3f7a1295a592 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:14.986967 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759350e7-1f71-4a97-a5b4-3f7a1295a592 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:14.987332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759350e7-1f71-4a97-a5b4-3f7a1295a592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:15.000807 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5c106-81d3-4ecd-a19b-28576dd60bf5 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:15.009801 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c42fb8-28af-4378-a392-fb0bae973e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:15.010525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c42fb8-28af-4378-a392-fb0bae973e18 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:15.010821 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c42fb8-28af-4378-a392-fb0bae973e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:15.011114 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c42fb8-28af-4378-a392-fb0bae973e18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:15.011885 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c42fb8-28af-4378-a392-fb0bae973e18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:15.015752 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c42fb8-28af-4378-a392-fb0bae973e18 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:15.019796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-759350e7-1f71-4a97-a5b4-3f7a1295a592 None None] MFA Rules not processed for user `6fd4224fba43405cb6b2432b97d516d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:15.020983 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-759350e7-1f71-4a97-a5b4-3f7a1295a592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:15.033204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 972/1927] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:15.034153 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c42fb8-28af-4378-a392-fb0bae973e18 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:15.038967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-15c42fb8-28af-4378-a392-fb0bae973e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:15.053948 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c42fb8-28af-4378-a392-fb0bae973e18 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:15.066385 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e35ef0-af13-407a-84dc-fdf6d290968b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:15.067643 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e35ef0-af13-407a-84dc-fdf6d290968b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:15.067924 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e35ef0-af13-407a-84dc-fdf6d290968b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:15.068210 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e35ef0-af13-407a-84dc-fdf6d290968b admin admin] PATH_INFO: `/v3/users/f304acd878e94d7888a1fe05884c3443` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:15.070629 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e35ef0-af13-407a-84dc-fdf6d290968b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f304acd878e94d7888a1fe05884c3443)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:15.072852 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e35ef0-af13-407a-84dc-fdf6d290968b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:15.104477 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:15.133167 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 956/1928] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:14 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:15.133965 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759350e7-1f71-4a97-a5b4-3f7a1295a592 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:15.135427 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-759350e7-1f71-4a97-a5b4-3f7a1295a592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:15.139374 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-05e35ef0-af13-407a-84dc-fdf6d290968b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f304acd878e94d7888a1fe05884c3443'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:15.140041 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-05e35ef0-af13-407a-84dc-fdf6d290968b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f304acd878e94d7888a1fe05884c3443'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:15.140663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-05e35ef0-af13-407a-84dc-fdf6d290968b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f304acd878e94d7888a1fe05884c3443'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:15.148773 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-05e35ef0-af13-407a-84dc-fdf6d290968b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f304acd878e94d7888a1fe05884c3443'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:15.161874 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-05e35ef0-af13-407a-84dc-fdf6d290968b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f304acd878e94d7888a1fe05884c3443'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:15.165487 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759350e7-1f71-4a97-a5b4-3f7a1295a592 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:15.173827 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65b0af-a104-455e-8421-4636276c18e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:15.175437 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65b0af-a104-455e-8421-4636276c18e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:15.175996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65b0af-a104-455e-8421-4636276c18e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:15.176528 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65b0af-a104-455e-8421-4636276c18e1 admin admin] PATH_INFO: `/v3/projects/3e0ec4b66c3a4d61b6e726240c659eab/users/9e890cde47c04431bf7bab48f5a0d569/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:15.176914 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 973/1929] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:06:15 2022] DELETE /identity/v3/users/f304acd878e94d7888a1fe05884c3443 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:15.177803 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e35ef0-af13-407a-84dc-fdf6d290968b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:15.179776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-05e35ef0-af13-407a-84dc-fdf6d290968b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:15.201244 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65b0af-a104-455e-8421-4636276c18e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e0ec4b66c3a4d61b6e726240c659eab, user_id=9e890cde47c04431bf7bab48f5a0d569, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:15.204695 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65b0af-a104-455e-8421-4636276c18e1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:15.229780 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 957/1930] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:15 2022] PUT /identity/v3/projects/3e0ec4b66c3a4d61b6e726240c659eab/users/9e890cde47c04431bf7bab48f5a0d569/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:15.246036 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97519a3-5e8d-4be3-9c26-f8c9230b3d2f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:15.246381 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97519a3-5e8d-4be3-9c26-f8c9230b3d2f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:15.246638 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97519a3-5e8d-4be3-9c26-f8c9230b3d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:15.272684 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e35ef0-af13-407a-84dc-fdf6d290968b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:15.303619 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f97519a3-5e8d-4be3-9c26-f8c9230b3d2f None None] MFA Rules not processed for user `9e890cde47c04431bf7bab48f5a0d569`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:15.305444 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f97519a3-5e8d-4be3-9c26-f8c9230b3d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:15.360064 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:15.379672 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302dea3f-02a3-4dbe-b37e-65e837555740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:15.381341 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302dea3f-02a3-4dbe-b37e-65e837555740 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:15.381985 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302dea3f-02a3-4dbe-b37e-65e837555740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:15.382796 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302dea3f-02a3-4dbe-b37e-65e837555740 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:15.383561 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302dea3f-02a3-4dbe-b37e-65e837555740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:15.387185 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302dea3f-02a3-4dbe-b37e-65e837555740 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:15.443116 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 974/1931] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:06:15 2022] POST /identity/v3/projects => generated 365 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:15.444730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302dea3f-02a3-4dbe-b37e-65e837555740 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:15.481502 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 958/1932] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:15.482490 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97519a3-5e8d-4be3-9c26-f8c9230b3d2f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:15.484428 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f97519a3-5e8d-4be3-9c26-f8c9230b3d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:15.492190 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:15.505503 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97519a3-5e8d-4be3-9c26-f8c9230b3d2f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:15.526652 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302dea3f-02a3-4dbe-b37e-65e837555740 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:15.532979 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95d666-3f9b-4ba2-83c2-1626d8b727e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:15.534162 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95d666-3f9b-4ba2-83c2-1626d8b727e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:15.534450 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95d666-3f9b-4ba2-83c2-1626d8b727e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:15.534802 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95d666-3f9b-4ba2-83c2-1626d8b727e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:15.535515 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95d666-3f9b-4ba2-83c2-1626d8b727e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:15.538342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95d666-3f9b-4ba2-83c2-1626d8b727e6 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:15.572291 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 975/1933] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:06:15 2022] POST /identity/v3/users => generated 289 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:06:15.576462 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95d666-3f9b-4ba2-83c2-1626d8b727e6 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:15.580549 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2513f4-9dff-4ae9-8778-c6533fdd2de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:15.581466 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2513f4-9dff-4ae9-8778-c6533fdd2de3 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:15.581937 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2513f4-9dff-4ae9-8778-c6533fdd2de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:15.582678 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2513f4-9dff-4ae9-8778-c6533fdd2de3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:15.583608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2513f4-9dff-4ae9-8778-c6533fdd2de3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:15.586756 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2513f4-9dff-4ae9-8778-c6533fdd2de3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:15.587672 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95d666-3f9b-4ba2-83c2-1626d8b727e6 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:15.593902 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095a850-1c41-4958-aaaf-b09aaad42f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:15.594589 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095a850-1c41-4958-aaaf-b09aaad42f98 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:15.594871 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095a850-1c41-4958-aaaf-b09aaad42f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:15.595154 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095a850-1c41-4958-aaaf-b09aaad42f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:15.596027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095a850-1c41-4958-aaaf-b09aaad42f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:15.598732 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095a850-1c41-4958-aaaf-b09aaad42f98 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:15.616850 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 976/1934] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 15:06:15.621812 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095a850-1c41-4958-aaaf-b09aaad42f98 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:15.630799 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 959/1935] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:06:15 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:15.637107 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2513f4-9dff-4ae9-8778-c6533fdd2de3 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:15.638588 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095a850-1c41-4958-aaaf-b09aaad42f98 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:15.726139 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03860b92-42b9-429b-b586-7a92104f2803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:15.727321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03860b92-42b9-429b-b586-7a92104f2803 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:15.727727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03860b92-42b9-429b-b586-7a92104f2803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:15.728087 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03860b92-42b9-429b-b586-7a92104f2803 admin admin] PATH_INFO: `/v3/projects/19980ac457ef4b3080815f2f5fcdc45a/users/4ab5d0cbdbfb47ee948d563c19706666/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:15.765121 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2513f4-9dff-4ae9-8778-c6533fdd2de3 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:15.767985 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03860b92-42b9-429b-b586-7a92104f2803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19980ac457ef4b3080815f2f5fcdc45a, user_id=4ab5d0cbdbfb47ee948d563c19706666, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:15.771436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03860b92-42b9-429b-b586-7a92104f2803 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:15.772274 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a234b-e436-4da9-801b-21fd5745336b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:15.773276 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a234b-e436-4da9-801b-21fd5745336b admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:15.773611 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a234b-e436-4da9-801b-21fd5745336b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:15.773980 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0a234b-e436-4da9-801b-21fd5745336b admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:15.775382 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a234b-e436-4da9-801b-21fd5745336b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:15.778254 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0a234b-e436-4da9-801b-21fd5745336b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:15.791779 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 977/1936] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:15 2022] PUT /identity/v3/projects/19980ac457ef4b3080815f2f5fcdc45a/users/4ab5d0cbdbfb47ee948d563c19706666/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:06:15.793013 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03860b92-42b9-429b-b586-7a92104f2803 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:15.796457 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-03860b92-42b9-429b-b586-7a92104f2803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:15.815431 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 960/1937] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:06:15 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:15.816507 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a234b-e436-4da9-801b-21fd5745336b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:15.829207 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0a234b-e436-4da9-801b-21fd5745336b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:15.877034 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03860b92-42b9-429b-b586-7a92104f2803 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:15.883139 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ed564-3ee2-4001-b575-4934f3720acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:15.884120 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ed564-3ee2-4001-b575-4934f3720acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:15.884460 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ed564-3ee2-4001-b575-4934f3720acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:15.884832 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ed564-3ee2-4001-b575-4934f3720acc admin admin] PATH_INFO: `/v3/projects/4a277b2375034d0a9c4606b12f96da1e` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:15.886099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ed564-3ee2-4001-b575-4934f3720acc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a277b2375034d0a9c4606b12f96da1e)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:15.888288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ed564-3ee2-4001-b575-4934f3720acc admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:15.890529 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:15.910613 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57f4c8-88b5-4394-9fcc-d3335791609f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:15.911334 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57f4c8-88b5-4394-9fcc-d3335791609f admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:15.911628 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57f4c8-88b5-4394-9fcc-d3335791609f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:15.911911 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57f4c8-88b5-4394-9fcc-d3335791609f admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:15.912807 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb57f4c8-88b5-4394-9fcc-d3335791609f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:15.914440 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb57f4c8-88b5-4394-9fcc-d3335791609f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:15.929078 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 961/1938] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:15.929078 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57f4c8-88b5-4394-9fcc-d3335791609f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:15.937160 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57f4c8-88b5-4394-9fcc-d3335791609f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:15.937537 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:15.952119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-712ed564-3ee2-4001-b575-4934f3720acc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a277b2375034d0a9c4606b12f96da1e', 'request_id': 'req-712ed564-3ee2-4001-b575-4934f3720acc'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:15.958170 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-712ed564-3ee2-4001-b575-4934f3720acc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a277b2375034d0a9c4606b12f96da1e', 'request_id': 'req-712ed564-3ee2-4001-b575-4934f3720acc'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:15.964975 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-712ed564-3ee2-4001-b575-4934f3720acc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a277b2375034d0a9c4606b12f96da1e', 'request_id': 'req-712ed564-3ee2-4001-b575-4934f3720acc'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:15.979859 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-712ed564-3ee2-4001-b575-4934f3720acc admin admin] The token cache is being invalidate because project 4a277b2375034d0a9c4606b12f96da1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:06:15.980184 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-712ed564-3ee2-4001-b575-4934f3720acc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:15.981064 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-712ed564-3ee2-4001-b575-4934f3720acc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:15.982916 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 978/1939] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:06:15 2022] DELETE /identity/v3/projects/4a277b2375034d0a9c4606b12f96da1e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:15.983540 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ed564-3ee2-4001-b575-4934f3720acc admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:15.984840 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-712ed564-3ee2-4001-b575-4934f3720acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:16.004630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b09d77-fec8-440f-b522-5764b6288b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:16.005570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b09d77-fec8-440f-b522-5764b6288b47 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:16.005570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b09d77-fec8-440f-b522-5764b6288b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:16.005851 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b09d77-fec8-440f-b522-5764b6288b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:16.007105 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b09d77-fec8-440f-b522-5764b6288b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:16.008743 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b09d77-fec8-440f-b522-5764b6288b47 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:16.019925 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 962/1940] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:16.024866 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508802e-2c8f-469d-89d9-2c2f7e4ae3e0 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:16.025194 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508802e-2c8f-469d-89d9-2c2f7e4ae3e0 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:16.025448 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508802e-2c8f-469d-89d9-2c2f7e4ae3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:16.045703 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7508802e-2c8f-469d-89d9-2c2f7e4ae3e0 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:16.047253 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7508802e-2c8f-469d-89d9-2c2f7e4ae3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:16.056316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 963/1941] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:16.057349 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7508802e-2c8f-469d-89d9-2c2f7e4ae3e0 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:16.058335 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ed564-3ee2-4001-b575-4934f3720acc admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:16.059010 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7508802e-2c8f-469d-89d9-2c2f7e4ae3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:16.063521 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e353d-385a-4960-a218-08c9b6a23964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:16.064423 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e353d-385a-4960-a218-08c9b6a23964 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:16.064709 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e353d-385a-4960-a218-08c9b6a23964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:16.064991 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e353d-385a-4960-a218-08c9b6a23964 admin admin] PATH_INFO: `/v3/projects/19980ac457ef4b3080815f2f5fcdc45a/users/4ab5d0cbdbfb47ee948d563c19706666/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:16.066995 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e353d-385a-4960-a218-08c9b6a23964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19980ac457ef4b3080815f2f5fcdc45a, user_id=4ab5d0cbdbfb47ee948d563c19706666, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:16.070651 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e353d-385a-4960-a218-08c9b6a23964 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:16.075285 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7508802e-2c8f-469d-89d9-2c2f7e4ae3e0 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:16.093529 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 979/1942] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:15 2022] PUT /identity/v3/projects/19980ac457ef4b3080815f2f5fcdc45a/users/4ab5d0cbdbfb47ee948d563c19706666/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:16.093529 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac017cd-9148-456d-9bd5-6368bcc53a11 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:16.093529 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac017cd-9148-456d-9bd5-6368bcc53a11 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:16.093529 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac017cd-9148-456d-9bd5-6368bcc53a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:16.112828 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9ac017cd-9148-456d-9bd5-6368bcc53a11 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:16.114058 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9ac017cd-9148-456d-9bd5-6368bcc53a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:16.144597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c65f5-010d-48fc-9b0f-c2d0fae6beb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:16.145299 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c65f5-010d-48fc-9b0f-c2d0fae6beb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:16.145587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c65f5-010d-48fc-9b0f-c2d0fae6beb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:16.145882 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c65f5-010d-48fc-9b0f-c2d0fae6beb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:16.147355 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c65f5-010d-48fc-9b0f-c2d0fae6beb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:16.148979 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c65f5-010d-48fc-9b0f-c2d0fae6beb3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:16.159097 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 964/1943] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:16.163556 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e815f-bd4f-4dd1-a651-57f96cfd6918 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:16.163857 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e815f-bd4f-4dd1-a651-57f96cfd6918 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:16.164145 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e815f-bd4f-4dd1-a651-57f96cfd6918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:16.187585 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 980/1944] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:16.188196 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac017cd-9148-456d-9bd5-6368bcc53a11 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:16.199109 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac017cd-9148-456d-9bd5-6368bcc53a11 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:16.201913 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-547e815f-bd4f-4dd1-a651-57f96cfd6918 None None] MFA Rules not processed for user `4ab5d0cbdbfb47ee948d563c19706666`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:16.203156 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-547e815f-bd4f-4dd1-a651-57f96cfd6918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:16.208090 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72e04d-b015-4964-8d23-98672f2f896c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:16.209119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72e04d-b015-4964-8d23-98672f2f896c admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:16.209905 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72e04d-b015-4964-8d23-98672f2f896c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:16.210183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72e04d-b015-4964-8d23-98672f2f896c admin admin] PATH_INFO: `/v3/projects/297cd2b584b04d0886a955b2390aad07/users/98ca44ec1ed047f68bd2cc8eb9f37b67/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:16.228663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72e04d-b015-4964-8d23-98672f2f896c admin admin] RBAC: Authorizing `identity:create_grant(project_id=297cd2b584b04d0886a955b2390aad07, user_id=98ca44ec1ed047f68bd2cc8eb9f37b67, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:16.232797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72e04d-b015-4964-8d23-98672f2f896c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:16.252517 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 981/1945] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:16 2022] PUT /identity/v3/projects/297cd2b584b04d0886a955b2390aad07/users/98ca44ec1ed047f68bd2cc8eb9f37b67/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:16.253424 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72e04d-b015-4964-8d23-98672f2f896c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:16.276470 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:16.301319 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 965/1946] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:16 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:16.302655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164112f3-cbd4-422b-9dd6-2e25c8611a71 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:16.303510 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164112f3-cbd4-422b-9dd6-2e25c8611a71 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:16.303794 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164112f3-cbd4-422b-9dd6-2e25c8611a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:16.349233 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-164112f3-cbd4-422b-9dd6-2e25c8611a71 None None] MFA Rules not processed for user `98ca44ec1ed047f68bd2cc8eb9f37b67`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:16.350539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-164112f3-cbd4-422b-9dd6-2e25c8611a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:16.351937 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:16.395159 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72e04d-b015-4964-8d23-98672f2f896c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:16.402472 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10c0aa-89a7-4663-93e1-fddb122bf5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:16.403429 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10c0aa-89a7-4663-93e1-fddb122bf5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:16.403793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10c0aa-89a7-4663-93e1-fddb122bf5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:16.404032 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10c0aa-89a7-4663-93e1-fddb122bf5f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:16.404829 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10c0aa-89a7-4663-93e1-fddb122bf5f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:06:16.405144 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10c0aa-89a7-4663-93e1-fddb122bf5f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:16.408564 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10c0aa-89a7-4663-93e1-fddb122bf5f9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:16.431576 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 982/1947] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:06:16.433974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10c0aa-89a7-4663-93e1-fddb122bf5f9 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:16.436852 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-af10c0aa-89a7-4663-93e1-fddb122bf5f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:16.463331 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 966/1948] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:16.464311 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164112f3-cbd4-422b-9dd6-2e25c8611a71 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:16.477638 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164112f3-cbd4-422b-9dd6-2e25c8611a71 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:16.503244 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929eaf6-f725-41a3-ae8b-2c0ee82898ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:16.504204 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929eaf6-f725-41a3-ae8b-2c0ee82898ab admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:16.507656 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929eaf6-f725-41a3-ae8b-2c0ee82898ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:16.508066 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929eaf6-f725-41a3-ae8b-2c0ee82898ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:16.508887 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929eaf6-f725-41a3-ae8b-2c0ee82898ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:16.511742 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929eaf6-f725-41a3-ae8b-2c0ee82898ab admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:16.518145 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10c0aa-89a7-4663-93e1-fddb122bf5f9 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:16.523117 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f35aa2-d934-4f74-afce-e1c00593fb9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:16.523980 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f35aa2-d934-4f74-afce-e1c00593fb9c service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:16.524547 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f35aa2-d934-4f74-afce-e1c00593fb9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:16.524980 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f35aa2-d934-4f74-afce-e1c00593fb9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:16.569931 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 967/1949] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:06:16 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:16.571009 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929eaf6-f725-41a3-ae8b-2c0ee82898ab admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:16.637342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f35aa2-d934-4f74-afce-e1c00593fb9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:16.638927 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f35aa2-d934-4f74-afce-e1c00593fb9c service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:16.660106 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929eaf6-f725-41a3-ae8b-2c0ee82898ab admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:16.667175 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436747a-1fd8-4715-b734-36d0c97e7a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:16.667562 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 983/1950] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:16 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:16.667804 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436747a-1fd8-4715-b734-36d0c97e7a23 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:16.668293 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436747a-1fd8-4715-b734-36d0c97e7a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:16.668435 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f35aa2-d934-4f74-afce-e1c00593fb9c service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:16.668910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436747a-1fd8-4715-b734-36d0c97e7a23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:16.669676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436747a-1fd8-4715-b734-36d0c97e7a23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:16.672287 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436747a-1fd8-4715-b734-36d0c97e7a23 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:16.684807 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f35aa2-d934-4f74-afce-e1c00593fb9c service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:16.690653 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956597e-ffee-4e29-9ead-ce47a6730281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:16.692365 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956597e-ffee-4e29-9ead-ce47a6730281 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:16.692927 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956597e-ffee-4e29-9ead-ce47a6730281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:16.693248 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956597e-ffee-4e29-9ead-ce47a6730281 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:16.694070 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956597e-ffee-4e29-9ead-ce47a6730281 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:16.696688 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956597e-ffee-4e29-9ead-ce47a6730281 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:16.710541 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 968/1951] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:06:16 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:16.714792 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436747a-1fd8-4715-b734-36d0c97e7a23 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:16.749527 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 984/1952] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:06:16 2022] POST /identity/v3/users => generated 286 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:16.753724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956597e-ffee-4e29-9ead-ce47a6730281 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:16.771130 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:16.772642 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956597e-ffee-4e29-9ead-ce47a6730281 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:16.793287 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436747a-1fd8-4715-b734-36d0c97e7a23 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:16.798681 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67093d-52e6-4310-9b90-a51a2f71f5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:16.799570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67093d-52e6-4310-9b90-a51a2f71f5bd admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:16.799958 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67093d-52e6-4310-9b90-a51a2f71f5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:16.800339 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67093d-52e6-4310-9b90-a51a2f71f5bd admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:16.801128 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67093d-52e6-4310-9b90-a51a2f71f5bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:16.803791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67093d-52e6-4310-9b90-a51a2f71f5bd admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:16.829496 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 969/1953] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:06:16 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:16.829496 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67093d-52e6-4310-9b90-a51a2f71f5bd admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:16.850558 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843ee69-bbfa-4b5d-900b-4f4714095702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:16.851260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843ee69-bbfa-4b5d-900b-4f4714095702 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:16.851542 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843ee69-bbfa-4b5d-900b-4f4714095702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:16.851813 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843ee69-bbfa-4b5d-900b-4f4714095702 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:16.852535 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843ee69-bbfa-4b5d-900b-4f4714095702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:16.854113 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843ee69-bbfa-4b5d-900b-4f4714095702 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:16.855617 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:16.867656 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 985/1954] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:16.868830 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843ee69-bbfa-4b5d-900b-4f4714095702 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:16.881388 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843ee69-bbfa-4b5d-900b-4f4714095702 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:16.886273 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eff27f-3eca-4ccb-a3cc-d24d9f866112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:16.887233 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eff27f-3eca-4ccb-a3cc-d24d9f866112 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:16.887742 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eff27f-3eca-4ccb-a3cc-d24d9f866112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:16.888335 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eff27f-3eca-4ccb-a3cc-d24d9f866112 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:16.889234 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eff27f-3eca-4ccb-a3cc-d24d9f866112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:16.890919 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eff27f-3eca-4ccb-a3cc-d24d9f866112 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:16.895067 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67093d-52e6-4310-9b90-a51a2f71f5bd admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:16.901363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff1844-5775-4be5-b5c6-5203f371387b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:16.902214 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff1844-5775-4be5-b5c6-5203f371387b service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:16.902640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff1844-5775-4be5-b5c6-5203f371387b service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:16.902755 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 986/1955] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:16.903272 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff1844-5775-4be5-b5c6-5203f371387b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:16.903776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eff27f-3eca-4ccb-a3cc-d24d9f866112 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:16.905861 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6cff1844-5775-4be5-b5c6-5203f371387b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:16.916192 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eff27f-3eca-4ccb-a3cc-d24d9f866112 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:16.921951 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076db70-ac94-4127-9282-a0ca6ac91177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:16.922832 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076db70-ac94-4127-9282-a0ca6ac91177 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:16.923259 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076db70-ac94-4127-9282-a0ca6ac91177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:16.923636 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076db70-ac94-4127-9282-a0ca6ac91177 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:16.924463 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076db70-ac94-4127-9282-a0ca6ac91177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:16.926156 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076db70-ac94-4127-9282-a0ca6ac91177 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:16.940455 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 987/1956] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:16.941554 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076db70-ac94-4127-9282-a0ca6ac91177 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:16.959322 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076db70-ac94-4127-9282-a0ca6ac91177 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:16.964657 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab1747-a3e7-4a3b-a6d2-cb21bc01672b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:16.965795 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab1747-a3e7-4a3b-a6d2-cb21bc01672b admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:16.966151 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab1747-a3e7-4a3b-a6d2-cb21bc01672b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:16.966525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab1747-a3e7-4a3b-a6d2-cb21bc01672b admin admin] PATH_INFO: `/v3/projects/69ac8dedf30040d08314bceaf82ba7f1/users/702d45daec434c0681ff72fe6c154c0a/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:16.979376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff1844-5775-4be5-b5c6-5203f371387b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:16.981116 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff1844-5775-4be5-b5c6-5203f371387b service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:16.986590 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab1747-a3e7-4a3b-a6d2-cb21bc01672b admin admin] RBAC: Authorizing `identity:create_grant(project_id=69ac8dedf30040d08314bceaf82ba7f1, user_id=702d45daec434c0681ff72fe6c154c0a, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:16.989865 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab1747-a3e7-4a3b-a6d2-cb21bc01672b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:16.991889 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 970/1957] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:16 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:17.006783 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff1844-5775-4be5-b5c6-5203f371387b service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:17.011263 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 988/1958] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:16 2022] PUT /identity/v3/projects/69ac8dedf30040d08314bceaf82ba7f1/users/702d45daec434c0681ff72fe6c154c0a/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:17.014815 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab1747-a3e7-4a3b-a6d2-cb21bc01672b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:17.027501 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff1844-5775-4be5-b5c6-5203f371387b service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:17.120322 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870e93c-6a53-45f2-bcdc-f7c0049099dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:17.121654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870e93c-6a53-45f2-bcdc-f7c0049099dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:17.121947 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870e93c-6a53-45f2-bcdc-f7c0049099dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:17.122355 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870e93c-6a53-45f2-bcdc-f7c0049099dd admin admin] PATH_INFO: `/v3/projects/44fb147b1dd247c69c4b0f29d0d2ef69/users/14b46f07032f4b36a7f5e72ea422e2ea/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:17.139708 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870e93c-6a53-45f2-bcdc-f7c0049099dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=44fb147b1dd247c69c4b0f29d0d2ef69, user_id=14b46f07032f4b36a7f5e72ea422e2ea, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:17.141244 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab1747-a3e7-4a3b-a6d2-cb21bc01672b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:17.143925 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870e93c-6a53-45f2-bcdc-f7c0049099dd admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:17.147131 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a9ed5-4df9-4db8-9ca9-ba529d2bf87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:17.147849 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a9ed5-4df9-4db8-9ca9-ba529d2bf87d admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:17.148152 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a9ed5-4df9-4db8-9ca9-ba529d2bf87d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:17.148420 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a9ed5-4df9-4db8-9ca9-ba529d2bf87d admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:17.149170 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a9ed5-4df9-4db8-9ca9-ba529d2bf87d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:17.150937 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a9ed5-4df9-4db8-9ca9-ba529d2bf87d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:17.162699 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 971/1959] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:16 2022] PUT /identity/v3/projects/44fb147b1dd247c69c4b0f29d0d2ef69/users/14b46f07032f4b36a7f5e72ea422e2ea/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:17.166145 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 989/1960] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 15:06:17.174170 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcc119-c90f-4e3b-a87a-9f08f874c6c1 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:17.174721 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcc119-c90f-4e3b-a87a-9f08f874c6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:17.175057 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcc119-c90f-4e3b-a87a-9f08f874c6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:17.176244 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a9ed5-4df9-4db8-9ca9-ba529d2bf87d admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:17.191155 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a9ed5-4df9-4db8-9ca9-ba529d2bf87d admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:17.194958 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:17.206119 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-abfcc119-c90f-4e3b-a87a-9f08f874c6c1 None None] MFA Rules not processed for user `14b46f07032f4b36a7f5e72ea422e2ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:17.208327 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-abfcc119-c90f-4e3b-a87a-9f08f874c6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:17.274749 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fffdd59-a497-41b3-9ed8-51a3a1fc178a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:17.275796 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffdd59-a497-41b3-9ed8-51a3a1fc178a admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:17.276087 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffdd59-a497-41b3-9ed8-51a3a1fc178a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:17.276414 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffdd59-a497-41b3-9ed8-51a3a1fc178a admin admin] PATH_INFO: `/v3/projects/69ac8dedf30040d08314bceaf82ba7f1/users/702d45daec434c0681ff72fe6c154c0a/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:17.278711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fffdd59-a497-41b3-9ed8-51a3a1fc178a admin admin] RBAC: Authorizing `identity:create_grant(project_id=69ac8dedf30040d08314bceaf82ba7f1, user_id=702d45daec434c0681ff72fe6c154c0a, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:17.281548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fffdd59-a497-41b3-9ed8-51a3a1fc178a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:17.299322 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 990/1961] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:17 2022] PUT /identity/v3/projects/69ac8dedf30040d08314bceaf82ba7f1/users/702d45daec434c0681ff72fe6c154c0a/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:17.315893 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c2b9f-b76a-4cf4-8c06-54611fc13e5e None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:17.315893 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c2b9f-b76a-4cf4-8c06-54611fc13e5e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:17.315893 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c2b9f-b76a-4cf4-8c06-54611fc13e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:17.319558 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 972/1962] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:17.344120 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcc119-c90f-4e3b-a87a-9f08f874c6c1 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:17.348319 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-abfcc119-c90f-4e3b-a87a-9f08f874c6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:17.363394 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b22c2b9f-b76a-4cf4-8c06-54611fc13e5e None None] MFA Rules not processed for user `702d45daec434c0681ff72fe6c154c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:17.378070 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b22c2b9f-b76a-4cf4-8c06-54611fc13e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:17.427875 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:17.496637 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 991/1963] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:17.497641 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcc119-c90f-4e3b-a87a-9f08f874c6c1 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:17.512124 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c2b9f-b76a-4cf4-8c06-54611fc13e5e None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:17.564413 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95518ef-d018-496b-b687-43947cbe489d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:17.565692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95518ef-d018-496b-b687-43947cbe489d service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:17.565988 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95518ef-d018-496b-b687-43947cbe489d service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:17.566268 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95518ef-d018-496b-b687-43947cbe489d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:17.582092 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c2b9f-b76a-4cf4-8c06-54611fc13e5e None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:17.586420 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd071a-3e17-403c-81b1-14f33aef62ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:17.590369 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd071a-3e17-403c-81b1-14f33aef62ce service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:17.590369 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd071a-3e17-403c-81b1-14f33aef62ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:17.590369 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd071a-3e17-403c-81b1-14f33aef62ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:17.598975 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd071a-3e17-403c-81b1-14f33aef62ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:17.600552 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd071a-3e17-403c-81b1-14f33aef62ce service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:17.611342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 992/1964] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 15:06:17.639780 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95518ef-d018-496b-b687-43947cbe489d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:17.642308 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95518ef-d018-496b-b687-43947cbe489d service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:17.663804 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 973/1965] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:18.604466 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd071a-3e17-403c-81b1-14f33aef62ce service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:18.617937 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd071a-3e17-403c-81b1-14f33aef62ce service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:18.630975 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276845cf-e183-418e-a2f3-2b76857c0c7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:18.631757 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276845cf-e183-418e-a2f3-2b76857c0c7b service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:18.632042 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276845cf-e183-418e-a2f3-2b76857c0c7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:18.632319 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276845cf-e183-418e-a2f3-2b76857c0c7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:18.634665 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-276845cf-e183-418e-a2f3-2b76857c0c7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:18.710868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276845cf-e183-418e-a2f3-2b76857c0c7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:18.721500 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276845cf-e183-418e-a2f3-2b76857c0c7b service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:18.736946 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 993/1966] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 15:06:19.483223 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95518ef-d018-496b-b687-43947cbe489d service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:19.484833 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f95518ef-d018-496b-b687-43947cbe489d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:19.500486 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:19.575564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95518ef-d018-496b-b687-43947cbe489d service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:19.583282 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14d362-4a7c-498e-9712-0e48d29892c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:19.584461 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14d362-4a7c-498e-9712-0e48d29892c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:19.584785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14d362-4a7c-498e-9712-0e48d29892c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:19.585067 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14d362-4a7c-498e-9712-0e48d29892c5 admin admin] PATH_INFO: `/v3/users/ac5426e3747048019e4c3c54c8ec274e` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:19.586317 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14d362-4a7c-498e-9712-0e48d29892c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac5426e3747048019e4c3c54c8ec274e)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:19.588316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14d362-4a7c-498e-9712-0e48d29892c5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:19.651471 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9e14d362-4a7c-498e-9712-0e48d29892c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac5426e3747048019e4c3c54c8ec274e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:19.659318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9e14d362-4a7c-498e-9712-0e48d29892c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac5426e3747048019e4c3c54c8ec274e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:19.685908 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9e14d362-4a7c-498e-9712-0e48d29892c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac5426e3747048019e4c3c54c8ec274e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:19.686967 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9e14d362-4a7c-498e-9712-0e48d29892c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac5426e3747048019e4c3c54c8ec274e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:19.687731 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9e14d362-4a7c-498e-9712-0e48d29892c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac5426e3747048019e4c3c54c8ec274e'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:19.706677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 974/1967] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:06:19 2022] DELETE /identity/v3/users/ac5426e3747048019e4c3c54c8ec274e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:19.711258 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ecb2d7-2373-4ea4-9263-d0f114c3b0a3 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:19.712120 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ecb2d7-2373-4ea4-9263-d0f114c3b0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:19.712625 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ecb2d7-2373-4ea4-9263-d0f114c3b0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:19.749242 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d7ecb2d7-2373-4ea4-9263-d0f114c3b0a3 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:19.750879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d7ecb2d7-2373-4ea4-9263-d0f114c3b0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:19.845981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 994/1968] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:06:19.859979 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14d362-4a7c-498e-9712-0e48d29892c5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:19.861429 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9e14d362-4a7c-498e-9712-0e48d29892c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:19.952874 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14d362-4a7c-498e-9712-0e48d29892c5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:19.961023 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c8348-e72f-4db3-9c6f-d3638c729715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:19.961782 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c8348-e72f-4db3-9c6f-d3638c729715 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:19.962008 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c8348-e72f-4db3-9c6f-d3638c729715 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:19.962288 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c8348-e72f-4db3-9c6f-d3638c729715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:19.978368 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c8348-e72f-4db3-9c6f-d3638c729715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:19.979951 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c8348-e72f-4db3-9c6f-d3638c729715 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:19.992282 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 975/1969] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:20.476670 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ecb2d7-2373-4ea4-9263-d0f114c3b0a3 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:20.478412 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d7ecb2d7-2373-4ea4-9263-d0f114c3b0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:20.491966 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ecb2d7-2373-4ea4-9263-d0f114c3b0a3 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:20.496864 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd2483-15ae-466a-a31e-9273c8a845d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:20.498141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd2483-15ae-466a-a31e-9273c8a845d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:20.498454 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd2483-15ae-466a-a31e-9273c8a845d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:20.499554 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd2483-15ae-466a-a31e-9273c8a845d7 admin admin] PATH_INFO: `/v3/projects/0eaceba4a952435ba0fef07cceb9e5db` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:20.500771 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd2483-15ae-466a-a31e-9273c8a845d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eaceba4a952435ba0fef07cceb9e5db)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:20.502838 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd2483-15ae-466a-a31e-9273c8a845d7 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:20.504559 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:20.553503 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-85dd2483-15ae-466a-a31e-9273c8a845d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eaceba4a952435ba0fef07cceb9e5db', 'request_id': 'req-85dd2483-15ae-466a-a31e-9273c8a845d7'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:20.559862 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-85dd2483-15ae-466a-a31e-9273c8a845d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eaceba4a952435ba0fef07cceb9e5db', 'request_id': 'req-85dd2483-15ae-466a-a31e-9273c8a845d7'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:20.566671 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-85dd2483-15ae-466a-a31e-9273c8a845d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eaceba4a952435ba0fef07cceb9e5db', 'request_id': 'req-85dd2483-15ae-466a-a31e-9273c8a845d7'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:20.580410 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-85dd2483-15ae-466a-a31e-9273c8a845d7 admin admin] The token cache is being invalidate because project 0eaceba4a952435ba0fef07cceb9e5db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:06:20.580702 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-85dd2483-15ae-466a-a31e-9273c8a845d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:20.581331 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-85dd2483-15ae-466a-a31e-9273c8a845d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:20.583187 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 995/1970] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:06:20 2022] DELETE /identity/v3/projects/0eaceba4a952435ba0fef07cceb9e5db => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:20.590047 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a09cb-4f74-4883-885c-8ef4bcbe5915 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:20.590728 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a09cb-4f74-4883-885c-8ef4bcbe5915 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:20.590826 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a09cb-4f74-4883-885c-8ef4bcbe5915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:20.609764 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-536a09cb-4f74-4883-885c-8ef4bcbe5915 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:20.611102 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-536a09cb-4f74-4883-885c-8ef4bcbe5915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:20.640893 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:20.680818 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 976/1971] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:20.688907 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e58695-d6ac-4fee-b425-e127a87746b2 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:20.689228 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e58695-d6ac-4fee-b425-e127a87746b2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:20.689471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e58695-d6ac-4fee-b425-e127a87746b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:20.709452 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-81e58695-d6ac-4fee-b425-e127a87746b2 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:20.710709 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-81e58695-d6ac-4fee-b425-e127a87746b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:20.718637 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 996/1972] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:20.723015 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a09cb-4f74-4883-885c-8ef4bcbe5915 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:20.732782 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a09cb-4f74-4883-885c-8ef4bcbe5915 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:20.737355 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce97184-6e0b-4872-a122-6965752504ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:20.738004 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce97184-6e0b-4872-a122-6965752504ba admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:20.738289 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce97184-6e0b-4872-a122-6965752504ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:20.738566 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce97184-6e0b-4872-a122-6965752504ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:20.739331 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce97184-6e0b-4872-a122-6965752504ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:06:20.739644 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce97184-6e0b-4872-a122-6965752504ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:20.741764 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce97184-6e0b-4872-a122-6965752504ba admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:20.753410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 977/1973] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:06:20.758073 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e58695-d6ac-4fee-b425-e127a87746b2 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:20.767906 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e58695-d6ac-4fee-b425-e127a87746b2 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:20.772595 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b818b0-51fe-4d3e-9d46-622bd26d6318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:20.773248 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b818b0-51fe-4d3e-9d46-622bd26d6318 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:20.773532 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b818b0-51fe-4d3e-9d46-622bd26d6318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:20.773811 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b818b0-51fe-4d3e-9d46-622bd26d6318 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:20.774503 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b818b0-51fe-4d3e-9d46-622bd26d6318 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:20.776441 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b818b0-51fe-4d3e-9d46-622bd26d6318 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:20.800701 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 997/1974] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:06:20 2022] POST /identity/v3/projects => generated 363 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:20.805250 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce97184-6e0b-4872-a122-6965752504ba admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:20.815422 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce97184-6e0b-4872-a122-6965752504ba admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:20.871103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce28e9-3147-4fda-b44b-aaf0b333c0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:20.871817 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce28e9-3147-4fda-b44b-aaf0b333c0c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:20.872092 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce28e9-3147-4fda-b44b-aaf0b333c0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:20.872370 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce28e9-3147-4fda-b44b-aaf0b333c0c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:20.873059 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce28e9-3147-4fda-b44b-aaf0b333c0c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:20.874982 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce28e9-3147-4fda-b44b-aaf0b333c0c9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:20.894762 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 978/1975] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:06:20 2022] POST /identity/v3/users => generated 282 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:20.898871 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b818b0-51fe-4d3e-9d46-622bd26d6318 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:20.909036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b818b0-51fe-4d3e-9d46-622bd26d6318 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:20.913621 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b230d-d707-4b99-9f5f-0ed4f5b97ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:20.914269 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b230d-d707-4b99-9f5f-0ed4f5b97ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:20.914554 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b230d-d707-4b99-9f5f-0ed4f5b97ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:20.914840 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b230d-d707-4b99-9f5f-0ed4f5b97ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:20.915603 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b230d-d707-4b99-9f5f-0ed4f5b97ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:20.917196 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b230d-d707-4b99-9f5f-0ed4f5b97ca2 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:20.927402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 998/1976] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:20.931565 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce28e9-3147-4fda-b44b-aaf0b333c0c9 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:20.941359 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce28e9-3147-4fda-b44b-aaf0b333c0c9 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:20.946547 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e11f8-d49c-4d20-a39d-a9bdfac120d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:20.947235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e11f8-d49c-4d20-a39d-a9bdfac120d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:20.947524 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e11f8-d49c-4d20-a39d-a9bdfac120d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:20.947808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e11f8-d49c-4d20-a39d-a9bdfac120d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:20.948533 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e11f8-d49c-4d20-a39d-a9bdfac120d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:20.950463 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e11f8-d49c-4d20-a39d-a9bdfac120d3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:20.960343 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 979/1977] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:20.964471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b230d-d707-4b99-9f5f-0ed4f5b97ca2 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:20.974272 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b230d-d707-4b99-9f5f-0ed4f5b97ca2 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:20.979026 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c29ba-c959-4fb0-8f80-cdd8bcef77e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:20.979952 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c29ba-c959-4fb0-8f80-cdd8bcef77e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:20.980235 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c29ba-c959-4fb0-8f80-cdd8bcef77e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:20.980513 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c29ba-c959-4fb0-8f80-cdd8bcef77e1 admin admin] PATH_INFO: `/v3/projects/f5114816fa9a41afb81957930a2ded12/users/d61127ff76414a27900dea9e42198bf7/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:20.995374 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c29ba-c959-4fb0-8f80-cdd8bcef77e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5114816fa9a41afb81957930a2ded12, user_id=d61127ff76414a27900dea9e42198bf7, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:20.998275 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c29ba-c959-4fb0-8f80-cdd8bcef77e1 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:21.011788 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 999/1978] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:20 2022] PUT /identity/v3/projects/f5114816fa9a41afb81957930a2ded12/users/d61127ff76414a27900dea9e42198bf7/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:21.021823 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa1332-32ea-4c75-a35d-25aa7723d671 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:21.022323 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa1332-32ea-4c75-a35d-25aa7723d671 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:21.022829 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa1332-32ea-4c75-a35d-25aa7723d671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:21.058880 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-83fa1332-32ea-4c75-a35d-25aa7723d671 None None] MFA Rules not processed for user `d61127ff76414a27900dea9e42198bf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:21.060152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-83fa1332-32ea-4c75-a35d-25aa7723d671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:21.126496 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 980/1979] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:21 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:21.138263 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c29ba-c959-4fb0-8f80-cdd8bcef77e1 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:21.139922 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-574c29ba-c959-4fb0-8f80-cdd8bcef77e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:21.197504 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c29ba-c959-4fb0-8f80-cdd8bcef77e1 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:21.201524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46413be-a9f9-4e09-b8e0-bc910d155b88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:21.202176 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46413be-a9f9-4e09-b8e0-bc910d155b88 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:21.202469 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46413be-a9f9-4e09-b8e0-bc910d155b88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:21.202757 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46413be-a9f9-4e09-b8e0-bc910d155b88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:21.211152 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46413be-a9f9-4e09-b8e0-bc910d155b88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:21.212606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46413be-a9f9-4e09-b8e0-bc910d155b88 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:21.221944 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1000/1980] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:21 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:21.246679 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa1332-32ea-4c75-a35d-25aa7723d671 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:21.248578 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-83fa1332-32ea-4c75-a35d-25aa7723d671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:21.300564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:21.360027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46413be-a9f9-4e09-b8e0-bc910d155b88 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:21.361562 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a46413be-a9f9-4e09-b8e0-bc910d155b88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:21.377070 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa1332-32ea-4c75-a35d-25aa7723d671 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:21.379489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46413be-a9f9-4e09-b8e0-bc910d155b88 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:21.384091 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff7540-d3de-4c7a-96ce-cbb56e76d4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:21.385129 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff7540-d3de-4c7a-96ce-cbb56e76d4de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:21.385421 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff7540-d3de-4c7a-96ce-cbb56e76d4de admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:21.385705 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff7540-d3de-4c7a-96ce-cbb56e76d4de admin admin] PATH_INFO: `/v3/users/14b46f07032f4b36a7f5e72ea422e2ea` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:21.385856 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707cad24-4076-4455-a5a9-5fcac92de343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:21.387329 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cad24-4076-4455-a5a9-5fcac92de343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:21.387735 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff7540-d3de-4c7a-96ce-cbb56e76d4de admin admin] RBAC: Authorizing `identity:delete_user(user_id=14b46f07032f4b36a7f5e72ea422e2ea)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:21.387935 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cad24-4076-4455-a5a9-5fcac92de343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:21.388330 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cad24-4076-4455-a5a9-5fcac92de343 admin admin] PATH_INFO: `/v3/users/6fd4224fba43405cb6b2432b97d516d5` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:21.390216 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707cad24-4076-4455-a5a9-5fcac92de343 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fd4224fba43405cb6b2432b97d516d5)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:21.390442 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff7540-d3de-4c7a-96ce-cbb56e76d4de admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:21.392586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707cad24-4076-4455-a5a9-5fcac92de343 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:21.440420 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:21.494057 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-70ff7540-d3de-4c7a-96ce-cbb56e76d4de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14b46f07032f4b36a7f5e72ea422e2ea'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:21.503542 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-707cad24-4076-4455-a5a9-5fcac92de343 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fd4224fba43405cb6b2432b97d516d5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:21.504932 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-707cad24-4076-4455-a5a9-5fcac92de343 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fd4224fba43405cb6b2432b97d516d5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:21.505619 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-707cad24-4076-4455-a5a9-5fcac92de343 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fd4224fba43405cb6b2432b97d516d5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:21.510223 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-70ff7540-d3de-4c7a-96ce-cbb56e76d4de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14b46f07032f4b36a7f5e72ea422e2ea'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:21.520217 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-707cad24-4076-4455-a5a9-5fcac92de343 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fd4224fba43405cb6b2432b97d516d5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:21.538550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-70ff7540-d3de-4c7a-96ce-cbb56e76d4de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14b46f07032f4b36a7f5e72ea422e2ea'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:21.539444 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-70ff7540-d3de-4c7a-96ce-cbb56e76d4de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14b46f07032f4b36a7f5e72ea422e2ea'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:21.541367 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-70ff7540-d3de-4c7a-96ce-cbb56e76d4de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14b46f07032f4b36a7f5e72ea422e2ea'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:21.548660 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-707cad24-4076-4455-a5a9-5fcac92de343 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fd4224fba43405cb6b2432b97d516d5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:21.570878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 981/1981] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:06:21 2022] DELETE /identity/v3/users/14b46f07032f4b36a7f5e72ea422e2ea => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:06:21.571884 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1001/1982] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:06:21 2022] DELETE /identity/v3/users/6fd4224fba43405cb6b2432b97d516d5 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:06:21.576203 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e8014-1504-4dc4-b626-59b274f63823 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:21.576670 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e8014-1504-4dc4-b626-59b274f63823 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:21.577095 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e8014-1504-4dc4-b626-59b274f63823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:21.580003 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434761e5-1a4d-4c06-979e-710e58153143 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:21.580405 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434761e5-1a4d-4c06-979e-710e58153143 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:21.580828 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434761e5-1a4d-4c06-979e-710e58153143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:21.598861 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-786e8014-1504-4dc4-b626-59b274f63823 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:21.602651 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-786e8014-1504-4dc4-b626-59b274f63823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:21.627143 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-434761e5-1a4d-4c06-979e-710e58153143 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:21.628733 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-434761e5-1a4d-4c06-979e-710e58153143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:21.723123 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 982/1983] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:06:21.734040 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e8014-1504-4dc4-b626-59b274f63823 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:21.735702 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-786e8014-1504-4dc4-b626-59b274f63823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:21.763887 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1002/1984] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:21.774612 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434761e5-1a4d-4c06-979e-710e58153143 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:21.776247 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-434761e5-1a4d-4c06-979e-710e58153143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:21.837256 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:21.871535 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434761e5-1a4d-4c06-979e-710e58153143 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:21.875767 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a767cd-0e44-46ba-9b59-47a2a2803540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:21.876488 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a767cd-0e44-46ba-9b59-47a2a2803540 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:21.876918 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a767cd-0e44-46ba-9b59-47a2a2803540 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:21.877159 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a767cd-0e44-46ba-9b59-47a2a2803540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:21.880567 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e8014-1504-4dc4-b626-59b274f63823 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:21.890215 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c531d-1f12-4057-abfc-1f910d1eb086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:21.890886 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c531d-1f12-4057-abfc-1f910d1eb086 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:21.890998 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a767cd-0e44-46ba-9b59-47a2a2803540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:21.891171 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c531d-1f12-4057-abfc-1f910d1eb086 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:21.891473 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c531d-1f12-4057-abfc-1f910d1eb086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:21.893386 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a767cd-0e44-46ba-9b59-47a2a2803540 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:21.907260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1003/1985] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:21.909428 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c531d-1f12-4057-abfc-1f910d1eb086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:21.910951 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c531d-1f12-4057-abfc-1f910d1eb086 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:21.931542 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 983/1986] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:22.219458 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a767cd-0e44-46ba-9b59-47a2a2803540 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:22.221068 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-48a767cd-0e44-46ba-9b59-47a2a2803540 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:22.235848 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a767cd-0e44-46ba-9b59-47a2a2803540 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:22.242469 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558a4d5-0ae4-4a2f-84cd-8621c4c19b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:22.243541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558a4d5-0ae4-4a2f-84cd-8621c4c19b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:22.243976 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558a4d5-0ae4-4a2f-84cd-8621c4c19b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:22.244356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558a4d5-0ae4-4a2f-84cd-8621c4c19b00 admin admin] PATH_INFO: `/v3/projects/44fb147b1dd247c69c4b0f29d0d2ef69` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:22.246043 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558a4d5-0ae4-4a2f-84cd-8621c4c19b00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44fb147b1dd247c69c4b0f29d0d2ef69)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:22.248214 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558a4d5-0ae4-4a2f-84cd-8621c4c19b00 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:22.304719 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:22.310057 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b558a4d5-0ae4-4a2f-84cd-8621c4c19b00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44fb147b1dd247c69c4b0f29d0d2ef69', 'request_id': 'req-b558a4d5-0ae4-4a2f-84cd-8621c4c19b00'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:22.321365 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b558a4d5-0ae4-4a2f-84cd-8621c4c19b00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44fb147b1dd247c69c4b0f29d0d2ef69', 'request_id': 'req-b558a4d5-0ae4-4a2f-84cd-8621c4c19b00'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:22.331556 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b558a4d5-0ae4-4a2f-84cd-8621c4c19b00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44fb147b1dd247c69c4b0f29d0d2ef69', 'request_id': 'req-b558a4d5-0ae4-4a2f-84cd-8621c4c19b00'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:22.354713 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b558a4d5-0ae4-4a2f-84cd-8621c4c19b00 admin admin] The token cache is being invalidate because project 44fb147b1dd247c69c4b0f29d0d2ef69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:06:22.355081 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b558a4d5-0ae4-4a2f-84cd-8621c4c19b00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:22.355800 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b558a4d5-0ae4-4a2f-84cd-8621c4c19b00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:22.357653 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1004/1987] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:06:22 2022] DELETE /identity/v3/projects/44fb147b1dd247c69c4b0f29d0d2ef69 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:22.362513 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c1da4-300f-4bd2-b1ca-531378f7dcff None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:22.362881 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c1da4-300f-4bd2-b1ca-531378f7dcff None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:22.363280 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c1da4-300f-4bd2-b1ca-531378f7dcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:22.386185 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-fa6c1da4-300f-4bd2-b1ca-531378f7dcff None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:22.387670 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fa6c1da4-300f-4bd2-b1ca-531378f7dcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:22.401677 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558a4d5-0ae4-4a2f-84cd-8621c4c19b00 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:22.403656 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b558a4d5-0ae4-4a2f-84cd-8621c4c19b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:22.464821 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 984/1988] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:22.473317 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d559e74-fc6f-4d6f-bae3-888a8bfd3ac3 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:22.475861 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d559e74-fc6f-4d6f-bae3-888a8bfd3ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:22.475861 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d559e74-fc6f-4d6f-bae3-888a8bfd3ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:22.495295 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-6d559e74-fc6f-4d6f-bae3-888a8bfd3ac3 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:22.496678 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6d559e74-fc6f-4d6f-bae3-888a8bfd3ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:22.501472 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558a4d5-0ae4-4a2f-84cd-8621c4c19b00 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:22.504943 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 985/1989] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:06:22.507759 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3768a-aaff-45f8-8e82-34658b22eb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:22.508874 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3768a-aaff-45f8-8e82-34658b22eb68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:22.509268 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3768a-aaff-45f8-8e82-34658b22eb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:22.509383 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d559e74-fc6f-4d6f-bae3-888a8bfd3ac3 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:22.510574 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3768a-aaff-45f8-8e82-34658b22eb68 admin admin] PATH_INFO: `/v3/projects/d1b180f339154875ac1d6f6ae5e79b57` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:22.511987 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3768a-aaff-45f8-8e82-34658b22eb68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1b180f339154875ac1d6f6ae5e79b57)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:22.515349 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3768a-aaff-45f8-8e82-34658b22eb68 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:22.518867 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d559e74-fc6f-4d6f-bae3-888a8bfd3ac3 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:22.524170 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e80524-4e5b-4917-9302-9a657a9b5986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:22.524833 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e80524-4e5b-4917-9302-9a657a9b5986 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:22.525116 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e80524-4e5b-4917-9302-9a657a9b5986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:22.525419 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e80524-4e5b-4917-9302-9a657a9b5986 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:22.526152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e80524-4e5b-4917-9302-9a657a9b5986 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:06:22.526455 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e80524-4e5b-4917-9302-9a657a9b5986 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:22.528191 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e80524-4e5b-4917-9302-9a657a9b5986 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:22.543382 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 986/1990] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 15:06:22.545880 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e80524-4e5b-4917-9302-9a657a9b5986 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:22.564309 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e80524-4e5b-4917-9302-9a657a9b5986 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:22.576858 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-89f3768a-aaff-45f8-8e82-34658b22eb68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1b180f339154875ac1d6f6ae5e79b57', 'request_id': 'req-89f3768a-aaff-45f8-8e82-34658b22eb68'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:22.588202 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-89f3768a-aaff-45f8-8e82-34658b22eb68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1b180f339154875ac1d6f6ae5e79b57', 'request_id': 'req-89f3768a-aaff-45f8-8e82-34658b22eb68'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:22.595406 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-89f3768a-aaff-45f8-8e82-34658b22eb68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1b180f339154875ac1d6f6ae5e79b57', 'request_id': 'req-89f3768a-aaff-45f8-8e82-34658b22eb68'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:22.614588 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-89f3768a-aaff-45f8-8e82-34658b22eb68 admin admin] The token cache is being invalidate because project d1b180f339154875ac1d6f6ae5e79b57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:06:22.614882 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-89f3768a-aaff-45f8-8e82-34658b22eb68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:22.615747 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-89f3768a-aaff-45f8-8e82-34658b22eb68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:22.620827 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1005/1991] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:06:22 2022] DELETE /identity/v3/projects/d1b180f339154875ac1d6f6ae5e79b57 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:06:22.621847 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3768a-aaff-45f8-8e82-34658b22eb68 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:22.623400 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-89f3768a-aaff-45f8-8e82-34658b22eb68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:22.640577 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c5937-6523-4b10-945d-1692b424d21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:22.641400 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c5937-6523-4b10-945d-1692b424d21c admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:22.641798 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c5937-6523-4b10-945d-1692b424d21c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:22.642174 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c5937-6523-4b10-945d-1692b424d21c admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:22.642966 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c5937-6523-4b10-945d-1692b424d21c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:22.645021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c5937-6523-4b10-945d-1692b424d21c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:22.683370 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 987/1992] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:06:22 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:22.687288 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c5937-6523-4b10-945d-1692b424d21c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:22.689150 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e85c5937-6523-4b10-945d-1692b424d21c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:22.705904 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:22.713440 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3768a-aaff-45f8-8e82-34658b22eb68 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:22.786590 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:22.792749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c5937-6523-4b10-945d-1692b424d21c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:22.803025 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d28567-cf4a-426a-9328-a5a8747b60d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:22.803863 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d28567-cf4a-426a-9328-a5a8747b60d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:22.804230 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d28567-cf4a-426a-9328-a5a8747b60d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:22.804767 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d28567-cf4a-426a-9328-a5a8747b60d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:22.805673 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d28567-cf4a-426a-9328-a5a8747b60d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:22.808847 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d28567-cf4a-426a-9328-a5a8747b60d3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:22.826732 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e59fae-d808-4747-b91c-a794beeaa28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:22.830020 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e59fae-d808-4747-b91c-a794beeaa28a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:22.830422 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e59fae-d808-4747-b91c-a794beeaa28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:22.830677 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e59fae-d808-4747-b91c-a794beeaa28a admin admin] PATH_INFO: `/v3/users/4ab5d0cbdbfb47ee948d563c19706666` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:22.833283 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e59fae-d808-4747-b91c-a794beeaa28a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ab5d0cbdbfb47ee948d563c19706666)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:22.836031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e59fae-d808-4747-b91c-a794beeaa28a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:22.844285 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 988/1993] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:06:22 2022] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:22.849070 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d28567-cf4a-426a-9328-a5a8747b60d3 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:22.870157 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d28567-cf4a-426a-9328-a5a8747b60d3 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:22.878631 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699277cc-670e-4431-88e0-e5341832e518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:22.879362 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699277cc-670e-4431-88e0-e5341832e518 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:22.879654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699277cc-670e-4431-88e0-e5341832e518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:22.879936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699277cc-670e-4431-88e0-e5341832e518 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:22.881208 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699277cc-670e-4431-88e0-e5341832e518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:22.883017 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699277cc-670e-4431-88e0-e5341832e518 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:22.898531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 989/1994] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:22.899474 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699277cc-670e-4431-88e0-e5341832e518 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:22.906718 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a9e59fae-d808-4747-b91c-a794beeaa28a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ab5d0cbdbfb47ee948d563c19706666'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:22.907466 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a9e59fae-d808-4747-b91c-a794beeaa28a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ab5d0cbdbfb47ee948d563c19706666'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:22.908100 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a9e59fae-d808-4747-b91c-a794beeaa28a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ab5d0cbdbfb47ee948d563c19706666'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:22.923538 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699277cc-670e-4431-88e0-e5341832e518 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:22.928589 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a9e59fae-d808-4747-b91c-a794beeaa28a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ab5d0cbdbfb47ee948d563c19706666'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:22.942827 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60205f87-b9f9-47e2-a714-6d6f32c26cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:22.944244 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60205f87-b9f9-47e2-a714-6d6f32c26cea admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:22.944543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60205f87-b9f9-47e2-a714-6d6f32c26cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:22.944830 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60205f87-b9f9-47e2-a714-6d6f32c26cea admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:22.945573 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60205f87-b9f9-47e2-a714-6d6f32c26cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:22.947739 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60205f87-b9f9-47e2-a714-6d6f32c26cea admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:22.964734 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 990/1995] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:22.967243 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60205f87-b9f9-47e2-a714-6d6f32c26cea admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:22.972714 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-60205f87-b9f9-47e2-a714-6d6f32c26cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:22.974566 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a9e59fae-d808-4747-b91c-a794beeaa28a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ab5d0cbdbfb47ee948d563c19706666'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:23.012409 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1006/1996] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:06:22 2022] DELETE /identity/v3/users/4ab5d0cbdbfb47ee948d563c19706666 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:23.022260 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60205f87-b9f9-47e2-a714-6d6f32c26cea admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:23.185560 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b0a24-114b-4047-b3fd-9a26c9348ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:23.186481 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b0a24-114b-4047-b3fd-9a26c9348ea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:23.186773 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b0a24-114b-4047-b3fd-9a26c9348ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:23.187056 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b0a24-114b-4047-b3fd-9a26c9348ea6 admin admin] PATH_INFO: `/v3/projects/b40b205b11294061b645361a5b491525/users/870bf3565a9248bb9663dd6fe4cc23bf/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:23.215860 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b0a24-114b-4047-b3fd-9a26c9348ea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b40b205b11294061b645361a5b491525, user_id=870bf3565a9248bb9663dd6fe4cc23bf, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:23.218550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b0a24-114b-4047-b3fd-9a26c9348ea6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:23.256740 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 991/1997] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:22 2022] PUT /identity/v3/projects/b40b205b11294061b645361a5b491525/users/870bf3565a9248bb9663dd6fe4cc23bf/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:23.257952 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34e631-3d75-460d-972c-6c97756708f9 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:23.258193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34e631-3d75-460d-972c-6c97756708f9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:23.258475 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34e631-3d75-460d-972c-6c97756708f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:23.303647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-1a34e631-3d75-460d-972c-6c97756708f9 None None] MFA Rules not processed for user `870bf3565a9248bb9663dd6fe4cc23bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:23.305294 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1a34e631-3d75-460d-972c-6c97756708f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:23.338786 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b0a24-114b-4047-b3fd-9a26c9348ea6 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:23.340955 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a59b0a24-114b-4047-b3fd-9a26c9348ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:23.420234 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b0a24-114b-4047-b3fd-9a26c9348ea6 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:23.426596 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0ef6d-c07b-453b-9745-05120ce52487 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:23.427433 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0ef6d-c07b-453b-9745-05120ce52487 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:23.428403 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0ef6d-c07b-453b-9745-05120ce52487 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:23.428861 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0ef6d-c07b-453b-9745-05120ce52487 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:23.431463 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7ef0ef6d-c07b-453b-9745-05120ce52487 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:23.432538 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1007/1998] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:23.437138 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34e631-3d75-460d-972c-6c97756708f9 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:23.457282 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:23.531090 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0ef6d-c07b-453b-9745-05120ce52487 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:23.533272 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0ef6d-c07b-453b-9745-05120ce52487 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:23.546177 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:23.550086 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34e631-3d75-460d-972c-6c97756708f9 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:23.553294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 992/1999] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 15:06:23.558150 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5978b20-6f9b-45f2-8198-bc8797b33952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:23.559096 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5978b20-6f9b-45f2-8198-bc8797b33952 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:23.559514 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5978b20-6f9b-45f2-8198-bc8797b33952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:23.559817 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5978b20-6f9b-45f2-8198-bc8797b33952 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:23.560590 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5978b20-6f9b-45f2-8198-bc8797b33952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:23.562669 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5978b20-6f9b-45f2-8198-bc8797b33952 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:23.598363 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1008/2000] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:06:23 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:23.603251 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0ef6d-c07b-453b-9745-05120ce52487 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:23.618152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0ef6d-c07b-453b-9745-05120ce52487 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:23.700896 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4e6d8-d018-4ec2-a198-9dca71188274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:23.701972 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4e6d8-d018-4ec2-a198-9dca71188274 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:23.702301 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4e6d8-d018-4ec2-a198-9dca71188274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:23.702588 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4e6d8-d018-4ec2-a198-9dca71188274 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:23.703975 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4e6d8-d018-4ec2-a198-9dca71188274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:23.706283 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4e6d8-d018-4ec2-a198-9dca71188274 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:23.744235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 993/2001] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:06:23 2022] POST /identity/v3/users => generated 289 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:06:23.748217 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5978b20-6f9b-45f2-8198-bc8797b33952 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:23.763504 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5978b20-6f9b-45f2-8198-bc8797b33952 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:23.777543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86245b-7125-4733-8901-53eb796b0448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:23.778620 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86245b-7125-4733-8901-53eb796b0448 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:23.779359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86245b-7125-4733-8901-53eb796b0448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:23.779704 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86245b-7125-4733-8901-53eb796b0448 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:23.780528 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86245b-7125-4733-8901-53eb796b0448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:23.782704 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86245b-7125-4733-8901-53eb796b0448 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:23.796089 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1009/2002] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 15:06:23.801313 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4e6d8-d018-4ec2-a198-9dca71188274 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:23.817288 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4e6d8-d018-4ec2-a198-9dca71188274 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:23.827189 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bfcb3-6fe1-4c69-831a-02375dad32f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:23.830862 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bfcb3-6fe1-4c69-831a-02375dad32f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:23.831427 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bfcb3-6fe1-4c69-831a-02375dad32f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:23.832164 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bfcb3-6fe1-4c69-831a-02375dad32f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:23.833060 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bfcb3-6fe1-4c69-831a-02375dad32f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:23.835350 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bfcb3-6fe1-4c69-831a-02375dad32f6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:23.855412 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 994/2003] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:23.859323 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86245b-7125-4733-8901-53eb796b0448 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:23.874491 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86245b-7125-4733-8901-53eb796b0448 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:23.884185 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61559f96-d652-4c6e-8537-b4dd29f38335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:23.885445 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61559f96-d652-4c6e-8537-b4dd29f38335 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:23.885977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61559f96-d652-4c6e-8537-b4dd29f38335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:23.886267 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61559f96-d652-4c6e-8537-b4dd29f38335 admin admin] PATH_INFO: `/v3/projects/ca303777064e44309b13be93ae81307a/users/dcd1544faab0412db3b47dfb471f54d5/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:23.913033 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61559f96-d652-4c6e-8537-b4dd29f38335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca303777064e44309b13be93ae81307a, user_id=dcd1544faab0412db3b47dfb471f54d5, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:23.915888 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61559f96-d652-4c6e-8537-b4dd29f38335 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:23.936942 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1010/2004] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:23 2022] PUT /identity/v3/projects/ca303777064e44309b13be93ae81307a/users/dcd1544faab0412db3b47dfb471f54d5/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:23.949625 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124f964-2c34-4ece-a612-e3638e255fae None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:23.950038 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124f964-2c34-4ece-a612-e3638e255fae None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:23.950446 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124f964-2c34-4ece-a612-e3638e255fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:23.984662 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7124f964-2c34-4ece-a612-e3638e255fae None None] MFA Rules not processed for user `dcd1544faab0412db3b47dfb471f54d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:23.986139 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7124f964-2c34-4ece-a612-e3638e255fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:24.080245 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 995/2005] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:24.088051 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61559f96-d652-4c6e-8537-b4dd29f38335 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:24.175886 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124f964-2c34-4ece-a612-e3638e255fae None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:24.178212 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7124f964-2c34-4ece-a612-e3638e255fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:24.220556 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61559f96-d652-4c6e-8537-b4dd29f38335 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:24.226012 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0bbbc-cf48-48bc-a680-fc5b3376db19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:24.226958 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0bbbc-cf48-48bc-a680-fc5b3376db19 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:24.227334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0bbbc-cf48-48bc-a680-fc5b3376db19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:24.227618 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0bbbc-cf48-48bc-a680-fc5b3376db19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:24.228903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0bbbc-cf48-48bc-a680-fc5b3376db19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:24.231708 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0bbbc-cf48-48bc-a680-fc5b3376db19 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:24.297690 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1011/2006] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:06:24 2022] POST /identity/v3/projects => generated 375 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:24.301652 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0bbbc-cf48-48bc-a680-fc5b3376db19 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:24.356651 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124f964-2c34-4ece-a612-e3638e255fae None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:24.379715 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:24.419844 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:24.436114 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0bbbc-cf48-48bc-a680-fc5b3376db19 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:24.449663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b61d5-76db-4b93-b882-f027ca50e902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:24.451912 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b61d5-76db-4b93-b882-f027ca50e902 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:24.452281 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b61d5-76db-4b93-b882-f027ca50e902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:24.454919 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b61d5-76db-4b93-b882-f027ca50e902 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:24.455872 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b61d5-76db-4b93-b882-f027ca50e902 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:24.461042 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b61d5-76db-4b93-b882-f027ca50e902 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:24.484817 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530cfdf-c263-4f17-9cf5-51ddb5c1a1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:24.485823 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530cfdf-c263-4f17-9cf5-51ddb5c1a1a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:24.486120 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530cfdf-c263-4f17-9cf5-51ddb5c1a1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:24.486474 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530cfdf-c263-4f17-9cf5-51ddb5c1a1a2 admin admin] PATH_INFO: `/v3/projects/19980ac457ef4b3080815f2f5fcdc45a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:24.488341 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530cfdf-c263-4f17-9cf5-51ddb5c1a1a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19980ac457ef4b3080815f2f5fcdc45a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:24.492470 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530cfdf-c263-4f17-9cf5-51ddb5c1a1a2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:24.517387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1012/2007] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:06:24 2022] POST /identity/v3/users => generated 294 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:24.522986 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b61d5-76db-4b93-b882-f027ca50e902 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:24.535517 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b61d5-76db-4b93-b882-f027ca50e902 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:24.560090 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e530cfdf-c263-4f17-9cf5-51ddb5c1a1a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19980ac457ef4b3080815f2f5fcdc45a', 'request_id': 'req-e530cfdf-c263-4f17-9cf5-51ddb5c1a1a2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:24.573621 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e530cfdf-c263-4f17-9cf5-51ddb5c1a1a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19980ac457ef4b3080815f2f5fcdc45a', 'request_id': 'req-e530cfdf-c263-4f17-9cf5-51ddb5c1a1a2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:24.586871 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e530cfdf-c263-4f17-9cf5-51ddb5c1a1a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19980ac457ef4b3080815f2f5fcdc45a', 'request_id': 'req-e530cfdf-c263-4f17-9cf5-51ddb5c1a1a2'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:24.601920 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e530cfdf-c263-4f17-9cf5-51ddb5c1a1a2 admin admin] The token cache is being invalidate because project 19980ac457ef4b3080815f2f5fcdc45a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:06:24.602800 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e530cfdf-c263-4f17-9cf5-51ddb5c1a1a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:24.603733 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e530cfdf-c263-4f17-9cf5-51ddb5c1a1a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:24.605661 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 996/2008] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:06:24 2022] DELETE /identity/v3/projects/19980ac457ef4b3080815f2f5fcdc45a => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:24.612022 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2563679-d710-4747-bb5f-331fe90a2976 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:24.613064 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2563679-d710-4747-bb5f-331fe90a2976 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:24.613583 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2563679-d710-4747-bb5f-331fe90a2976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:24.626422 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed59a7c-52dd-49b5-be34-acbe8ad199a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:24.627409 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed59a7c-52dd-49b5-be34-acbe8ad199a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:24.627888 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed59a7c-52dd-49b5-be34-acbe8ad199a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:24.628262 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed59a7c-52dd-49b5-be34-acbe8ad199a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:24.629150 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed59a7c-52dd-49b5-be34-acbe8ad199a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:24.631471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed59a7c-52dd-49b5-be34-acbe8ad199a9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:24.642484 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b2563679-d710-4747-bb5f-331fe90a2976 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:24.643788 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1013/2009] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:24.644529 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b2563679-d710-4747-bb5f-331fe90a2976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:24.649345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed59a7c-52dd-49b5-be34-acbe8ad199a9 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:24.653422 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-fed59a7c-52dd-49b5-be34-acbe8ad199a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:24.658926 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 997/2010] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:06:24.667380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a6f49-b52e-4a7a-876a-f5cdb9c3e3aa None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:24.668170 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a6f49-b52e-4a7a-876a-f5cdb9c3e3aa None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:24.668537 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a6f49-b52e-4a7a-876a-f5cdb9c3e3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:24.671124 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed59a7c-52dd-49b5-be34-acbe8ad199a9 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:24.677225 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb28a5-e1ec-4823-a056-2c97e628ab7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:24.678412 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb28a5-e1ec-4823-a056-2c97e628ab7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:24.678790 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb28a5-e1ec-4823-a056-2c97e628ab7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:24.679145 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb28a5-e1ec-4823-a056-2c97e628ab7a admin admin] PATH_INFO: `/v3/projects/08ac2c40cddc49afa037e197e149dd9c/users/74c7e46d043b42fc8b8fc4a6d29ca3cb/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:24.699380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-6d2a6f49-b52e-4a7a-876a-f5cdb9c3e3aa None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:24.700968 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb28a5-e1ec-4823-a056-2c97e628ab7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=08ac2c40cddc49afa037e197e149dd9c, user_id=74c7e46d043b42fc8b8fc4a6d29ca3cb, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:24.701401 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6d2a6f49-b52e-4a7a-876a-f5cdb9c3e3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:24.704497 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb28a5-e1ec-4823-a056-2c97e628ab7a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:24.716799 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 998/2011] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:06:24.722313 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a6f49-b52e-4a7a-876a-f5cdb9c3e3aa None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:24.743380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a6f49-b52e-4a7a-876a-f5cdb9c3e3aa None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:24.743961 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1014/2012] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:24 2022] PUT /identity/v3/projects/08ac2c40cddc49afa037e197e149dd9c/users/74c7e46d043b42fc8b8fc4a6d29ca3cb/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:06:24.748006 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb28a5-e1ec-4823-a056-2c97e628ab7a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:24.827247 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764850f-7ecc-49fe-abfb-7f9b264a5736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:24.828586 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764850f-7ecc-49fe-abfb-7f9b264a5736 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:24.828586 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764850f-7ecc-49fe-abfb-7f9b264a5736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:24.828779 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764850f-7ecc-49fe-abfb-7f9b264a5736 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:24.829584 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764850f-7ecc-49fe-abfb-7f9b264a5736 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:06:24.829781 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764850f-7ecc-49fe-abfb-7f9b264a5736 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:24.831887 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764850f-7ecc-49fe-abfb-7f9b264a5736 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:24.839753 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb28a5-e1ec-4823-a056-2c97e628ab7a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:24.850846 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca80495-f031-4238-9b2b-f46271c54ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:24.851913 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca80495-f031-4238-9b2b-f46271c54ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:24.852416 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca80495-f031-4238-9b2b-f46271c54ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:24.852929 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca80495-f031-4238-9b2b-f46271c54ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:24.854613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca80495-f031-4238-9b2b-f46271c54ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:24.857310 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca80495-f031-4238-9b2b-f46271c54ec0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:24.863295 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 999/2013] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:06:24.868776 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764850f-7ecc-49fe-abfb-7f9b264a5736 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:24.873376 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1015/2014] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:24.877947 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca80495-f031-4238-9b2b-f46271c54ec0 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:24.883739 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764850f-7ecc-49fe-abfb-7f9b264a5736 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:24.893185 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643cc708-04f7-4f37-8250-ef447460d806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:24.894005 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cc708-04f7-4f37-8250-ef447460d806 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:24.894299 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cc708-04f7-4f37-8250-ef447460d806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:24.894582 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cc708-04f7-4f37-8250-ef447460d806 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:24.895310 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643cc708-04f7-4f37-8250-ef447460d806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:24.897980 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643cc708-04f7-4f37-8250-ef447460d806 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:24.901653 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca80495-f031-4238-9b2b-f46271c54ec0 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:24.909327 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa433b1d-1fbd-49f5-a944-0e61c7c486d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:24.910639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa433b1d-1fbd-49f5-a944-0e61c7c486d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:24.911157 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa433b1d-1fbd-49f5-a944-0e61c7c486d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:24.911705 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa433b1d-1fbd-49f5-a944-0e61c7c486d2 admin admin] PATH_INFO: `/v3/projects/08ac2c40cddc49afa037e197e149dd9c/users/74c7e46d043b42fc8b8fc4a6d29ca3cb/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:24.914097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa433b1d-1fbd-49f5-a944-0e61c7c486d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08ac2c40cddc49afa037e197e149dd9c, user_id=74c7e46d043b42fc8b8fc4a6d29ca3cb, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:24.917154 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa433b1d-1fbd-49f5-a944-0e61c7c486d2 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:24.931423 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1016/2015] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:24 2022] PUT /identity/v3/projects/08ac2c40cddc49afa037e197e149dd9c/users/74c7e46d043b42fc8b8fc4a6d29ca3cb/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:24.942033 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aca777-3b0d-44c4-85ac-09be48efce9c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:24.942033 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aca777-3b0d-44c4-85ac-09be48efce9c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:24.942033 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aca777-3b0d-44c4-85ac-09be48efce9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:24.947236 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1000/2016] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:06:24 2022] POST /identity/v3/projects => generated 381 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:24.950738 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643cc708-04f7-4f37-8250-ef447460d806 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:24.966945 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:24.996186 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-33aca777-3b0d-44c4-85ac-09be48efce9c None None] MFA Rules not processed for user `74c7e46d043b42fc8b8fc4a6d29ca3cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:24.997842 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-33aca777-3b0d-44c4-85ac-09be48efce9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:25.033428 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:25.119081 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643cc708-04f7-4f37-8250-ef447460d806 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:25.124358 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d1bcd-13a8-4ec5-8ab6-6389c896a32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:25.125151 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d1bcd-13a8-4ec5-8ab6-6389c896a32c admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:25.125512 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d1bcd-13a8-4ec5-8ab6-6389c896a32c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:25.125868 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d1bcd-13a8-4ec5-8ab6-6389c896a32c admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:25.126628 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d1bcd-13a8-4ec5-8ab6-6389c896a32c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:25.128682 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d1bcd-13a8-4ec5-8ab6-6389c896a32c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:25.148253 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1017/2017] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:06:25.157460 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1001/2018] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:06:24 2022] POST /identity/v3/users => generated 291 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:25.162716 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aca777-3b0d-44c4-85ac-09be48efce9c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:25.162852 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d1bcd-13a8-4ec5-8ab6-6389c896a32c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:25.165266 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-549d1bcd-13a8-4ec5-8ab6-6389c896a32c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:25.175940 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aca777-3b0d-44c4-85ac-09be48efce9c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:25.187810 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bcf844-c91c-473c-ac55-a60a71ded41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:25.189096 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcf844-c91c-473c-ac55-a60a71ded41b admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:25.189702 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcf844-c91c-473c-ac55-a60a71ded41b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:25.190204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcf844-c91c-473c-ac55-a60a71ded41b admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:25.191432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bcf844-c91c-473c-ac55-a60a71ded41b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:25.195463 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bcf844-c91c-473c-ac55-a60a71ded41b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:25.213572 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1018/2019] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:25.217504 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bcf844-c91c-473c-ac55-a60a71ded41b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:25.228061 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bcf844-c91c-473c-ac55-a60a71ded41b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:25.233604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358d32c-939e-49e9-8307-14ab35aab383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:25.234371 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358d32c-939e-49e9-8307-14ab35aab383 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:25.234903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358d32c-939e-49e9-8307-14ab35aab383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:25.235218 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358d32c-939e-49e9-8307-14ab35aab383 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:25.236009 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358d32c-939e-49e9-8307-14ab35aab383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:25.237832 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358d32c-939e-49e9-8307-14ab35aab383 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:25.250610 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1019/2020] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 15:06:25.254767 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358d32c-939e-49e9-8307-14ab35aab383 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:25.257525 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d1bcd-13a8-4ec5-8ab6-6389c896a32c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:25.263154 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113a423-c1d9-475c-9c73-11a598d097fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:25.263154 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113a423-c1d9-475c-9c73-11a598d097fa service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:25.263435 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113a423-c1d9-475c-9c73-11a598d097fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:25.263687 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113a423-c1d9-475c-9c73-11a598d097fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:25.266298 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6113a423-c1d9-475c-9c73-11a598d097fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:25.266864 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358d32c-939e-49e9-8307-14ab35aab383 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:25.272290 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84233924-2ba7-41ad-aad2-809eac634aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:25.273189 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84233924-2ba7-41ad-aad2-809eac634aac admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:25.273475 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84233924-2ba7-41ad-aad2-809eac634aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:25.273759 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84233924-2ba7-41ad-aad2-809eac634aac admin admin] PATH_INFO: `/v3/projects/bb3d6ea860b74d85ab5b0dcbc9f80106/users/7bb52ba0869c421a8cb9798e4e69b5b5/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:25.290867 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84233924-2ba7-41ad-aad2-809eac634aac admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb3d6ea860b74d85ab5b0dcbc9f80106, user_id=7bb52ba0869c421a8cb9798e4e69b5b5, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:25.293603 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84233924-2ba7-41ad-aad2-809eac634aac admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:25.319284 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1020/2021] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:25 2022] PUT /identity/v3/projects/bb3d6ea860b74d85ab5b0dcbc9f80106/users/7bb52ba0869c421a8cb9798e4e69b5b5/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:06:25.332832 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe180352-235b-4c3b-8c68-cac85e5f8e31 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:25.333122 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe180352-235b-4c3b-8c68-cac85e5f8e31 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:25.333403 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe180352-235b-4c3b-8c68-cac85e5f8e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:25.357130 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6113a423-c1d9-475c-9c73-11a598d097fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:25.358615 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6113a423-c1d9-475c-9c73-11a598d097fa service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:25.363299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-fe180352-235b-4c3b-8c68-cac85e5f8e31 None None] MFA Rules not processed for user `7bb52ba0869c421a8cb9798e4e69b5b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:25.364682 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-fe180352-235b-4c3b-8c68-cac85e5f8e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:25.369709 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1002/2022] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:25.441649 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1021/2023] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:25.447163 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113a423-c1d9-475c-9c73-11a598d097fa service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:25.459817 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113a423-c1d9-475c-9c73-11a598d097fa service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:25.515665 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:25.535407 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0e74f-e5b3-4954-bc89-2f405b6255ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:25.539388 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0e74f-e5b3-4954-bc89-2f405b6255ea admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:25.539831 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0e74f-e5b3-4954-bc89-2f405b6255ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:25.540636 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0e74f-e5b3-4954-bc89-2f405b6255ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:25.541560 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0e74f-e5b3-4954-bc89-2f405b6255ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:25.543956 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0e74f-e5b3-4954-bc89-2f405b6255ea admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:25.595768 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1003/2024] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:06:25 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:25.600931 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe180352-235b-4c3b-8c68-cac85e5f8e31 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:25.616393 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe180352-235b-4c3b-8c68-cac85e5f8e31 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:25.732230 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb56fe1-4af4-42eb-bdf5-df65a4c29399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:25.735326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb56fe1-4af4-42eb-bdf5-df65a4c29399 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:25.735847 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb56fe1-4af4-42eb-bdf5-df65a4c29399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:25.736227 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb56fe1-4af4-42eb-bdf5-df65a4c29399 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:25.737175 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb56fe1-4af4-42eb-bdf5-df65a4c29399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:25.739329 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb56fe1-4af4-42eb-bdf5-df65a4c29399 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:25.749414 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:25.766624 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1022/2025] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:06:25 2022] POST /identity/v3/users => generated 295 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:25.770261 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0e74f-e5b3-4954-bc89-2f405b6255ea admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:25.787765 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0e74f-e5b3-4954-bc89-2f405b6255ea admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:25.792748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946e58a-6ab3-423b-bd1c-126fe097cad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:25.793570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946e58a-6ab3-423b-bd1c-126fe097cad5 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:25.793959 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946e58a-6ab3-423b-bd1c-126fe097cad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:25.794335 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946e58a-6ab3-423b-bd1c-126fe097cad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:25.795154 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946e58a-6ab3-423b-bd1c-126fe097cad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:25.796903 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946e58a-6ab3-423b-bd1c-126fe097cad5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:25.812423 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1004/2026] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:25.814994 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb56fe1-4af4-42eb-bdf5-df65a4c29399 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:25.825507 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb56fe1-4af4-42eb-bdf5-df65a4c29399 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:25.830608 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7ebaa-7cb6-4c32-b3a0-fe65bd8c9401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:25.831627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7ebaa-7cb6-4c32-b3a0-fe65bd8c9401 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:25.831973 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7ebaa-7cb6-4c32-b3a0-fe65bd8c9401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:25.832315 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7ebaa-7cb6-4c32-b3a0-fe65bd8c9401 admin admin] PATH_INFO: `/v3/projects/8ea9ac12ae1e4cfdaddab0a0c07c8922/users/98498500a1934e7baafcb3adb9d89920/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:25.851520 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7ebaa-7cb6-4c32-b3a0-fe65bd8c9401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ea9ac12ae1e4cfdaddab0a0c07c8922, user_id=98498500a1934e7baafcb3adb9d89920, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:25.854836 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7ebaa-7cb6-4c32-b3a0-fe65bd8c9401 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:25.875728 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1023/2027] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:25 2022] PUT /identity/v3/projects/8ea9ac12ae1e4cfdaddab0a0c07c8922/users/98498500a1934e7baafcb3adb9d89920/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:25.879684 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946e58a-6ab3-423b-bd1c-126fe097cad5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:25.895007 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946e58a-6ab3-423b-bd1c-126fe097cad5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:25.976463 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b43a2-c006-4d91-af87-54b1eed57407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:25.977402 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b43a2-c006-4d91-af87-54b1eed57407 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:25.977854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b43a2-c006-4d91-af87-54b1eed57407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:25.978311 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b43a2-c006-4d91-af87-54b1eed57407 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:25.979634 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b43a2-c006-4d91-af87-54b1eed57407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:25.981591 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b43a2-c006-4d91-af87-54b1eed57407 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:25.995026 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1005/2028] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 15:06:25.999576 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7ebaa-7cb6-4c32-b3a0-fe65bd8c9401 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:26.010829 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7ebaa-7cb6-4c32-b3a0-fe65bd8c9401 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:26.016553 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2cfac-496e-4281-9f75-215f0f92ed71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:26.017460 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2cfac-496e-4281-9f75-215f0f92ed71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:26.017742 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2cfac-496e-4281-9f75-215f0f92ed71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:26.018020 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2cfac-496e-4281-9f75-215f0f92ed71 admin admin] PATH_INFO: `/v3/projects/8ea9ac12ae1e4cfdaddab0a0c07c8922/users/98498500a1934e7baafcb3adb9d89920/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:26.020315 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2cfac-496e-4281-9f75-215f0f92ed71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ea9ac12ae1e4cfdaddab0a0c07c8922, user_id=98498500a1934e7baafcb3adb9d89920, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:26.023586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2cfac-496e-4281-9f75-215f0f92ed71 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:26.039247 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1024/2029] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:25 2022] PUT /identity/v3/projects/8ea9ac12ae1e4cfdaddab0a0c07c8922/users/98498500a1934e7baafcb3adb9d89920/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:26.047280 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c0d74-97d7-402d-873b-1d4f4a12722c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:26.047623 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c0d74-97d7-402d-873b-1d4f4a12722c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:26.047856 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c0d74-97d7-402d-873b-1d4f4a12722c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:26.101673 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e52c0d74-97d7-402d-873b-1d4f4a12722c None None] MFA Rules not processed for user `98498500a1934e7baafcb3adb9d89920`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:26.103236 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e52c0d74-97d7-402d-873b-1d4f4a12722c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:26.216945 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1006/2030] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:26.309918 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2cfac-496e-4281-9f75-215f0f92ed71 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:26.312131 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-cdd2cfac-496e-4281-9f75-215f0f92ed71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:26.420541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2cfac-496e-4281-9f75-215f0f92ed71 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:26.424539 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae501aa-e765-4ede-9ab2-84dc9c44d537 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:26.425179 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae501aa-e765-4ede-9ab2-84dc9c44d537 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:26.425473 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae501aa-e765-4ede-9ab2-84dc9c44d537 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:26.425742 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae501aa-e765-4ede-9ab2-84dc9c44d537 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:26.440458 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae501aa-e765-4ede-9ab2-84dc9c44d537 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:26.441997 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae501aa-e765-4ede-9ab2-84dc9c44d537 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:26.454380 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1025/2031] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:26 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:26.535124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c0d74-97d7-402d-873b-1d4f4a12722c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:26.536795 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e52c0d74-97d7-402d-873b-1d4f4a12722c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:26.649378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:26.696824 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c0d74-97d7-402d-873b-1d4f4a12722c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:26.703751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e99fbc-42eb-49a1-8e7f-ad60791037bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:26.704837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e99fbc-42eb-49a1-8e7f-ad60791037bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:26.705119 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e99fbc-42eb-49a1-8e7f-ad60791037bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:26.705431 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e99fbc-42eb-49a1-8e7f-ad60791037bd admin admin] PATH_INFO: `/v3/users/9e890cde47c04431bf7bab48f5a0d569` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:26.712515 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e99fbc-42eb-49a1-8e7f-ad60791037bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e890cde47c04431bf7bab48f5a0d569)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:26.715005 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e99fbc-42eb-49a1-8e7f-ad60791037bd admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:26.814584 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d3e99fbc-42eb-49a1-8e7f-ad60791037bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e890cde47c04431bf7bab48f5a0d569'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:26.824985 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d3e99fbc-42eb-49a1-8e7f-ad60791037bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e890cde47c04431bf7bab48f5a0d569'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:26.851083 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d3e99fbc-42eb-49a1-8e7f-ad60791037bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e890cde47c04431bf7bab48f5a0d569'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:26.851961 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d3e99fbc-42eb-49a1-8e7f-ad60791037bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e890cde47c04431bf7bab48f5a0d569'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:26.852812 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d3e99fbc-42eb-49a1-8e7f-ad60791037bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e890cde47c04431bf7bab48f5a0d569'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:26.874862 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1007/2032] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:06:26 2022] DELETE /identity/v3/users/9e890cde47c04431bf7bab48f5a0d569 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:26.879652 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edd85b-6544-406c-a0a4-0e0fc3f774b4 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:26.881172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edd85b-6544-406c-a0a4-0e0fc3f774b4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:26.882336 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edd85b-6544-406c-a0a4-0e0fc3f774b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:26.909838 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a4edd85b-6544-406c-a0a4-0e0fc3f774b4 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:26.911380 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a4edd85b-6544-406c-a0a4-0e0fc3f774b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:26.992809 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1026/2033] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:27.004001 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e99fbc-42eb-49a1-8e7f-ad60791037bd admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:27.005552 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d3e99fbc-42eb-49a1-8e7f-ad60791037bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:27.011297 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4edd85b-6544-406c-a0a4-0e0fc3f774b4 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:27.015268 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a4edd85b-6544-406c-a0a4-0e0fc3f774b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:27.026909 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4edd85b-6544-406c-a0a4-0e0fc3f774b4 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:27.032959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263a6ec-115d-4c81-a847-dd62b447e566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:27.034124 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263a6ec-115d-4c81-a847-dd62b447e566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:27.034541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263a6ec-115d-4c81-a847-dd62b447e566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:27.034908 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263a6ec-115d-4c81-a847-dd62b447e566 admin admin] PATH_INFO: `/v3/users/7bb52ba0869c421a8cb9798e4e69b5b5` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:27.036418 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263a6ec-115d-4c81-a847-dd62b447e566 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bb52ba0869c421a8cb9798e4e69b5b5)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:27.039479 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263a6ec-115d-4c81-a847-dd62b447e566 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:27.092975 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1263a6ec-115d-4c81-a847-dd62b447e566 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bb52ba0869c421a8cb9798e4e69b5b5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:27.093647 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e99fbc-42eb-49a1-8e7f-ad60791037bd admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:27.093791 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1263a6ec-115d-4c81-a847-dd62b447e566 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bb52ba0869c421a8cb9798e4e69b5b5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:27.094307 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1263a6ec-115d-4c81-a847-dd62b447e566 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bb52ba0869c421a8cb9798e4e69b5b5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:27.097807 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e798c-1011-457d-9850-f3973d22121a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:27.098220 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:INSERT=5,keystone:SELECT=87,keystone:DELETE=8 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:27.098829 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e798c-1011-457d-9850-f3973d22121a service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:27.099136 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e798c-1011-457d-9850-f3973d22121a service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:27.100039 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e798c-1011-457d-9850-f3973d22121a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:27.102289 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3e1e798c-1011-457d-9850-f3973d22121a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:27.102799 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1263a6ec-115d-4c81-a847-dd62b447e566 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bb52ba0869c421a8cb9798e4e69b5b5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:27.115993 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e798c-1011-457d-9850-f3973d22121a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:27.116702 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1263a6ec-115d-4c81-a847-dd62b447e566 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bb52ba0869c421a8cb9798e4e69b5b5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:27.117438 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e798c-1011-457d-9850-f3973d22121a service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:27.127640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1008/2034] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:27.128585 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e798c-1011-457d-9850-f3973d22121a service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:27.130086 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3e1e798c-1011-457d-9850-f3973d22121a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:27.130199 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1027/2035] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:06:27 2022] DELETE /identity/v3/users/7bb52ba0869c421a8cb9798e4e69b5b5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:06:27.134805 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea84f9f-cf5f-43aa-8ffb-eb5e214ff5ec None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:27.135171 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea84f9f-cf5f-43aa-8ffb-eb5e214ff5ec None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:27.135410 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea84f9f-cf5f-43aa-8ffb-eb5e214ff5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:27.154932 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7ea84f9f-cf5f-43aa-8ffb-eb5e214ff5ec None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:27.156405 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7ea84f9f-cf5f-43aa-8ffb-eb5e214ff5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:27.204357 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e798c-1011-457d-9850-f3973d22121a service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:27.225238 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1028/2036] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:06:27.226200 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:27.235124 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea84f9f-cf5f-43aa-8ffb-eb5e214ff5ec None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:27.236990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7ea84f9f-cf5f-43aa-8ffb-eb5e214ff5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:27.279504 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70301b3c-1389-4647-81ea-d5e7cfe31ec0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:27.280213 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70301b3c-1389-4647-81ea-d5e7cfe31ec0 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:27.280503 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70301b3c-1389-4647-81ea-d5e7cfe31ec0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:27.280784 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70301b3c-1389-4647-81ea-d5e7cfe31ec0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:27.282797 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-70301b3c-1389-4647-81ea-d5e7cfe31ec0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:27.338002 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea84f9f-cf5f-43aa-8ffb-eb5e214ff5ec None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:27.342153 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c5843-f29a-4f0f-9760-8c7e459d9155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:27.342805 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c5843-f29a-4f0f-9760-8c7e459d9155 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:27.343090 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c5843-f29a-4f0f-9760-8c7e459d9155 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:27.343410 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c5843-f29a-4f0f-9760-8c7e459d9155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:27.352522 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70301b3c-1389-4647-81ea-d5e7cfe31ec0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:27.353834 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c5843-f29a-4f0f-9760-8c7e459d9155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:27.354207 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70301b3c-1389-4647-81ea-d5e7cfe31ec0 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:27.355703 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c5843-f29a-4f0f-9760-8c7e459d9155 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:27.366204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1029/2037] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 15:06:27.367387 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1009/2038] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:27.466620 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c5843-f29a-4f0f-9760-8c7e459d9155 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:27.468353 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0d3c5843-f29a-4f0f-9760-8c7e459d9155 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:27.489171 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c5843-f29a-4f0f-9760-8c7e459d9155 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:27.497280 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373cd15-8591-4ed9-9352-47a0274408a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:27.498648 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373cd15-8591-4ed9-9352-47a0274408a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:27.499108 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373cd15-8591-4ed9-9352-47a0274408a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:27.500199 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373cd15-8591-4ed9-9352-47a0274408a2 admin admin] PATH_INFO: `/v3/projects/3e0ec4b66c3a4d61b6e726240c659eab` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:27.502281 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373cd15-8591-4ed9-9352-47a0274408a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e0ec4b66c3a4d61b6e726240c659eab)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:27.506306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373cd15-8591-4ed9-9352-47a0274408a2 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:27.590034 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0373cd15-8591-4ed9-9352-47a0274408a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e0ec4b66c3a4d61b6e726240c659eab', 'request_id': 'req-0373cd15-8591-4ed9-9352-47a0274408a2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:27.610588 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0373cd15-8591-4ed9-9352-47a0274408a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e0ec4b66c3a4d61b6e726240c659eab', 'request_id': 'req-0373cd15-8591-4ed9-9352-47a0274408a2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:27.619700 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0373cd15-8591-4ed9-9352-47a0274408a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e0ec4b66c3a4d61b6e726240c659eab', 'request_id': 'req-0373cd15-8591-4ed9-9352-47a0274408a2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:27.624565 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:27.644193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0373cd15-8591-4ed9-9352-47a0274408a2 admin admin] The token cache is being invalidate because project 3e0ec4b66c3a4d61b6e726240c659eab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:06:27.644509 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0373cd15-8591-4ed9-9352-47a0274408a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:27.645232 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0373cd15-8591-4ed9-9352-47a0274408a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:27.647074 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1030/2039] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:06:27 2022] DELETE /identity/v3/projects/3e0ec4b66c3a4d61b6e726240c659eab => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:27.651102 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70301b3c-1389-4647-81ea-d5e7cfe31ec0 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:27.670272 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70301b3c-1389-4647-81ea-d5e7cfe31ec0 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:27.750792 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373cd15-8591-4ed9-9352-47a0274408a2 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:27.752517 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0373cd15-8591-4ed9-9352-47a0274408a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:27.779334 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08189fe-2af4-49f4-b079-e03ac12ca7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:27.782059 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08189fe-2af4-49f4-b079-e03ac12ca7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:27.783436 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08189fe-2af4-49f4-b079-e03ac12ca7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:27.783954 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08189fe-2af4-49f4-b079-e03ac12ca7fd admin admin] PATH_INFO: `/v3/users/98ca44ec1ed047f68bd2cc8eb9f37b67` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:27.785761 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08189fe-2af4-49f4-b079-e03ac12ca7fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=98ca44ec1ed047f68bd2cc8eb9f37b67)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:27.788343 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08189fe-2af4-49f4-b079-e03ac12ca7fd admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:27.873998 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c08189fe-2af4-49f4-b079-e03ac12ca7fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98ca44ec1ed047f68bd2cc8eb9f37b67'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:27.887969 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c08189fe-2af4-49f4-b079-e03ac12ca7fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98ca44ec1ed047f68bd2cc8eb9f37b67'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:27.891409 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373cd15-8591-4ed9-9352-47a0274408a2 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:27.902054 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa73858-508e-4385-92ab-420752613d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:27.904602 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa73858-508e-4385-92ab-420752613d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:27.909212 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa73858-508e-4385-92ab-420752613d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:27.909212 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa73858-508e-4385-92ab-420752613d77 admin admin] PATH_INFO: `/v3/projects/bb3d6ea860b74d85ab5b0dcbc9f80106` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:27.910606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa73858-508e-4385-92ab-420752613d77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb3d6ea860b74d85ab5b0dcbc9f80106)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:27.914019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa73858-508e-4385-92ab-420752613d77 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:27.916009 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c08189fe-2af4-49f4-b079-e03ac12ca7fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98ca44ec1ed047f68bd2cc8eb9f37b67'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:27.916772 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c08189fe-2af4-49f4-b079-e03ac12ca7fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98ca44ec1ed047f68bd2cc8eb9f37b67'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:27.917459 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c08189fe-2af4-49f4-b079-e03ac12ca7fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98ca44ec1ed047f68bd2cc8eb9f37b67'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:27.921974 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:27.941624 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1010/2040] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:06:27 2022] DELETE /identity/v3/users/98ca44ec1ed047f68bd2cc8eb9f37b67 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:28.011000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-aaa73858-508e-4385-92ab-420752613d77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb3d6ea860b74d85ab5b0dcbc9f80106', 'request_id': 'req-aaa73858-508e-4385-92ab-420752613d77'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:28.018826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-aaa73858-508e-4385-92ab-420752613d77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb3d6ea860b74d85ab5b0dcbc9f80106', 'request_id': 'req-aaa73858-508e-4385-92ab-420752613d77'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:28.026646 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-aaa73858-508e-4385-92ab-420752613d77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb3d6ea860b74d85ab5b0dcbc9f80106', 'request_id': 'req-aaa73858-508e-4385-92ab-420752613d77'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:28.046896 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-aaa73858-508e-4385-92ab-420752613d77 admin admin] The token cache is being invalidate because project bb3d6ea860b74d85ab5b0dcbc9f80106 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:06:28.047276 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-aaa73858-508e-4385-92ab-420752613d77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:28.048235 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-aaa73858-508e-4385-92ab-420752613d77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:28.053584 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1031/2041] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:06:27 2022] DELETE /identity/v3/projects/bb3d6ea860b74d85ab5b0dcbc9f80106 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:06:28.054891 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08189fe-2af4-49f4-b079-e03ac12ca7fd admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:28.056254 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c08189fe-2af4-49f4-b079-e03ac12ca7fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:28.189361 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08189fe-2af4-49f4-b079-e03ac12ca7fd admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:28.239306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa73858-508e-4385-92ab-420752613d77 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:28.244860 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-aaa73858-508e-4385-92ab-420752613d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:28.289686 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5e119-7bac-4b68-b570-0efb1be98a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:28.302834 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5e119-7bac-4b68-b570-0efb1be98a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:28.305888 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5e119-7bac-4b68-b570-0efb1be98a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:28.306572 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5e119-7bac-4b68-b570-0efb1be98a4e admin admin] PATH_INFO: `/v3/users/98498500a1934e7baafcb3adb9d89920` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:28.311860 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5e119-7bac-4b68-b570-0efb1be98a4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=98498500a1934e7baafcb3adb9d89920)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:28.315242 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5e119-7bac-4b68-b570-0efb1be98a4e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:28.376853 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa73858-508e-4385-92ab-420752613d77 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:28.380811 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0799b-05c4-4019-af2d-9807a30b510d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:28.382356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0799b-05c4-4019-af2d-9807a30b510d service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:28.382782 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0799b-05c4-4019-af2d-9807a30b510d service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:28.383162 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0799b-05c4-4019-af2d-9807a30b510d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:28.386583 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-89d0799b-05c4-4019-af2d-9807a30b510d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:28.440232 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-16d5e119-7bac-4b68-b570-0efb1be98a4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98498500a1934e7baafcb3adb9d89920'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:28.450649 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-16d5e119-7bac-4b68-b570-0efb1be98a4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98498500a1934e7baafcb3adb9d89920'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:28.455524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:28.476506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-16d5e119-7bac-4b68-b570-0efb1be98a4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98498500a1934e7baafcb3adb9d89920'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:28.477661 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-16d5e119-7bac-4b68-b570-0efb1be98a4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98498500a1934e7baafcb3adb9d89920'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:28.479587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-16d5e119-7bac-4b68-b570-0efb1be98a4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98498500a1934e7baafcb3adb9d89920'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:28.495368 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0799b-05c4-4019-af2d-9807a30b510d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:28.498082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0799b-05c4-4019-af2d-9807a30b510d service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:28.506172 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1011/2042] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:06:28 2022] DELETE /identity/v3/users/98498500a1934e7baafcb3adb9d89920 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:28.510247 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1032/2043] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:28 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:28.608134 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5e119-7bac-4b68-b570-0efb1be98a4e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:28.611807 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-16d5e119-7bac-4b68-b570-0efb1be98a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:28.657785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:28.706743 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5e119-7bac-4b68-b570-0efb1be98a4e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:28.713574 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae40aac-4629-4782-811b-850b8a6802e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:28.714533 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae40aac-4629-4782-811b-850b8a6802e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:28.714987 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae40aac-4629-4782-811b-850b8a6802e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:28.715428 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae40aac-4629-4782-811b-850b8a6802e3 admin admin] PATH_INFO: `/v3/projects/297cd2b584b04d0886a955b2390aad07` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:28.716670 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae40aac-4629-4782-811b-850b8a6802e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=297cd2b584b04d0886a955b2390aad07)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:28.718877 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae40aac-4629-4782-811b-850b8a6802e3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:28.777576 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7ae40aac-4629-4782-811b-850b8a6802e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '297cd2b584b04d0886a955b2390aad07', 'request_id': 'req-7ae40aac-4629-4782-811b-850b8a6802e3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:28.788663 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7ae40aac-4629-4782-811b-850b8a6802e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '297cd2b584b04d0886a955b2390aad07', 'request_id': 'req-7ae40aac-4629-4782-811b-850b8a6802e3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:28.797914 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7ae40aac-4629-4782-811b-850b8a6802e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '297cd2b584b04d0886a955b2390aad07', 'request_id': 'req-7ae40aac-4629-4782-811b-850b8a6802e3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:28.811500 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7ae40aac-4629-4782-811b-850b8a6802e3 admin admin] The token cache is being invalidate because project 297cd2b584b04d0886a955b2390aad07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:06:28.811979 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7ae40aac-4629-4782-811b-850b8a6802e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:28.812911 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7ae40aac-4629-4782-811b-850b8a6802e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:28.814746 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1012/2044] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:06:28 2022] DELETE /identity/v3/projects/297cd2b584b04d0886a955b2390aad07 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:28.820689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0799b-05c4-4019-af2d-9807a30b510d service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:28.822459 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-89d0799b-05c4-4019-af2d-9807a30b510d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:28.842587 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0799b-05c4-4019-af2d-9807a30b510d service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:28.920066 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b18cd-de34-46b9-8e02-7a398fbf68ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:28.921182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b18cd-de34-46b9-8e02-7a398fbf68ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:28.921589 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b18cd-de34-46b9-8e02-7a398fbf68ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:28.922015 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b18cd-de34-46b9-8e02-7a398fbf68ed admin admin] PATH_INFO: `/v3/users/702d45daec434c0681ff72fe6c154c0a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:28.923559 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b18cd-de34-46b9-8e02-7a398fbf68ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=702d45daec434c0681ff72fe6c154c0a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:28.926036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b18cd-de34-46b9-8e02-7a398fbf68ed admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:28.981874 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-040b18cd-de34-46b9-8e02-7a398fbf68ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '702d45daec434c0681ff72fe6c154c0a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:28.983623 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-040b18cd-de34-46b9-8e02-7a398fbf68ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '702d45daec434c0681ff72fe6c154c0a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:28.984465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-040b18cd-de34-46b9-8e02-7a398fbf68ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '702d45daec434c0681ff72fe6c154c0a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:28.997665 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-040b18cd-de34-46b9-8e02-7a398fbf68ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '702d45daec434c0681ff72fe6c154c0a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:29.022151 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-040b18cd-de34-46b9-8e02-7a398fbf68ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '702d45daec434c0681ff72fe6c154c0a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:29.046250 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1033/2045] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:06:28 2022] DELETE /identity/v3/users/702d45daec434c0681ff72fe6c154c0a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:29.051066 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae40aac-4629-4782-811b-850b8a6802e3 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:29.053286 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7ae40aac-4629-4782-811b-850b8a6802e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:29.072531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae40aac-4629-4782-811b-850b8a6802e3 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:29.159785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957db02-d8e5-4bac-a018-a32df3976784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:29.160788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957db02-d8e5-4bac-a018-a32df3976784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:29.163048 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957db02-d8e5-4bac-a018-a32df3976784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:29.163379 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957db02-d8e5-4bac-a018-a32df3976784 admin admin] PATH_INFO: `/v3/users/8b06fc42235a4ea08cd81b2bf6b4a4cb` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:29.164706 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957db02-d8e5-4bac-a018-a32df3976784 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b06fc42235a4ea08cd81b2bf6b4a4cb)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:29.166683 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957db02-d8e5-4bac-a018-a32df3976784 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:29.239082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b18cd-de34-46b9-8e02-7a398fbf68ed admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:29.242658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-040b18cd-de34-46b9-8e02-7a398fbf68ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:29.261974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b18cd-de34-46b9-8e02-7a398fbf68ed admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:29.265941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5957db02-d8e5-4bac-a018-a32df3976784 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b06fc42235a4ea08cd81b2bf6b4a4cb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:29.272412 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:29.275440 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5957db02-d8e5-4bac-a018-a32df3976784 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b06fc42235a4ea08cd81b2bf6b4a4cb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:29.281063 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9ef78-04ae-4571-920e-ae7e621c94a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:29.283645 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9ef78-04ae-4571-920e-ae7e621c94a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:29.292186 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9ef78-04ae-4571-920e-ae7e621c94a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:29.292482 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9ef78-04ae-4571-920e-ae7e621c94a0 admin admin] PATH_INFO: `/v3/projects/8ea9ac12ae1e4cfdaddab0a0c07c8922` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:29.296534 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9ef78-04ae-4571-920e-ae7e621c94a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ea9ac12ae1e4cfdaddab0a0c07c8922)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:29.299082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9ef78-04ae-4571-920e-ae7e621c94a0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:29.318632 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5957db02-d8e5-4bac-a018-a32df3976784 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b06fc42235a4ea08cd81b2bf6b4a4cb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:29.320649 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5957db02-d8e5-4bac-a018-a32df3976784 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b06fc42235a4ea08cd81b2bf6b4a4cb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:29.321521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5957db02-d8e5-4bac-a018-a32df3976784 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b06fc42235a4ea08cd81b2bf6b4a4cb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:29.363839 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1013/2046] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:06:29 2022] DELETE /identity/v3/users/8b06fc42235a4ea08cd81b2bf6b4a4cb => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:06:29.421331 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-54b9ef78-04ae-4571-920e-ae7e621c94a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ea9ac12ae1e4cfdaddab0a0c07c8922', 'request_id': 'req-54b9ef78-04ae-4571-920e-ae7e621c94a0'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:29.422641 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:29.431823 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-54b9ef78-04ae-4571-920e-ae7e621c94a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ea9ac12ae1e4cfdaddab0a0c07c8922', 'request_id': 'req-54b9ef78-04ae-4571-920e-ae7e621c94a0'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:29.446312 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-54b9ef78-04ae-4571-920e-ae7e621c94a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ea9ac12ae1e4cfdaddab0a0c07c8922', 'request_id': 'req-54b9ef78-04ae-4571-920e-ae7e621c94a0'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:29.464444 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957db02-d8e5-4bac-a018-a32df3976784 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:29.467106 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-54b9ef78-04ae-4571-920e-ae7e621c94a0 admin admin] The token cache is being invalidate because project 8ea9ac12ae1e4cfdaddab0a0c07c8922 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:06:29.467421 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5957db02-d8e5-4bac-a018-a32df3976784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:29.467561 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-54b9ef78-04ae-4571-920e-ae7e621c94a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:29.468380 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-54b9ef78-04ae-4571-920e-ae7e621c94a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:29.470527 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1034/2047] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:06:29 2022] DELETE /identity/v3/projects/8ea9ac12ae1e4cfdaddab0a0c07c8922 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:29.481862 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fc89b-d17c-457e-83bb-825b79fa321c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:29.482162 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fc89b-d17c-457e-83bb-825b79fa321c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:29.482351 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fc89b-d17c-457e-83bb-825b79fa321c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:29.514213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-773fc89b-d17c-457e-83bb-825b79fa321c None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:29.515561 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-773fc89b-d17c-457e-83bb-825b79fa321c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:29.576829 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957db02-d8e5-4bac-a018-a32df3976784 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:29.591240 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1035/2048] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:29.596547 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bab422-9edb-4e04-9fd9-ecd19c08adbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:29.597513 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bab422-9edb-4e04-9fd9-ecd19c08adbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:29.597864 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bab422-9edb-4e04-9fd9-ecd19c08adbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:29.598205 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bab422-9edb-4e04-9fd9-ecd19c08adbe admin admin] PATH_INFO: `/v3/projects/69ac8dedf30040d08314bceaf82ba7f1` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:29.600333 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bab422-9edb-4e04-9fd9-ecd19c08adbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=69ac8dedf30040d08314bceaf82ba7f1)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:29.601128 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9df24-a357-4153-befa-1be14d6dec38 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:29.601568 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9df24-a357-4153-befa-1be14d6dec38 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:29.601859 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9df24-a357-4153-befa-1be14d6dec38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:29.602652 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bab422-9edb-4e04-9fd9-ecd19c08adbe admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:29.625721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-92b9df24-a357-4153-befa-1be14d6dec38 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:29.626940 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-92b9df24-a357-4153-befa-1be14d6dec38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:29.641096 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1036/2049] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:29.645666 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b9df24-a357-4153-befa-1be14d6dec38 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:29.658111 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b9df24-a357-4153-befa-1be14d6dec38 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:29.666111 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d0bab422-9edb-4e04-9fd9-ecd19c08adbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69ac8dedf30040d08314bceaf82ba7f1', 'request_id': 'req-d0bab422-9edb-4e04-9fd9-ecd19c08adbe'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:29.688938 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d0bab422-9edb-4e04-9fd9-ecd19c08adbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69ac8dedf30040d08314bceaf82ba7f1', 'request_id': 'req-d0bab422-9edb-4e04-9fd9-ecd19c08adbe'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:29.698661 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d0bab422-9edb-4e04-9fd9-ecd19c08adbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69ac8dedf30040d08314bceaf82ba7f1', 'request_id': 'req-d0bab422-9edb-4e04-9fd9-ecd19c08adbe'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:29.713429 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d0bab422-9edb-4e04-9fd9-ecd19c08adbe admin admin] The token cache is being invalidate because project 69ac8dedf30040d08314bceaf82ba7f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:06:29.713782 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d0bab422-9edb-4e04-9fd9-ecd19c08adbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:29.714499 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d0bab422-9edb-4e04-9fd9-ecd19c08adbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:29.716217 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1014/2050] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:06:29 2022] DELETE /identity/v3/projects/69ac8dedf30040d08314bceaf82ba7f1 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:06:29.717053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bab422-9edb-4e04-9fd9-ecd19c08adbe admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:29.718417 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d0bab422-9edb-4e04-9fd9-ecd19c08adbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:29.743796 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6992d80-5323-43cc-9a98-0d7a47bdd53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:29.745299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6992d80-5323-43cc-9a98-0d7a47bdd53f admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:29.746055 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6992d80-5323-43cc-9a98-0d7a47bdd53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:29.746798 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6992d80-5323-43cc-9a98-0d7a47bdd53f admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:29.747877 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6992d80-5323-43cc-9a98-0d7a47bdd53f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:06:29.748379 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6992d80-5323-43cc-9a98-0d7a47bdd53f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:29.750173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6992d80-5323-43cc-9a98-0d7a47bdd53f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:29.765706 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1037/2051] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:06:29.767418 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c7838-9c77-457a-b9b7-c5fca7b2d10d None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:29.767705 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c7838-9c77-457a-b9b7-c5fca7b2d10d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:29.767979 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c7838-9c77-457a-b9b7-c5fca7b2d10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:29.792649 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-147c7838-9c77-457a-b9b7-c5fca7b2d10d None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:29.794014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-147c7838-9c77-457a-b9b7-c5fca7b2d10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:29.803438 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1038/2052] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:29.804089 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c7838-9c77-457a-b9b7-c5fca7b2d10d None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:29.804280 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bab422-9edb-4e04-9fd9-ecd19c08adbe admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:29.805472 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-147c7838-9c77-457a-b9b7-c5fca7b2d10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:29.809153 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abf385-0805-43db-97ac-b5131fb73c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:29.810048 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abf385-0805-43db-97ac-b5131fb73c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:29.810434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abf385-0805-43db-97ac-b5131fb73c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:29.810713 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abf385-0805-43db-97ac-b5131fb73c13 admin admin] PATH_INFO: `/v3/projects/4f393107cd16496f85de03046f03c461` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:29.812062 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86abf385-0805-43db-97ac-b5131fb73c13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f393107cd16496f85de03046f03c461)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:29.815407 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86abf385-0805-43db-97ac-b5131fb73c13 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:29.818512 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:29.819666 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c7838-9c77-457a-b9b7-c5fca7b2d10d None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:29.826415 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b824fa-75a3-4147-8c0a-9f956dc0969a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:29.827770 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b824fa-75a3-4147-8c0a-9f956dc0969a admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:29.828099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b824fa-75a3-4147-8c0a-9f956dc0969a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:29.828526 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b824fa-75a3-4147-8c0a-9f956dc0969a admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:29.829445 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b824fa-75a3-4147-8c0a-9f956dc0969a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:29.831971 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b824fa-75a3-4147-8c0a-9f956dc0969a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:29.866031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1039/2053] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:06:29 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:29.868638 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bd2d3-4119-48db-a1a2-ccfda494e68f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:29.868929 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bd2d3-4119-48db-a1a2-ccfda494e68f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:29.869229 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bd2d3-4119-48db-a1a2-ccfda494e68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:29.877871 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-86abf385-0805-43db-97ac-b5131fb73c13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f393107cd16496f85de03046f03c461', 'request_id': 'req-86abf385-0805-43db-97ac-b5131fb73c13'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:29.886117 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-86abf385-0805-43db-97ac-b5131fb73c13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f393107cd16496f85de03046f03c461', 'request_id': 'req-86abf385-0805-43db-97ac-b5131fb73c13'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:29.890524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b89bd2d3-4119-48db-a1a2-ccfda494e68f None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:29.891782 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b89bd2d3-4119-48db-a1a2-ccfda494e68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:29.893326 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-86abf385-0805-43db-97ac-b5131fb73c13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f393107cd16496f85de03046f03c461', 'request_id': 'req-86abf385-0805-43db-97ac-b5131fb73c13'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:29.905909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-86abf385-0805-43db-97ac-b5131fb73c13 admin admin] The token cache is being invalidate because project 4f393107cd16496f85de03046f03c461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:06:29.906280 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-86abf385-0805-43db-97ac-b5131fb73c13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:29.907657 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-86abf385-0805-43db-97ac-b5131fb73c13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:29.909297 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1015/2054] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:06:29 2022] DELETE /identity/v3/projects/4f393107cd16496f85de03046f03c461 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:29.910277 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abf385-0805-43db-97ac-b5131fb73c13 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:29.914368 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-86abf385-0805-43db-97ac-b5131fb73c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:29.931363 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:29.967046 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1040/2055] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:29.967046 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7be38c-8a6b-456f-b513-ba882af9adef None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:29.967046 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7be38c-8a6b-456f-b513-ba882af9adef None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:29.967046 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7be38c-8a6b-456f-b513-ba882af9adef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:29.988774 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9c7be38c-8a6b-456f-b513-ba882af9adef None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:29.991047 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9c7be38c-8a6b-456f-b513-ba882af9adef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:29.994642 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abf385-0805-43db-97ac-b5131fb73c13 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:30.000281 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e3404-8508-4a9c-bfd8-cff1eb7317a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:30.006423 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1041/2056] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:30.006689 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e3404-8508-4a9c-bfd8-cff1eb7317a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:30.006689 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e3404-8508-4a9c-bfd8-cff1eb7317a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:30.006689 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e3404-8508-4a9c-bfd8-cff1eb7317a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:30.006900 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7be38c-8a6b-456f-b513-ba882af9adef None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:30.006982 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e3404-8508-4a9c-bfd8-cff1eb7317a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:30.006982 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e3404-8508-4a9c-bfd8-cff1eb7317a8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:30.016043 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7be38c-8a6b-456f-b513-ba882af9adef None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:30.022592 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0925263-fe64-4172-b4bf-e22d246f3c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:30.023568 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0925263-fe64-4172-b4bf-e22d246f3c1c admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:30.023853 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0925263-fe64-4172-b4bf-e22d246f3c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:30.024081 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0925263-fe64-4172-b4bf-e22d246f3c1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:30.024783 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0925263-fe64-4172-b4bf-e22d246f3c1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:06:30.025089 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0925263-fe64-4172-b4bf-e22d246f3c1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:30.026712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0925263-fe64-4172-b4bf-e22d246f3c1c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:30.035867 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1016/2057] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:06:29 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:30.035867 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99dd61-b382-4ef7-b20a-9d807d9c4f90 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:30.035867 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99dd61-b382-4ef7-b20a-9d807d9c4f90 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:30.035867 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99dd61-b382-4ef7-b20a-9d807d9c4f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:30.042913 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1042/2058] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:06:30.042913 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0925263-fe64-4172-b4bf-e22d246f3c1c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:30.052208 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0925263-fe64-4172-b4bf-e22d246f3c1c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:30.057623 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6f98d-211c-47b6-afb1-1672c39c3316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:30.058396 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6f98d-211c-47b6-afb1-1672c39c3316 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:30.058835 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6f98d-211c-47b6-afb1-1672c39c3316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:30.059122 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ca99dd61-b382-4ef7-b20a-9d807d9c4f90 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:30.059695 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6f98d-211c-47b6-afb1-1672c39c3316 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:30.060473 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ca99dd61-b382-4ef7-b20a-9d807d9c4f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:30.060571 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6f98d-211c-47b6-afb1-1672c39c3316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:30.062214 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6f98d-211c-47b6-afb1-1672c39c3316 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:30.068978 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1017/2059] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:30.069957 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99dd61-b382-4ef7-b20a-9d807d9c4f90 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:30.079091 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1043/2060] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:30.079091 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6f98d-211c-47b6-afb1-1672c39c3316 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:30.085238 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99dd61-b382-4ef7-b20a-9d807d9c4f90 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:30.089979 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6f98d-211c-47b6-afb1-1672c39c3316 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:30.090618 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac27b1e-1272-4a6c-a10d-05d1e9e2bbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:30.091328 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac27b1e-1272-4a6c-a10d-05d1e9e2bbf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:30.091617 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac27b1e-1272-4a6c-a10d-05d1e9e2bbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:30.091899 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac27b1e-1272-4a6c-a10d-05d1e9e2bbf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:30.092605 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac27b1e-1272-4a6c-a10d-05d1e9e2bbf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:30.094517 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac27b1e-1272-4a6c-a10d-05d1e9e2bbf3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:30.094737 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e927268-1bb4-41b1-8bd6-431f011f61d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:30.095441 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e927268-1bb4-41b1-8bd6-431f011f61d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:30.095727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e927268-1bb4-41b1-8bd6-431f011f61d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:30.095996 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e927268-1bb4-41b1-8bd6-431f011f61d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:30.096717 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e927268-1bb4-41b1-8bd6-431f011f61d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:06:30.097022 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e927268-1bb4-41b1-8bd6-431f011f61d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:30.098609 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e927268-1bb4-41b1-8bd6-431f011f61d4 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:30.114277 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1044/2061] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:06:30.114277 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e927268-1bb4-41b1-8bd6-431f011f61d4 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:30.125393 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e927268-1bb4-41b1-8bd6-431f011f61d4 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:30.125548 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1018/2062] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:06:30 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:30.125548 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac27b1e-1272-4a6c-a10d-05d1e9e2bbf3 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:30.175169 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:30.182034 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7df4c9-5e4b-4c8c-9dba-9dfa3d4f80d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:30.182708 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7df4c9-5e4b-4c8c-9dba-9dfa3d4f80d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:30.182989 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7df4c9-5e4b-4c8c-9dba-9dfa3d4f80d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:30.183289 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7df4c9-5e4b-4c8c-9dba-9dfa3d4f80d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:30.184017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7df4c9-5e4b-4c8c-9dba-9dfa3d4f80d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:30.185596 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7df4c9-5e4b-4c8c-9dba-9dfa3d4f80d0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:30.186433 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac27b1e-1272-4a6c-a10d-05d1e9e2bbf3 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:30.192149 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac33621-1dee-40ca-97e2-e934f1cf2fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:30.193328 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac33621-1dee-40ca-97e2-e934f1cf2fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:30.193628 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac33621-1dee-40ca-97e2-e934f1cf2fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:30.193884 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac33621-1dee-40ca-97e2-e934f1cf2fa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:30.194619 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac33621-1dee-40ca-97e2-e934f1cf2fa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:30.196034 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1045/2063] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:30.196810 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7df4c9-5e4b-4c8c-9dba-9dfa3d4f80d0 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:30.199666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac33621-1dee-40ca-97e2-e934f1cf2fa5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:30.206111 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7df4c9-5e4b-4c8c-9dba-9dfa3d4f80d0 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:30.212107 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccc9e4-eafb-44f7-bc18-845c65b50639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:30.212757 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccc9e4-eafb-44f7-bc18-845c65b50639 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:30.213039 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccc9e4-eafb-44f7-bc18-845c65b50639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:30.213315 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccc9e4-eafb-44f7-bc18-845c65b50639 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:30.214003 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fccc9e4-eafb-44f7-bc18-845c65b50639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:30.216197 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fccc9e4-eafb-44f7-bc18-845c65b50639 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:30.227495 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1019/2064] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:06:30 2022] POST /identity/v3/projects => generated 367 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:30.228414 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac33621-1dee-40ca-97e2-e934f1cf2fa5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:30.235445 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1046/2065] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:06:30 2022] POST /identity/v3/users => generated 287 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:30.236434 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccc9e4-eafb-44f7-bc18-845c65b50639 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:30.245883 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccc9e4-eafb-44f7-bc18-845c65b50639 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:30.297473 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac33621-1dee-40ca-97e2-e934f1cf2fa5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:30.302053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9b306-681a-4a3e-9b83-2d561905e7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:30.302959 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9b306-681a-4a3e-9b83-2d561905e7e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:30.303076 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89cbc3-5b90-4eeb-9644-39da71967ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:30.303280 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9b306-681a-4a3e-9b83-2d561905e7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:30.303546 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9b306-681a-4a3e-9b83-2d561905e7e8 admin admin] PATH_INFO: `/v3/projects/ce5252c2c10640f5867c55c12f7224b9/users/6512f7cf03db456f9e6b8e611c3efa0c/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:30.303655 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89cbc3-5b90-4eeb-9644-39da71967ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:30.303928 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89cbc3-5b90-4eeb-9644-39da71967ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:30.304206 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89cbc3-5b90-4eeb-9644-39da71967ae1 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:30.304895 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d89cbc3-5b90-4eeb-9644-39da71967ae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:30.306809 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d89cbc3-5b90-4eeb-9644-39da71967ae1 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:30.318453 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9b306-681a-4a3e-9b83-2d561905e7e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce5252c2c10640f5867c55c12f7224b9, user_id=6512f7cf03db456f9e6b8e611c3efa0c, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:30.321144 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9b306-681a-4a3e-9b83-2d561905e7e8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:30.328850 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1047/2066] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:06:30 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:30.329663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89cbc3-5b90-4eeb-9644-39da71967ae1 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:30.335417 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:30.337654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1020/2067] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:30 2022] PUT /identity/v3/projects/ce5252c2c10640f5867c55c12f7224b9/users/6512f7cf03db456f9e6b8e611c3efa0c/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:30.338321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9b306-681a-4a3e-9b83-2d561905e7e8 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:30.343574 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89cbc3-5b90-4eeb-9644-39da71967ae1 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:30.405427 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9b306-681a-4a3e-9b83-2d561905e7e8 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:30.410263 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837ef21-16b6-4bcf-8156-d9333ffaed98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:30.410579 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06ae12-4c67-4690-a7b0-309a3c2814cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:30.410939 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837ef21-16b6-4bcf-8156-d9333ffaed98 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:30.411244 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837ef21-16b6-4bcf-8156-d9333ffaed98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:30.411343 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06ae12-4c67-4690-a7b0-309a3c2814cb admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:30.411550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837ef21-16b6-4bcf-8156-d9333ffaed98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:30.411659 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06ae12-4c67-4690-a7b0-309a3c2814cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:30.411919 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06ae12-4c67-4690-a7b0-309a3c2814cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:30.412559 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837ef21-16b6-4bcf-8156-d9333ffaed98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:30.413989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837ef21-16b6-4bcf-8156-d9333ffaed98 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:30.414797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06ae12-4c67-4690-a7b0-309a3c2814cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:30.416376 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06ae12-4c67-4690-a7b0-309a3c2814cb admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:30.424794 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1021/2068] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:30.426150 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9b8d5-5318-4dd6-b97c-f1ccbc64d478 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:30.426500 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9b8d5-5318-4dd6-b97c-f1ccbc64d478 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:30.426842 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9b8d5-5318-4dd6-b97c-f1ccbc64d478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:30.427867 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1048/2069] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:30.429124 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06ae12-4c67-4690-a7b0-309a3c2814cb admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:30.448618 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06ae12-4c67-4690-a7b0-309a3c2814cb admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:30.453399 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6f300-6d55-4312-8755-c37f7ed20ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:30.454073 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6f300-6d55-4312-8755-c37f7ed20ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:30.454357 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6f300-6d55-4312-8755-c37f7ed20ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:30.454637 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6f300-6d55-4312-8755-c37f7ed20ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:30.455402 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6f300-6d55-4312-8755-c37f7ed20ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:30.457008 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6f300-6d55-4312-8755-c37f7ed20ba8 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:30.465044 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-3cf9b8d5-5318-4dd6-b97c-f1ccbc64d478 None None] MFA Rules not processed for user `6512f7cf03db456f9e6b8e611c3efa0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:30.466334 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3cf9b8d5-5318-4dd6-b97c-f1ccbc64d478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:30.468313 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1049/2070] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:30.469394 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6f300-6d55-4312-8755-c37f7ed20ba8 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:30.479168 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6f300-6d55-4312-8755-c37f7ed20ba8 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:30.484323 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490b535-9d05-4699-90da-611ef0f2ebb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:30.485002 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490b535-9d05-4699-90da-611ef0f2ebb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:30.485297 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490b535-9d05-4699-90da-611ef0f2ebb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:30.485558 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490b535-9d05-4699-90da-611ef0f2ebb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:30.486279 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490b535-9d05-4699-90da-611ef0f2ebb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:30.487916 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490b535-9d05-4699-90da-611ef0f2ebb1 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:30.502298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1050/2071] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:30.502298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490b535-9d05-4699-90da-611ef0f2ebb1 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:30.509900 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490b535-9d05-4699-90da-611ef0f2ebb1 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:30.514663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699e9ef-bcf2-4201-b18a-c04255bed271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:30.515540 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699e9ef-bcf2-4201-b18a-c04255bed271 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:30.515815 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699e9ef-bcf2-4201-b18a-c04255bed271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:30.516091 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699e9ef-bcf2-4201-b18a-c04255bed271 admin admin] PATH_INFO: `/v3/projects/35837d9c7ea54b99873e00d2621b39ec/users/9cd6bea3d8f64a82bfa058f728b557de/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:30.516620 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:30.531699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699e9ef-bcf2-4201-b18a-c04255bed271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35837d9c7ea54b99873e00d2621b39ec, user_id=9cd6bea3d8f64a82bfa058f728b557de, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:30.534378 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699e9ef-bcf2-4201-b18a-c04255bed271 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:30.537472 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1022/2072] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:30.538060 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9b8d5-5318-4dd6-b97c-f1ccbc64d478 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:30.548580 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9b8d5-5318-4dd6-b97c-f1ccbc64d478 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:30.553805 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1051/2073] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:30 2022] PUT /identity/v3/projects/35837d9c7ea54b99873e00d2621b39ec/users/9cd6bea3d8f64a82bfa058f728b557de/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:30.554619 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699e9ef-bcf2-4201-b18a-c04255bed271 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:30.556265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4699e9ef-bcf2-4201-b18a-c04255bed271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:30.613415 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaaf904-b001-41bb-802e-5193ed0d1db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:30.614366 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaaf904-b001-41bb-802e-5193ed0d1db7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:30.615180 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaaf904-b001-41bb-802e-5193ed0d1db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:30.615502 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaaf904-b001-41bb-802e-5193ed0d1db7 admin admin] PATH_INFO: `/v3/projects/7dae251faaae4c60be49e940d842099c/users/4713bf0cfe8a4ddcb174d721df8d5d73/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:30.615964 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699e9ef-bcf2-4201-b18a-c04255bed271 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:30.620077 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5a251-37b0-4446-b215-840da1c9c46c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:30.620996 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5a251-37b0-4446-b215-840da1c9c46c service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:30.621407 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5a251-37b0-4446-b215-840da1c9c46c service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:30.621701 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5a251-37b0-4446-b215-840da1c9c46c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:30.632428 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaaf904-b001-41bb-802e-5193ed0d1db7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dae251faaae4c60be49e940d842099c, user_id=4713bf0cfe8a4ddcb174d721df8d5d73, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:30.635135 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaaf904-b001-41bb-802e-5193ed0d1db7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:30.650801 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1023/2074] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:30 2022] PUT /identity/v3/projects/7dae251faaae4c60be49e940d842099c/users/4713bf0cfe8a4ddcb174d721df8d5d73/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:30.652216 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e4d91-f127-4fd0-8dcc-5bf686f074a3 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:30.652517 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e4d91-f127-4fd0-8dcc-5bf686f074a3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:30.652803 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e4d91-f127-4fd0-8dcc-5bf686f074a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:30.686088 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e71e4d91-f127-4fd0-8dcc-5bf686f074a3 None None] MFA Rules not processed for user `9cd6bea3d8f64a82bfa058f728b557de`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:30.687385 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5a251-37b0-4446-b215-840da1c9c46c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:30.687607 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e71e4d91-f127-4fd0-8dcc-5bf686f074a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:30.688910 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5a251-37b0-4446-b215-840da1c9c46c service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:30.698866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1052/2075] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:30.710695 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495133a-e701-4ac8-8a9a-49d5c27f5a39 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:30.710993 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495133a-e701-4ac8-8a9a-49d5c27f5a39 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:30.711296 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495133a-e701-4ac8-8a9a-49d5c27f5a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:30.723236 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:30.731042 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a495133a-e701-4ac8-8a9a-49d5c27f5a39 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:30.733898 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a495133a-e701-4ac8-8a9a-49d5c27f5a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:30.778413 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1024/2076] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:30 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:30.783281 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e4d91-f127-4fd0-8dcc-5bf686f074a3 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:30.820618 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1053/2077] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:30.830686 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495133a-e701-4ac8-8a9a-49d5c27f5a39 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:30.832655 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a495133a-e701-4ac8-8a9a-49d5c27f5a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:30.849840 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e4d91-f127-4fd0-8dcc-5bf686f074a3 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:30.855109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831e92f-1de6-4ffb-afb2-239c52a3e8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:30.856000 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831e92f-1de6-4ffb-afb2-239c52a3e8ce admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:30.856155 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831e92f-1de6-4ffb-afb2-239c52a3e8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:30.856351 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831e92f-1de6-4ffb-afb2-239c52a3e8ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:30.857072 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831e92f-1de6-4ffb-afb2-239c52a3e8ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:30.859097 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831e92f-1de6-4ffb-afb2-239c52a3e8ce admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:30.862812 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:30.893787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1025/2078] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:06:30 2022] POST /identity/v3/projects => generated 367 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:06:30.896950 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495133a-e701-4ac8-8a9a-49d5c27f5a39 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:30.897938 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831e92f-1de6-4ffb-afb2-239c52a3e8ce admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:30.955115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2eb2d-0208-4e79-bc8e-b263b01c0e7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:30.956040 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2eb2d-0208-4e79-bc8e-b263b01c0e7a service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:30.956420 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2eb2d-0208-4e79-bc8e-b263b01c0e7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:30.956701 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2eb2d-0208-4e79-bc8e-b263b01c0e7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:30.977763 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831e92f-1de6-4ffb-afb2-239c52a3e8ce admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:30.985053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc1c95-77a6-4010-aa85-d999e58e412d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:30.986222 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc1c95-77a6-4010-aa85-d999e58e412d admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:30.986563 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc1c95-77a6-4010-aa85-d999e58e412d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:30.986852 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc1c95-77a6-4010-aa85-d999e58e412d admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:30.988024 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc1c95-77a6-4010-aa85-d999e58e412d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:30.991144 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc1c95-77a6-4010-aa85-d999e58e412d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:31.022920 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1026/2079] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:06:30 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:31.024111 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc1c95-77a6-4010-aa85-d999e58e412d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:31.039252 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc1c95-77a6-4010-aa85-d999e58e412d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:31.049096 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f23a9-f433-4083-9a7e-92144c14bfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:31.051213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2eb2d-0208-4e79-bc8e-b263b01c0e7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:31.054178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2eb2d-0208-4e79-bc8e-b263b01c0e7a service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:31.056349 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f23a9-f433-4083-9a7e-92144c14bfab admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:31.056644 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f23a9-f433-4083-9a7e-92144c14bfab admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:31.056923 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f23a9-f433-4083-9a7e-92144c14bfab admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:31.057713 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f23a9-f433-4083-9a7e-92144c14bfab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:31.059389 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f23a9-f433-4083-9a7e-92144c14bfab admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:31.075939 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1054/2080] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:31.085997 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1027/2081] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:31.087687 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2eb2d-0208-4e79-bc8e-b263b01c0e7a service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:31.097682 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2eb2d-0208-4e79-bc8e-b263b01c0e7a service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:31.104753 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a23d0-caf6-49d0-8977-c775f4d070b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:31.105827 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a23d0-caf6-49d0-8977-c775f4d070b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:31.106298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a23d0-caf6-49d0-8977-c775f4d070b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:31.106642 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a23d0-caf6-49d0-8977-c775f4d070b9 admin admin] PATH_INFO: `/v3/projects/0e9d17cac23e4e699efd891473f7314c/users/a642a578db8446b083b80578e14109c5/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:31.120382 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:31.124921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a23d0-caf6-49d0-8977-c775f4d070b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e9d17cac23e4e699efd891473f7314c, user_id=a642a578db8446b083b80578e14109c5, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:31.127843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a23d0-caf6-49d0-8977-c775f4d070b9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:31.141683 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1055/2082] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:31 2022] PUT /identity/v3/projects/0e9d17cac23e4e699efd891473f7314c/users/a642a578db8446b083b80578e14109c5/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:31.145591 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f23a9-f433-4083-9a7e-92144c14bfab admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:31.155576 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f23a9-f433-4083-9a7e-92144c14bfab admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:31.215836 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a6ead-7e8d-49a8-8116-529ebedea11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:31.216510 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a6ead-7e8d-49a8-8116-529ebedea11a admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:31.216792 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a6ead-7e8d-49a8-8116-529ebedea11a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:31.217066 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a6ead-7e8d-49a8-8116-529ebedea11a admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:31.217800 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a6ead-7e8d-49a8-8116-529ebedea11a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:31.219425 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a6ead-7e8d-49a8-8116-529ebedea11a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:31.234342 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1028/2083] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:31.235770 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a23d0-caf6-49d0-8977-c775f4d070b9 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:31.247463 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a23d0-caf6-49d0-8977-c775f4d070b9 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:31.252549 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ff8d9-2f43-4df7-81b6-7c11515a19dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:31.254296 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ff8d9-2f43-4df7-81b6-7c11515a19dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:31.254590 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ff8d9-2f43-4df7-81b6-7c11515a19dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:31.254907 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ff8d9-2f43-4df7-81b6-7c11515a19dc admin admin] PATH_INFO: `/v3/projects/0e9d17cac23e4e699efd891473f7314c/users/a642a578db8446b083b80578e14109c5/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:31.257104 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ff8d9-2f43-4df7-81b6-7c11515a19dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e9d17cac23e4e699efd891473f7314c, user_id=a642a578db8446b083b80578e14109c5, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:31.260057 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ff8d9-2f43-4df7-81b6-7c11515a19dc admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:31.271525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1056/2084] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:31 2022] PUT /identity/v3/projects/0e9d17cac23e4e699efd891473f7314c/users/a642a578db8446b083b80578e14109c5/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:06:31.283553 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c74c8-ef96-49a4-8841-8bd7cd9a9118 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:31.283846 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c74c8-ef96-49a4-8841-8bd7cd9a9118 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:31.284228 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c74c8-ef96-49a4-8841-8bd7cd9a9118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:31.311139 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-cf6c74c8-ef96-49a4-8841-8bd7cd9a9118 None None] MFA Rules not processed for user `a642a578db8446b083b80578e14109c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:31.312567 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-cf6c74c8-ef96-49a4-8841-8bd7cd9a9118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:31.364496 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:31.393861 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1029/2085] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:31 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:31.406048 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ff8d9-2f43-4df7-81b6-7c11515a19dc admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:31.408499 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8a4ff8d9-2f43-4df7-81b6-7c11515a19dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:31.496137 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ff8d9-2f43-4df7-81b6-7c11515a19dc admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:31.500306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09441d9-96b3-4f6d-802c-666bc968c545 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:31.501048 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09441d9-96b3-4f6d-802c-666bc968c545 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:31.501334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09441d9-96b3-4f6d-802c-666bc968c545 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:31.501608 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09441d9-96b3-4f6d-802c-666bc968c545 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:31.512357 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09441d9-96b3-4f6d-802c-666bc968c545 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:31.514773 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09441d9-96b3-4f6d-802c-666bc968c545 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:31.529638 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1057/2086] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:31 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 15:06:31.808805 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742bbd9-f187-466a-bf91-d08c601470af None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:31.809149 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742bbd9-f187-466a-bf91-d08c601470af None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:31.809437 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742bbd9-f187-466a-bf91-d08c601470af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:31.841385 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0742bbd9-f187-466a-bf91-d08c601470af None None] MFA Rules not processed for user `4713bf0cfe8a4ddcb174d721df8d5d73`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:31.842813 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0742bbd9-f187-466a-bf91-d08c601470af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:31.966322 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1030/2087] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:31.970564 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09441d9-96b3-4f6d-802c-666bc968c545 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:32.066661 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09441d9-96b3-4f6d-802c-666bc968c545 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:32.072553 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6d4b2-07ad-43f4-9746-cee87ddd5d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:32.073292 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6d4b2-07ad-43f4-9746-cee87ddd5d66 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:32.073650 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6d4b2-07ad-43f4-9746-cee87ddd5d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:32.074001 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6d4b2-07ad-43f4-9746-cee87ddd5d66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:32.074810 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6d4b2-07ad-43f4-9746-cee87ddd5d66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:32.076993 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6d4b2-07ad-43f4-9746-cee87ddd5d66 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:32.118715 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1058/2088] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:06:31 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:32.123901 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742bbd9-f187-466a-bf91-d08c601470af None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:32.138364 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742bbd9-f187-466a-bf91-d08c601470af None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:32.198833 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22354f64-e1de-472b-b420-66bdbb679b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:32.199568 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22354f64-e1de-472b-b420-66bdbb679b8a admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:32.199841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22354f64-e1de-472b-b420-66bdbb679b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:32.200124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22354f64-e1de-472b-b420-66bdbb679b8a admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:32.200821 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22354f64-e1de-472b-b420-66bdbb679b8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:32.202828 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22354f64-e1de-472b-b420-66bdbb679b8a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:32.224882 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1031/2089] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:06:32 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:32.231476 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6d4b2-07ad-43f4-9746-cee87ddd5d66 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:32.245194 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6d4b2-07ad-43f4-9746-cee87ddd5d66 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:32.250053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e017b2-888a-4891-a392-90648b21d64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:32.250710 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e017b2-888a-4891-a392-90648b21d64e admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:32.250991 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e017b2-888a-4891-a392-90648b21d64e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:32.251304 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e017b2-888a-4891-a392-90648b21d64e admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:32.252033 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e017b2-888a-4891-a392-90648b21d64e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:32.253615 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e017b2-888a-4891-a392-90648b21d64e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:32.265628 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1059/2090] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 15:06:32.271020 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22354f64-e1de-472b-b420-66bdbb679b8a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:32.280373 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22354f64-e1de-472b-b420-66bdbb679b8a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:32.285412 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cd4aa-742e-4d10-9f34-1ac8d17580ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:32.286479 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cd4aa-742e-4d10-9f34-1ac8d17580ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:32.286790 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cd4aa-742e-4d10-9f34-1ac8d17580ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:32.287072 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cd4aa-742e-4d10-9f34-1ac8d17580ef admin admin] PATH_INFO: `/v3/projects/f790c0f33c96410a84745135173145be/users/ff1be6e9ae6740878232b3c50f956008/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:32.304103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4cd4aa-742e-4d10-9f34-1ac8d17580ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=f790c0f33c96410a84745135173145be, user_id=ff1be6e9ae6740878232b3c50f956008, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:32.306938 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4cd4aa-742e-4d10-9f34-1ac8d17580ef admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:32.339427 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1032/2091] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:32 2022] PUT /identity/v3/projects/f790c0f33c96410a84745135173145be/users/ff1be6e9ae6740878232b3c50f956008/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:32.343113 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e017b2-888a-4891-a392-90648b21d64e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:32.353540 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e017b2-888a-4891-a392-90648b21d64e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:32.404960 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:32.419758 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f35ad9-eb7d-4a27-8c92-f14530699ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:32.420477 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f35ad9-eb7d-4a27-8c92-f14530699ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:32.421387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f35ad9-eb7d-4a27-8c92-f14530699ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:32.421387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f35ad9-eb7d-4a27-8c92-f14530699ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:32.422328 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f35ad9-eb7d-4a27-8c92-f14530699ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:32.423711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f35ad9-eb7d-4a27-8c92-f14530699ae5 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:32.437827 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1060/2092] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:32.439365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cd4aa-742e-4d10-9f34-1ac8d17580ef admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:32.450165 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cd4aa-742e-4d10-9f34-1ac8d17580ef admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:32.455853 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbece9f8-20f0-4e51-8dbf-392420c93c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:32.456735 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbece9f8-20f0-4e51-8dbf-392420c93c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:32.457141 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbece9f8-20f0-4e51-8dbf-392420c93c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:32.457425 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbece9f8-20f0-4e51-8dbf-392420c93c45 admin admin] PATH_INFO: `/v3/projects/f790c0f33c96410a84745135173145be/users/ff1be6e9ae6740878232b3c50f956008/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:32.459712 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbece9f8-20f0-4e51-8dbf-392420c93c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f790c0f33c96410a84745135173145be, user_id=ff1be6e9ae6740878232b3c50f956008, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:32.462863 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbece9f8-20f0-4e51-8dbf-392420c93c45 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:32.473492 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1033/2093] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:32 2022] PUT /identity/v3/projects/f790c0f33c96410a84745135173145be/users/ff1be6e9ae6740878232b3c50f956008/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:33.032124 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f35ad9-eb7d-4a27-8c92-f14530699ae5 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:33.043336 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f35ad9-eb7d-4a27-8c92-f14530699ae5 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:33.114585 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a07dd-869c-4b82-820a-afbca7d6d91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:33.115653 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a07dd-869c-4b82-820a-afbca7d6d91e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:33.115924 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a07dd-869c-4b82-820a-afbca7d6d91e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:33.116267 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a07dd-869c-4b82-820a-afbca7d6d91e admin admin] PATH_INFO: `/v3/users/9cd6bea3d8f64a82bfa058f728b557de` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:33.117537 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a07dd-869c-4b82-820a-afbca7d6d91e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cd6bea3d8f64a82bfa058f728b557de)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:33.119706 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a07dd-869c-4b82-820a-afbca7d6d91e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:33.210765 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-563a07dd-869c-4b82-820a-afbca7d6d91e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cd6bea3d8f64a82bfa058f728b557de'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:33.211918 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-563a07dd-869c-4b82-820a-afbca7d6d91e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cd6bea3d8f64a82bfa058f728b557de'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:33.212950 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-563a07dd-869c-4b82-820a-afbca7d6d91e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cd6bea3d8f64a82bfa058f728b557de'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:33.228322 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-563a07dd-869c-4b82-820a-afbca7d6d91e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cd6bea3d8f64a82bfa058f728b557de'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:33.251594 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-563a07dd-869c-4b82-820a-afbca7d6d91e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cd6bea3d8f64a82bfa058f728b557de'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:33.277099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1061/2094] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:06:33 2022] DELETE /identity/v3/users/9cd6bea3d8f64a82bfa058f728b557de => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:33.278889 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c06fd7-63a0-426b-a408-1689ebb8cffd None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:33.279454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c06fd7-63a0-426b-a408-1689ebb8cffd None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:33.279536 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c06fd7-63a0-426b-a408-1689ebb8cffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:33.321492 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-83c06fd7-63a0-426b-a408-1689ebb8cffd None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:33.330303 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-83c06fd7-63a0-426b-a408-1689ebb8cffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:33.365481 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:33.434904 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1034/2095] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:33.445930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a07dd-869c-4b82-820a-afbca7d6d91e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:33.448268 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-563a07dd-869c-4b82-820a-afbca7d6d91e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:33.519125 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b02bb-4c5a-49c5-8134-ca46f2044d89 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:33.519477 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b02bb-4c5a-49c5-8134-ca46f2044d89 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:33.519756 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b02bb-4c5a-49c5-8134-ca46f2044d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:33.573085 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-105b02bb-4c5a-49c5-8134-ca46f2044d89 None None] MFA Rules not processed for user `ff1be6e9ae6740878232b3c50f956008`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:33.574321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-105b02bb-4c5a-49c5-8134-ca46f2044d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:33.582266 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a07dd-869c-4b82-820a-afbca7d6d91e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:33.596677 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c76a78-4db7-441b-a39b-3a2c96304359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:33.597352 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c76a78-4db7-441b-a39b-3a2c96304359 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:33.597655 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c76a78-4db7-441b-a39b-3a2c96304359 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:33.597918 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c76a78-4db7-441b-a39b-3a2c96304359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:33.618928 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c76a78-4db7-441b-a39b-3a2c96304359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:33.620941 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c76a78-4db7-441b-a39b-3a2c96304359 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:33.636395 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1062/2096] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:33.732973 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1035/2097] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:33.760561 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c76a78-4db7-441b-a39b-3a2c96304359 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:33.761982 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-74c76a78-4db7-441b-a39b-3a2c96304359 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:33.777313 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:33.841278 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c76a78-4db7-441b-a39b-3a2c96304359 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:33.846302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d06c7-493f-44e4-8fa9-35044506e868 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:33.847186 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d06c7-493f-44e4-8fa9-35044506e868 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:33.847340 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d06c7-493f-44e4-8fa9-35044506e868 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:33.847542 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d06c7-493f-44e4-8fa9-35044506e868 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:33.856138 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1a7d06c7-493f-44e4-8fa9-35044506e868 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:33.926239 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d06c7-493f-44e4-8fa9-35044506e868 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:33.928290 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d06c7-493f-44e4-8fa9-35044506e868 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:33.937915 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1063/2098] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:33.967939 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b02bb-4c5a-49c5-8134-ca46f2044d89 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:33.969669 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-105b02bb-4c5a-49c5-8134-ca46f2044d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:33.996862 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b02bb-4c5a-49c5-8134-ca46f2044d89 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:34.007115 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ada39b-5cfd-4d02-885c-513a0cb3ff50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:34.008247 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ada39b-5cfd-4d02-885c-513a0cb3ff50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:34.008487 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ada39b-5cfd-4d02-885c-513a0cb3ff50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:34.008808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ada39b-5cfd-4d02-885c-513a0cb3ff50 admin admin] PATH_INFO: `/v3/projects/35837d9c7ea54b99873e00d2621b39ec` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:34.010028 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ada39b-5cfd-4d02-885c-513a0cb3ff50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35837d9c7ea54b99873e00d2621b39ec)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:34.012084 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ada39b-5cfd-4d02-885c-513a0cb3ff50 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:34.073776 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-68ada39b-5cfd-4d02-885c-513a0cb3ff50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35837d9c7ea54b99873e00d2621b39ec', 'request_id': 'req-68ada39b-5cfd-4d02-885c-513a0cb3ff50'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:34.086594 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-68ada39b-5cfd-4d02-885c-513a0cb3ff50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35837d9c7ea54b99873e00d2621b39ec', 'request_id': 'req-68ada39b-5cfd-4d02-885c-513a0cb3ff50'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:34.095753 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-68ada39b-5cfd-4d02-885c-513a0cb3ff50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35837d9c7ea54b99873e00d2621b39ec', 'request_id': 'req-68ada39b-5cfd-4d02-885c-513a0cb3ff50'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:34.110117 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-68ada39b-5cfd-4d02-885c-513a0cb3ff50 admin admin] The token cache is being invalidate because project 35837d9c7ea54b99873e00d2621b39ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:06:34.110564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-68ada39b-5cfd-4d02-885c-513a0cb3ff50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:34.111273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-68ada39b-5cfd-4d02-885c-513a0cb3ff50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:34.116794 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1036/2099] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:06:33 2022] DELETE /identity/v3/projects/35837d9c7ea54b99873e00d2621b39ec => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:34.118782 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d06c7-493f-44e4-8fa9-35044506e868 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:34.132754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d06c7-493f-44e4-8fa9-35044506e868 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:34.229208 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560fda8f-baab-4d3d-84bc-96df0f25d022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:34.230157 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fda8f-baab-4d3d-84bc-96df0f25d022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:34.230574 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fda8f-baab-4d3d-84bc-96df0f25d022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:34.230856 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fda8f-baab-4d3d-84bc-96df0f25d022 admin admin] PATH_INFO: `/v3/users/a642a578db8446b083b80578e14109c5` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:34.232190 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560fda8f-baab-4d3d-84bc-96df0f25d022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a642a578db8446b083b80578e14109c5)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:34.234262 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560fda8f-baab-4d3d-84bc-96df0f25d022 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:34.293800 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-560fda8f-baab-4d3d-84bc-96df0f25d022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a642a578db8446b083b80578e14109c5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:34.294557 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-560fda8f-baab-4d3d-84bc-96df0f25d022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a642a578db8446b083b80578e14109c5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:34.295477 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-560fda8f-baab-4d3d-84bc-96df0f25d022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a642a578db8446b083b80578e14109c5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:34.304913 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-560fda8f-baab-4d3d-84bc-96df0f25d022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a642a578db8446b083b80578e14109c5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:34.315576 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:34.318479 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-560fda8f-baab-4d3d-84bc-96df0f25d022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a642a578db8446b083b80578e14109c5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:34.332967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1064/2100] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:06:34 2022] DELETE /identity/v3/users/a642a578db8446b083b80578e14109c5 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:06:34.612386 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ada39b-5cfd-4d02-885c-513a0cb3ff50 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:34.614840 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-68ada39b-5cfd-4d02-885c-513a0cb3ff50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:34.638818 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ada39b-5cfd-4d02-885c-513a0cb3ff50 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:34.672097 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:34.698469 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae81f33-5359-4873-98ba-fd485adcdd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:34.699528 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae81f33-5359-4873-98ba-fd485adcdd78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:34.699817 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae81f33-5359-4873-98ba-fd485adcdd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:34.700089 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae81f33-5359-4873-98ba-fd485adcdd78 admin admin] PATH_INFO: `/v3/projects/0e9d17cac23e4e699efd891473f7314c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:34.701458 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae81f33-5359-4873-98ba-fd485adcdd78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e9d17cac23e4e699efd891473f7314c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:34.703462 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae81f33-5359-4873-98ba-fd485adcdd78 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:34.752202 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-cae81f33-5359-4873-98ba-fd485adcdd78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e9d17cac23e4e699efd891473f7314c', 'request_id': 'req-cae81f33-5359-4873-98ba-fd485adcdd78'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:34.759972 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-cae81f33-5359-4873-98ba-fd485adcdd78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e9d17cac23e4e699efd891473f7314c', 'request_id': 'req-cae81f33-5359-4873-98ba-fd485adcdd78'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:34.767669 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-cae81f33-5359-4873-98ba-fd485adcdd78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e9d17cac23e4e699efd891473f7314c', 'request_id': 'req-cae81f33-5359-4873-98ba-fd485adcdd78'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:34.778459 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-cae81f33-5359-4873-98ba-fd485adcdd78 admin admin] The token cache is being invalidate because project 0e9d17cac23e4e699efd891473f7314c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:06:34.778811 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-cae81f33-5359-4873-98ba-fd485adcdd78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:34.779488 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-cae81f33-5359-4873-98ba-fd485adcdd78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:34.781026 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1037/2101] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:06:34 2022] DELETE /identity/v3/projects/0e9d17cac23e4e699efd891473f7314c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:34.786074 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71188a2-43b0-4744-b7e2-483c50908a7e None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:34.786672 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71188a2-43b0-4744-b7e2-483c50908a7e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:34.787112 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71188a2-43b0-4744-b7e2-483c50908a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:34.811354 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b71188a2-43b0-4744-b7e2-483c50908a7e None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:34.812580 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b71188a2-43b0-4744-b7e2-483c50908a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:34.871014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1065/2102] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:06:34.878642 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b426d0-2eda-496a-bf55-5f3ae6fbb7eb None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:34.878931 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b426d0-2eda-496a-bf55-5f3ae6fbb7eb None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:34.879264 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b426d0-2eda-496a-bf55-5f3ae6fbb7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:34.898042 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-43b426d0-2eda-496a-bf55-5f3ae6fbb7eb None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:34.899248 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-43b426d0-2eda-496a-bf55-5f3ae6fbb7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:34.906975 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1038/2103] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:34.910979 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71188a2-43b0-4744-b7e2-483c50908a7e None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:34.920933 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71188a2-43b0-4744-b7e2-483c50908a7e None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:34.925924 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830bd20-3465-4eef-8a66-9f9b124d30e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:34.926594 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830bd20-3465-4eef-8a66-9f9b124d30e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:34.926906 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830bd20-3465-4eef-8a66-9f9b124d30e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:34.927180 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830bd20-3465-4eef-8a66-9f9b124d30e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:34.927939 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830bd20-3465-4eef-8a66-9f9b124d30e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:06:34.928247 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830bd20-3465-4eef-8a66-9f9b124d30e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:34.929839 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830bd20-3465-4eef-8a66-9f9b124d30e2 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:34.941206 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1066/2104] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:06:34.945949 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b426d0-2eda-496a-bf55-5f3ae6fbb7eb None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:34.955036 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b426d0-2eda-496a-bf55-5f3ae6fbb7eb None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:34.960366 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44be94-9f91-4221-ae29-a80ce817ddcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:34.961015 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44be94-9f91-4221-ae29-a80ce817ddcb admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:34.961300 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44be94-9f91-4221-ae29-a80ce817ddcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:34.961576 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44be94-9f91-4221-ae29-a80ce817ddcb admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:34.962278 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44be94-9f91-4221-ae29-a80ce817ddcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:34.964223 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44be94-9f91-4221-ae29-a80ce817ddcb admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:34.989235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1039/2105] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:06:34 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:34.993766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830bd20-3465-4eef-8a66-9f9b124d30e2 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:35.003793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830bd20-3465-4eef-8a66-9f9b124d30e2 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:35.058977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a976da-c8f7-4574-98f2-a054d269d9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:35.059658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a976da-c8f7-4574-98f2-a054d269d9a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:35.059942 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a976da-c8f7-4574-98f2-a054d269d9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:35.060218 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a976da-c8f7-4574-98f2-a054d269d9a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:35.060909 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a976da-c8f7-4574-98f2-a054d269d9a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:35.062813 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a976da-c8f7-4574-98f2-a054d269d9a4 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:35.083602 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1067/2106] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:06:34 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:35.087741 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44be94-9f91-4221-ae29-a80ce817ddcb admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:35.097842 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44be94-9f91-4221-ae29-a80ce817ddcb admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:35.102418 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a07705-8a0f-4c03-8e4a-a0a99a5742aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:35.103076 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a07705-8a0f-4c03-8e4a-a0a99a5742aa admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:35.103390 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a07705-8a0f-4c03-8e4a-a0a99a5742aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:35.103671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a07705-8a0f-4c03-8e4a-a0a99a5742aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:35.104398 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a07705-8a0f-4c03-8e4a-a0a99a5742aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:35.106006 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a07705-8a0f-4c03-8e4a-a0a99a5742aa admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:35.116793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1040/2107] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:35.120713 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a976da-c8f7-4574-98f2-a054d269d9a4 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:35.131148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a976da-c8f7-4574-98f2-a054d269d9a4 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:35.135663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03b0b6-173c-49f9-85d1-12a97d2d3d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:35.136313 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03b0b6-173c-49f9-85d1-12a97d2d3d72 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:35.136596 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03b0b6-173c-49f9-85d1-12a97d2d3d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:35.136871 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03b0b6-173c-49f9-85d1-12a97d2d3d72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:35.137594 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03b0b6-173c-49f9-85d1-12a97d2d3d72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:35.139171 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03b0b6-173c-49f9-85d1-12a97d2d3d72 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:35.148760 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1068/2108] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:35.152689 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a07705-8a0f-4c03-8e4a-a0a99a5742aa admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:35.162804 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a07705-8a0f-4c03-8e4a-a0a99a5742aa admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:35.167509 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea46c4-e3e9-4231-9f67-4e54a0488a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:35.168380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea46c4-e3e9-4231-9f67-4e54a0488a21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:35.168670 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea46c4-e3e9-4231-9f67-4e54a0488a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:35.168952 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea46c4-e3e9-4231-9f67-4e54a0488a21 admin admin] PATH_INFO: `/v3/projects/a5cd8fe83b9541ca903a480f81349b16/users/31a575c410ff4657bd5f647fb63d9a71/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:35.184719 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea46c4-e3e9-4231-9f67-4e54a0488a21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5cd8fe83b9541ca903a480f81349b16, user_id=31a575c410ff4657bd5f647fb63d9a71, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:35.187442 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea46c4-e3e9-4231-9f67-4e54a0488a21 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:35.200736 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1041/2109] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:35 2022] PUT /identity/v3/projects/a5cd8fe83b9541ca903a480f81349b16/users/31a575c410ff4657bd5f647fb63d9a71/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:35.211804 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1deb48-4c2b-408c-aa66-6a3dc8bc0ce3 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:35.212093 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1deb48-4c2b-408c-aa66-6a3dc8bc0ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:35.212369 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1deb48-4c2b-408c-aa66-6a3dc8bc0ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:35.238235 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-4f1deb48-4c2b-408c-aa66-6a3dc8bc0ce3 None None] MFA Rules not processed for user `31a575c410ff4657bd5f647fb63d9a71`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:35.240161 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4f1deb48-4c2b-408c-aa66-6a3dc8bc0ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:35.279217 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:35.303986 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1069/2110] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:35.308405 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea46c4-e3e9-4231-9f67-4e54a0488a21 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:35.380752 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea46c4-e3e9-4231-9f67-4e54a0488a21 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:35.385525 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced4b59-2670-430a-a84b-6a112816cd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:35.386124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced4b59-2670-430a-a84b-6a112816cd1f admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:35.386409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced4b59-2670-430a-a84b-6a112816cd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:35.386687 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced4b59-2670-430a-a84b-6a112816cd1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:35.387403 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced4b59-2670-430a-a84b-6a112816cd1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:35.389293 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced4b59-2670-430a-a84b-6a112816cd1f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:35.393224 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:35.415117 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1042/2111] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:06:35 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:35.419212 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1deb48-4c2b-408c-aa66-6a3dc8bc0ce3 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:35.430613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1deb48-4c2b-408c-aa66-6a3dc8bc0ce3 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:35.484892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa3b5e-8d48-4f22-b18d-1175d53ba670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:35.485550 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa3b5e-8d48-4f22-b18d-1175d53ba670 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:35.485833 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa3b5e-8d48-4f22-b18d-1175d53ba670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:35.486108 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa3b5e-8d48-4f22-b18d-1175d53ba670 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:35.486791 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa3b5e-8d48-4f22-b18d-1175d53ba670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:35.488766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa3b5e-8d48-4f22-b18d-1175d53ba670 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:35.508872 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1070/2112] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:06:35 2022] POST /identity/v3/users => generated 295 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:06:35.512852 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced4b59-2670-430a-a84b-6a112816cd1f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:35.523061 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced4b59-2670-430a-a84b-6a112816cd1f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:35.529248 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e8de6-d2e3-4fb6-9402-3316abe2897e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:35.529934 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e8de6-d2e3-4fb6-9402-3316abe2897e admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:35.530216 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e8de6-d2e3-4fb6-9402-3316abe2897e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:35.530494 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e8de6-d2e3-4fb6-9402-3316abe2897e admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:35.531229 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e8de6-d2e3-4fb6-9402-3316abe2897e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:35.532975 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e8de6-d2e3-4fb6-9402-3316abe2897e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:35.543894 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1043/2113] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:35.547993 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa3b5e-8d48-4f22-b18d-1175d53ba670 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:35.558464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa3b5e-8d48-4f22-b18d-1175d53ba670 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:35.563115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afa264-2849-4ef2-afc1-5b7ff4f1e6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:35.564039 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afa264-2849-4ef2-afc1-5b7ff4f1e6fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:35.564326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afa264-2849-4ef2-afc1-5b7ff4f1e6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:35.564604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afa264-2849-4ef2-afc1-5b7ff4f1e6fc admin admin] PATH_INFO: `/v3/projects/826698f3537e489bb85fda47779f11fd/users/837e63dc218b4710a98ea949bc0a926a/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:35.579455 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79afa264-2849-4ef2-afc1-5b7ff4f1e6fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=826698f3537e489bb85fda47779f11fd, user_id=837e63dc218b4710a98ea949bc0a926a, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:35.582155 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79afa264-2849-4ef2-afc1-5b7ff4f1e6fc admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:35.595213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1071/2114] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:35 2022] PUT /identity/v3/projects/826698f3537e489bb85fda47779f11fd/users/837e63dc218b4710a98ea949bc0a926a/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:35.599608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e8de6-d2e3-4fb6-9402-3316abe2897e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:35.609763 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e8de6-d2e3-4fb6-9402-3316abe2897e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:35.665151 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd77a2-950a-49dd-9a21-b43e4ff94965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:35.665815 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd77a2-950a-49dd-9a21-b43e4ff94965 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:35.666102 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd77a2-950a-49dd-9a21-b43e4ff94965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:35.666420 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd77a2-950a-49dd-9a21-b43e4ff94965 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:35.667114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd77a2-950a-49dd-9a21-b43e4ff94965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:35.668774 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd77a2-950a-49dd-9a21-b43e4ff94965 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:35.682491 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1044/2115] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:35.683766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afa264-2849-4ef2-afc1-5b7ff4f1e6fc admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:35.693793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afa264-2849-4ef2-afc1-5b7ff4f1e6fc admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:35.698527 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fcbb0-5076-4a3d-bcda-ced3b64fc1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:35.699448 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fcbb0-5076-4a3d-bcda-ced3b64fc1d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:35.699762 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fcbb0-5076-4a3d-bcda-ced3b64fc1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:35.700042 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fcbb0-5076-4a3d-bcda-ced3b64fc1d7 admin admin] PATH_INFO: `/v3/projects/826698f3537e489bb85fda47779f11fd/users/837e63dc218b4710a98ea949bc0a926a/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:35.702047 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fcbb0-5076-4a3d-bcda-ced3b64fc1d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=826698f3537e489bb85fda47779f11fd, user_id=837e63dc218b4710a98ea949bc0a926a, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:35.704789 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fcbb0-5076-4a3d-bcda-ced3b64fc1d7 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:35.715513 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1072/2116] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:35 2022] PUT /identity/v3/projects/826698f3537e489bb85fda47779f11fd/users/837e63dc218b4710a98ea949bc0a926a/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:35.726137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad46b64-aa9f-4710-b6d4-1e693d906297 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:35.726433 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad46b64-aa9f-4710-b6d4-1e693d906297 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:35.726718 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad46b64-aa9f-4710-b6d4-1e693d906297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:35.753406 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0ad46b64-aa9f-4710-b6d4-1e693d906297 None None] MFA Rules not processed for user `837e63dc218b4710a98ea949bc0a926a`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:35.754626 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0ad46b64-aa9f-4710-b6d4-1e693d906297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:35.832220 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1045/2117] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:35.844336 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fcbb0-5076-4a3d-bcda-ced3b64fc1d7 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:35.846299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-394fcbb0-5076-4a3d-bcda-ced3b64fc1d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:35.903388 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fcbb0-5076-4a3d-bcda-ced3b64fc1d7 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:35.907097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6863a9-5d9c-4596-9f7d-bf6f2dfa7f03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:35.907762 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6863a9-5d9c-4596-9f7d-bf6f2dfa7f03 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:35.908048 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6863a9-5d9c-4596-9f7d-bf6f2dfa7f03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:35.908329 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6863a9-5d9c-4596-9f7d-bf6f2dfa7f03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:35.952218 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:35.965253 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6863a9-5d9c-4596-9f7d-bf6f2dfa7f03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:35.966809 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6863a9-5d9c-4596-9f7d-bf6f2dfa7f03 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:35.976182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1073/2118] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:37.480210 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad46b64-aa9f-4710-b6d4-1e693d906297 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:37.493275 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad46b64-aa9f-4710-b6d4-1e693d906297 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:37.497933 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae3b52-2c36-4eae-a4b5-09151549ae39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:37.498585 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae3b52-2c36-4eae-a4b5-09151549ae39 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:37.498872 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae3b52-2c36-4eae-a4b5-09151549ae39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:37.499150 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae3b52-2c36-4eae-a4b5-09151549ae39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:37.501515 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e0ae3b52-2c36-4eae-a4b5-09151549ae39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:37.562139 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:37.578881 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae3b52-2c36-4eae-a4b5-09151549ae39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:37.580480 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae3b52-2c36-4eae-a4b5-09151549ae39 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:37.590489 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1046/2119] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:37.979053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6863a9-5d9c-4596-9f7d-bf6f2dfa7f03 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:37.980486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8c6863a9-5d9c-4596-9f7d-bf6f2dfa7f03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:38.046766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6863a9-5d9c-4596-9f7d-bf6f2dfa7f03 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:38.051178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61e293-8656-4fd6-9d71-71e20ea2f1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:38.052078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61e293-8656-4fd6-9d71-71e20ea2f1b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:38.052356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61e293-8656-4fd6-9d71-71e20ea2f1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:38.052768 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61e293-8656-4fd6-9d71-71e20ea2f1b3 admin admin] PATH_INFO: `/v3/users/870bf3565a9248bb9663dd6fe4cc23bf` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:38.053952 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61e293-8656-4fd6-9d71-71e20ea2f1b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=870bf3565a9248bb9663dd6fe4cc23bf)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:38.055928 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61e293-8656-4fd6-9d71-71e20ea2f1b3 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:38.102841 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9f61e293-8656-4fd6-9d71-71e20ea2f1b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '870bf3565a9248bb9663dd6fe4cc23bf'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:38.103511 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9f61e293-8656-4fd6-9d71-71e20ea2f1b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '870bf3565a9248bb9663dd6fe4cc23bf'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:38.104142 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9f61e293-8656-4fd6-9d71-71e20ea2f1b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '870bf3565a9248bb9663dd6fe4cc23bf'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:38.111334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9f61e293-8656-4fd6-9d71-71e20ea2f1b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '870bf3565a9248bb9663dd6fe4cc23bf'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:38.124213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9f61e293-8656-4fd6-9d71-71e20ea2f1b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '870bf3565a9248bb9663dd6fe4cc23bf'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:38.137491 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1074/2120] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:06:37 2022] DELETE /identity/v3/users/870bf3565a9248bb9663dd6fe4cc23bf => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:38.142263 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60a28b-023e-4505-9bb1-5ee48dd489ac None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:38.142564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60a28b-023e-4505-9bb1-5ee48dd489ac None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:38.142847 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf60a28b-023e-4505-9bb1-5ee48dd489ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:38.167689 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-bf60a28b-023e-4505-9bb1-5ee48dd489ac None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:38.168977 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bf60a28b-023e-4505-9bb1-5ee48dd489ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:38.229336 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1047/2121] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:38.238947 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61e293-8656-4fd6-9d71-71e20ea2f1b3 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:38.240403 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9f61e293-8656-4fd6-9d71-71e20ea2f1b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:38.296324 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61e293-8656-4fd6-9d71-71e20ea2f1b3 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:38.299989 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d941f-5c93-43d8-9281-11c5df6a6337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:38.300586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d941f-5c93-43d8-9281-11c5df6a6337 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:38.300862 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d941f-5c93-43d8-9281-11c5df6a6337 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:38.301136 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d941f-5c93-43d8-9281-11c5df6a6337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:38.310044 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d941f-5c93-43d8-9281-11c5df6a6337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:38.311624 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d941f-5c93-43d8-9281-11c5df6a6337 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:38.321379 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1075/2122] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:38.587710 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60a28b-023e-4505-9bb1-5ee48dd489ac None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:38.589281 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bf60a28b-023e-4505-9bb1-5ee48dd489ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:38.601602 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf60a28b-023e-4505-9bb1-5ee48dd489ac None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:38.606722 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f964fa-f18a-4216-bbfb-0ed0892159e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:38.607835 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f964fa-f18a-4216-bbfb-0ed0892159e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:38.608510 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f964fa-f18a-4216-bbfb-0ed0892159e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:38.608937 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f964fa-f18a-4216-bbfb-0ed0892159e9 admin admin] PATH_INFO: `/v3/projects/b40b205b11294061b645361a5b491525` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:38.610458 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f964fa-f18a-4216-bbfb-0ed0892159e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b40b205b11294061b645361a5b491525)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:38.612398 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f964fa-f18a-4216-bbfb-0ed0892159e9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:38.664718 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-08f964fa-f18a-4216-bbfb-0ed0892159e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b40b205b11294061b645361a5b491525', 'request_id': 'req-08f964fa-f18a-4216-bbfb-0ed0892159e9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:38.671529 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-08f964fa-f18a-4216-bbfb-0ed0892159e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b40b205b11294061b645361a5b491525', 'request_id': 'req-08f964fa-f18a-4216-bbfb-0ed0892159e9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:38.677594 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-08f964fa-f18a-4216-bbfb-0ed0892159e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b40b205b11294061b645361a5b491525', 'request_id': 'req-08f964fa-f18a-4216-bbfb-0ed0892159e9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:38.687623 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-08f964fa-f18a-4216-bbfb-0ed0892159e9 admin admin] The token cache is being invalidate because project b40b205b11294061b645361a5b491525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:06:38.687931 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-08f964fa-f18a-4216-bbfb-0ed0892159e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:38.688550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-08f964fa-f18a-4216-bbfb-0ed0892159e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:38.690065 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1048/2123] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:06:38 2022] DELETE /identity/v3/projects/b40b205b11294061b645361a5b491525 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:38.694473 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d941f-5c93-43d8-9281-11c5df6a6337 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:38.704360 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d941f-5c93-43d8-9281-11c5df6a6337 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:38.708990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:38.763418 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7156d4f-05ea-4eab-b908-408fb6a04b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:38.764277 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7156d4f-05ea-4eab-b908-408fb6a04b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:38.764562 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7156d4f-05ea-4eab-b908-408fb6a04b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:38.764841 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7156d4f-05ea-4eab-b908-408fb6a04b01 admin admin] PATH_INFO: `/v3/users/dcd1544faab0412db3b47dfb471f54d5` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:38.766049 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7156d4f-05ea-4eab-b908-408fb6a04b01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd1544faab0412db3b47dfb471f54d5)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:38.768014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7156d4f-05ea-4eab-b908-408fb6a04b01 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:38.815241 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e7156d4f-05ea-4eab-b908-408fb6a04b01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd1544faab0412db3b47dfb471f54d5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:38.815918 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e7156d4f-05ea-4eab-b908-408fb6a04b01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd1544faab0412db3b47dfb471f54d5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:38.816635 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e7156d4f-05ea-4eab-b908-408fb6a04b01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd1544faab0412db3b47dfb471f54d5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:38.828721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e7156d4f-05ea-4eab-b908-408fb6a04b01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd1544faab0412db3b47dfb471f54d5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:38.841190 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-e7156d4f-05ea-4eab-b908-408fb6a04b01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd1544faab0412db3b47dfb471f54d5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:38.854141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1076/2124] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:06:38 2022] DELETE /identity/v3/users/dcd1544faab0412db3b47dfb471f54d5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:39.118502 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f964fa-f18a-4216-bbfb-0ed0892159e9 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:39.120070 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-08f964fa-f18a-4216-bbfb-0ed0892159e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:39.134972 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f964fa-f18a-4216-bbfb-0ed0892159e9 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:39.193539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d036040-8f95-4ce1-bd7e-26dabf61b020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:39.194531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d036040-8f95-4ce1-bd7e-26dabf61b020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:39.194819 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d036040-8f95-4ce1-bd7e-26dabf61b020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:39.195116 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d036040-8f95-4ce1-bd7e-26dabf61b020 admin admin] PATH_INFO: `/v3/projects/ca303777064e44309b13be93ae81307a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:39.196342 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d036040-8f95-4ce1-bd7e-26dabf61b020 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca303777064e44309b13be93ae81307a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:39.198263 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d036040-8f95-4ce1-bd7e-26dabf61b020 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:39.215292 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:39.248370 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1d036040-8f95-4ce1-bd7e-26dabf61b020 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca303777064e44309b13be93ae81307a', 'request_id': 'req-1d036040-8f95-4ce1-bd7e-26dabf61b020'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:39.256063 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1d036040-8f95-4ce1-bd7e-26dabf61b020 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca303777064e44309b13be93ae81307a', 'request_id': 'req-1d036040-8f95-4ce1-bd7e-26dabf61b020'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:39.262593 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1d036040-8f95-4ce1-bd7e-26dabf61b020 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca303777064e44309b13be93ae81307a', 'request_id': 'req-1d036040-8f95-4ce1-bd7e-26dabf61b020'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:39.273534 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1d036040-8f95-4ce1-bd7e-26dabf61b020 admin admin] The token cache is being invalidate because project ca303777064e44309b13be93ae81307a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:06:39.273821 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1d036040-8f95-4ce1-bd7e-26dabf61b020 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:39.274471 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1d036040-8f95-4ce1-bd7e-26dabf61b020 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:39.276114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1049/2125] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:06:39 2022] DELETE /identity/v3/projects/ca303777064e44309b13be93ae81307a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:39.280087 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7156d4f-05ea-4eab-b908-408fb6a04b01 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:39.281493 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e7156d4f-05ea-4eab-b908-408fb6a04b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:39.295192 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7156d4f-05ea-4eab-b908-408fb6a04b01 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:39.368882 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e5924-e4fb-4efb-a3db-b702378e2cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:39.369758 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e5924-e4fb-4efb-a3db-b702378e2cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:39.370042 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e5924-e4fb-4efb-a3db-b702378e2cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:39.370322 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e5924-e4fb-4efb-a3db-b702378e2cab admin admin] PATH_INFO: `/v3/users/74c7e46d043b42fc8b8fc4a6d29ca3cb` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:39.371808 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e5924-e4fb-4efb-a3db-b702378e2cab admin admin] RBAC: Authorizing `identity:delete_user(user_id=74c7e46d043b42fc8b8fc4a6d29ca3cb)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:39.373739 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e5924-e4fb-4efb-a3db-b702378e2cab admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:39.405045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:39.420730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5d2e5924-e4fb-4efb-a3db-b702378e2cab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74c7e46d043b42fc8b8fc4a6d29ca3cb'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:39.421381 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5d2e5924-e4fb-4efb-a3db-b702378e2cab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74c7e46d043b42fc8b8fc4a6d29ca3cb'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:39.421991 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5d2e5924-e4fb-4efb-a3db-b702378e2cab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74c7e46d043b42fc8b8fc4a6d29ca3cb'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:39.429798 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5d2e5924-e4fb-4efb-a3db-b702378e2cab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74c7e46d043b42fc8b8fc4a6d29ca3cb'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:39.441461 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5d2e5924-e4fb-4efb-a3db-b702378e2cab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74c7e46d043b42fc8b8fc4a6d29ca3cb'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:39.453329 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1077/2126] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:06:39 2022] DELETE /identity/v3/users/74c7e46d043b42fc8b8fc4a6d29ca3cb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:39.716498 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d036040-8f95-4ce1-bd7e-26dabf61b020 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:39.718058 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1d036040-8f95-4ce1-bd7e-26dabf61b020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:39.731653 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d036040-8f95-4ce1-bd7e-26dabf61b020 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:39.789428 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619f557-08a8-4910-885a-4ac7b511015d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:39.790296 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619f557-08a8-4910-885a-4ac7b511015d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:39.790607 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619f557-08a8-4910-885a-4ac7b511015d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:39.790885 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619f557-08a8-4910-885a-4ac7b511015d admin admin] PATH_INFO: `/v3/projects/08ac2c40cddc49afa037e197e149dd9c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:39.792126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9619f557-08a8-4910-885a-4ac7b511015d admin admin] RBAC: Authorizing `identity:delete_project(project_id=08ac2c40cddc49afa037e197e149dd9c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:39.794452 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9619f557-08a8-4910-885a-4ac7b511015d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:39.841946 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9619f557-08a8-4910-885a-4ac7b511015d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08ac2c40cddc49afa037e197e149dd9c', 'request_id': 'req-9619f557-08a8-4910-885a-4ac7b511015d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:39.850320 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9619f557-08a8-4910-885a-4ac7b511015d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08ac2c40cddc49afa037e197e149dd9c', 'request_id': 'req-9619f557-08a8-4910-885a-4ac7b511015d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:39.860117 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9619f557-08a8-4910-885a-4ac7b511015d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08ac2c40cddc49afa037e197e149dd9c', 'request_id': 'req-9619f557-08a8-4910-885a-4ac7b511015d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:39.870940 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9619f557-08a8-4910-885a-4ac7b511015d admin admin] The token cache is being invalidate because project 08ac2c40cddc49afa037e197e149dd9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:06:39.871265 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9619f557-08a8-4910-885a-4ac7b511015d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:39.871910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9619f557-08a8-4910-885a-4ac7b511015d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:39.873446 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1050/2127] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:06:39 2022] DELETE /identity/v3/projects/08ac2c40cddc49afa037e197e149dd9c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:39.878276 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94bdd7-021e-46ab-bc97-38e12ea3d019 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:39.878568 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94bdd7-021e-46ab-bc97-38e12ea3d019 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:39.878848 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94bdd7-021e-46ab-bc97-38e12ea3d019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:39.898349 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-be94bdd7-021e-46ab-bc97-38e12ea3d019 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:39.899667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-be94bdd7-021e-46ab-bc97-38e12ea3d019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:39.959898 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1078/2128] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:39.968505 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774ba26-5c30-405e-8c45-0af9176fdb45 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:39.968819 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774ba26-5c30-405e-8c45-0af9176fdb45 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:39.969099 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774ba26-5c30-405e-8c45-0af9176fdb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:39.986964 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c774ba26-5c30-405e-8c45-0af9176fdb45 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:39.988214 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c774ba26-5c30-405e-8c45-0af9176fdb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:39.996294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1051/2129] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:40.000319 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94bdd7-021e-46ab-bc97-38e12ea3d019 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:40.010796 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94bdd7-021e-46ab-bc97-38e12ea3d019 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:40.015354 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710f460-05fe-4c71-b015-48a2d907cf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:40.015999 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710f460-05fe-4c71-b015-48a2d907cf9b admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:40.016281 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710f460-05fe-4c71-b015-48a2d907cf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:40.016556 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710f460-05fe-4c71-b015-48a2d907cf9b admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:40.017290 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710f460-05fe-4c71-b015-48a2d907cf9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:06:40.017598 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710f460-05fe-4c71-b015-48a2d907cf9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:40.019221 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710f460-05fe-4c71-b015-48a2d907cf9b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:40.031685 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1079/2130] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:06:40.035051 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774ba26-5c30-405e-8c45-0af9176fdb45 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:40.044125 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774ba26-5c30-405e-8c45-0af9176fdb45 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:40.048666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334738e-d4c6-4738-84f2-8da8617b8aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:40.049303 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334738e-d4c6-4738-84f2-8da8617b8aee admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:40.049586 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334738e-d4c6-4738-84f2-8da8617b8aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:40.049883 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334738e-d4c6-4738-84f2-8da8617b8aee admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:40.050573 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334738e-d4c6-4738-84f2-8da8617b8aee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:40.052515 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334738e-d4c6-4738-84f2-8da8617b8aee admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:40.077210 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1052/2131] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:06:40 2022] POST /identity/v3/projects => generated 373 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:06:40.081517 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710f460-05fe-4c71-b015-48a2d907cf9b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:40.092288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710f460-05fe-4c71-b015-48a2d907cf9b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:40.148163 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e911b-c34b-467c-8042-a869d2cc791a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:40.148840 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e911b-c34b-467c-8042-a869d2cc791a admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:40.149120 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e911b-c34b-467c-8042-a869d2cc791a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:40.149393 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e911b-c34b-467c-8042-a869d2cc791a admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:40.150076 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e911b-c34b-467c-8042-a869d2cc791a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:40.152006 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e911b-c34b-467c-8042-a869d2cc791a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:40.170781 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1080/2132] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:06:40 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:06:40.174797 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334738e-d4c6-4738-84f2-8da8617b8aee admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:40.184716 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334738e-d4c6-4738-84f2-8da8617b8aee admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:40.189278 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768f36f-36f8-4864-85f4-c1d8ffe82c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:40.189927 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768f36f-36f8-4864-85f4-c1d8ffe82c2a admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:40.190211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768f36f-36f8-4864-85f4-c1d8ffe82c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:40.190486 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768f36f-36f8-4864-85f4-c1d8ffe82c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:40.191261 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768f36f-36f8-4864-85f4-c1d8ffe82c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:40.192917 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768f36f-36f8-4864-85f4-c1d8ffe82c2a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:40.194665 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:40.205848 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1053/2133] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:40.210139 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e911b-c34b-467c-8042-a869d2cc791a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:40.220054 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e911b-c34b-467c-8042-a869d2cc791a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:40.224691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3298c85-b42a-4cca-8d79-91066acd2ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:40.225343 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3298c85-b42a-4cca-8d79-91066acd2ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:40.225629 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3298c85-b42a-4cca-8d79-91066acd2ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:40.225910 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3298c85-b42a-4cca-8d79-91066acd2ab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:40.226633 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3298c85-b42a-4cca-8d79-91066acd2ab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:40.228260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3298c85-b42a-4cca-8d79-91066acd2ab3 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:40.237945 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1081/2134] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:40.242485 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768f36f-36f8-4864-85f4-c1d8ffe82c2a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:40.252412 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768f36f-36f8-4864-85f4-c1d8ffe82c2a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:40.258176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b78e2-961b-4cb6-a12f-d1b9aef2796a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:40.259052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b78e2-961b-4cb6-a12f-d1b9aef2796a admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:40.259379 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b78e2-961b-4cb6-a12f-d1b9aef2796a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:40.259656 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b78e2-961b-4cb6-a12f-d1b9aef2796a admin admin] PATH_INFO: `/v3/projects/53ceaeb0b04c4ad5962cffbceff7a251/users/fa0c971921814b3880f3d3521fa0ffd2/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:40.274010 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b78e2-961b-4cb6-a12f-d1b9aef2796a admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ceaeb0b04c4ad5962cffbceff7a251, user_id=fa0c971921814b3880f3d3521fa0ffd2, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:40.276719 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b78e2-961b-4cb6-a12f-d1b9aef2796a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:40.289426 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1054/2135] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:40 2022] PUT /identity/v3/projects/53ceaeb0b04c4ad5962cffbceff7a251/users/fa0c971921814b3880f3d3521fa0ffd2/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:40.299806 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732856b7-09ef-4a7e-b2c1-6577baaf23f1 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:40.300266 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732856b7-09ef-4a7e-b2c1-6577baaf23f1 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:40.300404 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732856b7-09ef-4a7e-b2c1-6577baaf23f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:40.339487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:40.339487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-732856b7-09ef-4a7e-b2c1-6577baaf23f1 None None] MFA Rules not processed for user `fa0c971921814b3880f3d3521fa0ffd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:40.339487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-732856b7-09ef-4a7e-b2c1-6577baaf23f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:40.410755 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1082/2136] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:40.422018 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b78e2-961b-4cb6-a12f-d1b9aef2796a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:40.423824 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e47b78e2-961b-4cb6-a12f-d1b9aef2796a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:40.482240 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b78e2-961b-4cb6-a12f-d1b9aef2796a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:40.485934 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1c52c-f6b4-412a-856f-fafd5b5decdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:40.486692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1c52c-f6b4-412a-856f-fafd5b5decdf service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:40.486980 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1c52c-f6b4-412a-856f-fafd5b5decdf service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:40.487363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1c52c-f6b4-412a-856f-fafd5b5decdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:40.496841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1c52c-f6b4-412a-856f-fafd5b5decdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:40.498273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee1c52c-f6b4-412a-856f-fafd5b5decdf service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:40.507575 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1055/2137] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:40.530985 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732856b7-09ef-4a7e-b2c1-6577baaf23f1 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:40.596735 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732856b7-09ef-4a7e-b2c1-6577baaf23f1 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:40.602018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53189e-e4bb-4bb7-af04-62f85bbc54f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:40.602897 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53189e-e4bb-4bb7-af04-62f85bbc54f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:40.603185 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53189e-e4bb-4bb7-af04-62f85bbc54f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:40.603490 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53189e-e4bb-4bb7-af04-62f85bbc54f6 admin admin] PATH_INFO: `/v3/users/fa0c971921814b3880f3d3521fa0ffd2` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:40.604709 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53189e-e4bb-4bb7-af04-62f85bbc54f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa0c971921814b3880f3d3521fa0ffd2)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:40.606628 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53189e-e4bb-4bb7-af04-62f85bbc54f6 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:40.651909 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9e53189e-e4bb-4bb7-af04-62f85bbc54f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa0c971921814b3880f3d3521fa0ffd2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:40.652576 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9e53189e-e4bb-4bb7-af04-62f85bbc54f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa0c971921814b3880f3d3521fa0ffd2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:40.653205 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9e53189e-e4bb-4bb7-af04-62f85bbc54f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa0c971921814b3880f3d3521fa0ffd2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:40.660232 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9e53189e-e4bb-4bb7-af04-62f85bbc54f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa0c971921814b3880f3d3521fa0ffd2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:40.672683 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9e53189e-e4bb-4bb7-af04-62f85bbc54f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa0c971921814b3880f3d3521fa0ffd2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:40.685900 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1083/2138] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:06:40 2022] DELETE /identity/v3/users/fa0c971921814b3880f3d3521fa0ffd2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:40.690351 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53babd-aebd-4518-9b92-577b82cd5433 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:40.690645 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53babd-aebd-4518-9b92-577b82cd5433 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:40.690929 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53babd-aebd-4518-9b92-577b82cd5433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:40.708248 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0e53babd-aebd-4518-9b92-577b82cd5433 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:40.709519 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0e53babd-aebd-4518-9b92-577b82cd5433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:40.768559 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1056/2139] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:40.777970 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53189e-e4bb-4bb7-af04-62f85bbc54f6 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:40.779466 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9e53189e-e4bb-4bb7-af04-62f85bbc54f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:40.806164 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:40.840468 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53189e-e4bb-4bb7-af04-62f85bbc54f6 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:40.844003 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02b946-9c87-4959-9e41-0057617b1a41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:40.844640 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02b946-9c87-4959-9e41-0057617b1a41 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:40.844919 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02b946-9c87-4959-9e41-0057617b1a41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:40.845189 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02b946-9c87-4959-9e41-0057617b1a41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:40.854482 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02b946-9c87-4959-9e41-0057617b1a41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:40.855931 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02b946-9c87-4959-9e41-0057617b1a41 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:40.866087 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1084/2140] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:41.129904 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53babd-aebd-4518-9b92-577b82cd5433 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:41.131385 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0e53babd-aebd-4518-9b92-577b82cd5433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:41.143635 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53babd-aebd-4518-9b92-577b82cd5433 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:41.148971 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368cf83-6aaa-4e87-a7fe-8ee06934edb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:41.149910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368cf83-6aaa-4e87-a7fe-8ee06934edb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:41.150272 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368cf83-6aaa-4e87-a7fe-8ee06934edb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:41.150561 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368cf83-6aaa-4e87-a7fe-8ee06934edb3 admin admin] PATH_INFO: `/v3/projects/53ceaeb0b04c4ad5962cffbceff7a251` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:41.151852 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368cf83-6aaa-4e87-a7fe-8ee06934edb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53ceaeb0b04c4ad5962cffbceff7a251)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:41.153756 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368cf83-6aaa-4e87-a7fe-8ee06934edb3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:41.200288 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5368cf83-6aaa-4e87-a7fe-8ee06934edb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53ceaeb0b04c4ad5962cffbceff7a251', 'request_id': 'req-5368cf83-6aaa-4e87-a7fe-8ee06934edb3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:41.207569 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5368cf83-6aaa-4e87-a7fe-8ee06934edb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53ceaeb0b04c4ad5962cffbceff7a251', 'request_id': 'req-5368cf83-6aaa-4e87-a7fe-8ee06934edb3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:41.214284 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5368cf83-6aaa-4e87-a7fe-8ee06934edb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53ceaeb0b04c4ad5962cffbceff7a251', 'request_id': 'req-5368cf83-6aaa-4e87-a7fe-8ee06934edb3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:41.220416 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:41.226069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5368cf83-6aaa-4e87-a7fe-8ee06934edb3 admin admin] The token cache is being invalidate because project 53ceaeb0b04c4ad5962cffbceff7a251 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:06:41.226576 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5368cf83-6aaa-4e87-a7fe-8ee06934edb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:41.227684 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5368cf83-6aaa-4e87-a7fe-8ee06934edb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:06:41.229510 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1057/2141] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:06:41 2022] DELETE /identity/v3/projects/53ceaeb0b04c4ad5962cffbceff7a251 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:41.234318 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391f0ab-7f99-42bb-a20c-ffaee961f7f1 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:41.234606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391f0ab-7f99-42bb-a20c-ffaee961f7f1 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:41.234880 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391f0ab-7f99-42bb-a20c-ffaee961f7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:41.252174 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-8391f0ab-7f99-42bb-a20c-ffaee961f7f1 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:41.253353 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8391f0ab-7f99-42bb-a20c-ffaee961f7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:41.311547 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1085/2142] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:41.318894 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493a805-5b0e-49a9-a6e5-c001d73e0ea5 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:41.319162 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493a805-5b0e-49a9-a6e5-c001d73e0ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:41.319479 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493a805-5b0e-49a9-a6e5-c001d73e0ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:41.339190 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b493a805-5b0e-49a9-a6e5-c001d73e0ea5 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:41.340423 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b493a805-5b0e-49a9-a6e5-c001d73e0ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:41.348829 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1058/2143] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:41.353749 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391f0ab-7f99-42bb-a20c-ffaee961f7f1 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:41.363460 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391f0ab-7f99-42bb-a20c-ffaee961f7f1 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:41.368705 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd9a0d-7603-4e30-885b-648fa16f2c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:41.369354 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd9a0d-7603-4e30-885b-648fa16f2c67 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:41.369640 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd9a0d-7603-4e30-885b-648fa16f2c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:41.369925 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd9a0d-7603-4e30-885b-648fa16f2c67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:41.370909 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd9a0d-7603-4e30-885b-648fa16f2c67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:06:41.371241 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd9a0d-7603-4e30-885b-648fa16f2c67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:41.372930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd9a0d-7603-4e30-885b-648fa16f2c67 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:41.384806 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1086/2144] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 15:06:41.389124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493a805-5b0e-49a9-a6e5-c001d73e0ea5 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:41.398773 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493a805-5b0e-49a9-a6e5-c001d73e0ea5 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:41.403354 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b232eb9-5a6e-4314-a379-3a08357434ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:41.403990 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b232eb9-5a6e-4314-a379-3a08357434ba admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:41.404273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b232eb9-5a6e-4314-a379-3a08357434ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:41.404547 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b232eb9-5a6e-4314-a379-3a08357434ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:41.405340 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b232eb9-5a6e-4314-a379-3a08357434ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:41.407826 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b232eb9-5a6e-4314-a379-3a08357434ba admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:41.433714 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1059/2145] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:06:41 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:06:41.437837 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd9a0d-7603-4e30-885b-648fa16f2c67 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:41.448284 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd9a0d-7603-4e30-885b-648fa16f2c67 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:41.504172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847a3ab-95e7-4985-95e6-b29474fac5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:41.504399 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847a3ab-95e7-4985-95e6-b29474fac5c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:41.504657 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847a3ab-95e7-4985-95e6-b29474fac5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:41.504938 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847a3ab-95e7-4985-95e6-b29474fac5c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:41.505647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847a3ab-95e7-4985-95e6-b29474fac5c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:41.508109 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a847a3ab-95e7-4985-95e6-b29474fac5c9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:41.532213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1087/2146] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:06:41 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:06:41.533399 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b232eb9-5a6e-4314-a379-3a08357434ba admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:41.545324 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b232eb9-5a6e-4314-a379-3a08357434ba admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:41.549951 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff2951-0e50-4a2c-874b-83efc63a933c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:41.550615 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff2951-0e50-4a2c-874b-83efc63a933c admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:41.550903 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff2951-0e50-4a2c-874b-83efc63a933c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:41.551183 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff2951-0e50-4a2c-874b-83efc63a933c admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:41.551946 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff2951-0e50-4a2c-874b-83efc63a933c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:41.553532 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff2951-0e50-4a2c-874b-83efc63a933c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:41.564516 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1060/2147] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:41.569882 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847a3ab-95e7-4985-95e6-b29474fac5c9 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:41.580062 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847a3ab-95e7-4985-95e6-b29474fac5c9 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:41.586185 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3107f-52ad-4b32-ba7e-6d108df81179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:41.586844 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3107f-52ad-4b32-ba7e-6d108df81179 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:41.587122 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3107f-52ad-4b32-ba7e-6d108df81179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:41.587438 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3107f-52ad-4b32-ba7e-6d108df81179 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:41.588265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3107f-52ad-4b32-ba7e-6d108df81179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:41.589879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3107f-52ad-4b32-ba7e-6d108df81179 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:41.601025 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1088/2148] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:06:41.604989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff2951-0e50-4a2c-874b-83efc63a933c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:41.615336 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff2951-0e50-4a2c-874b-83efc63a933c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:41.620213 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb249d-2656-49dc-a68c-78ac44cdce85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:41.621399 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb249d-2656-49dc-a68c-78ac44cdce85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:41.621837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb249d-2656-49dc-a68c-78ac44cdce85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:41.622106 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb249d-2656-49dc-a68c-78ac44cdce85 admin admin] PATH_INFO: `/v3/projects/c2ef58d90a9945eca7132189425cb0c8/users/294fb8c5f9414199a14b5d436732db86/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:41.642861 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb249d-2656-49dc-a68c-78ac44cdce85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2ef58d90a9945eca7132189425cb0c8, user_id=294fb8c5f9414199a14b5d436732db86, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:41.642861 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb249d-2656-49dc-a68c-78ac44cdce85 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:41.657147 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1061/2149] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:06:41 2022] PUT /identity/v3/projects/c2ef58d90a9945eca7132189425cb0c8/users/294fb8c5f9414199a14b5d436732db86/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:06:41.667758 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248818e4-4b9f-4902-bb6d-478b423397cf None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:41.668046 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248818e4-4b9f-4902-bb6d-478b423397cf None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:41.668324 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248818e4-4b9f-4902-bb6d-478b423397cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:41.694475 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-248818e4-4b9f-4902-bb6d-478b423397cf None None] MFA Rules not processed for user `294fb8c5f9414199a14b5d436732db86`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:06:41.695724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-248818e4-4b9f-4902-bb6d-478b423397cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:41.714341 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:41.762430 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1089/2150] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:06:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:06:41.772944 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb249d-2656-49dc-a68c-78ac44cdce85 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:41.774669 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f8eb249d-2656-49dc-a68c-78ac44cdce85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:41.830879 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb249d-2656-49dc-a68c-78ac44cdce85 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:41.834586 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8b0e5-a3f0-45da-8a68-2664373d1e4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:41.835276 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8b0e5-a3f0-45da-8a68-2664373d1e4e service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:41.835568 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8b0e5-a3f0-45da-8a68-2664373d1e4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:41.835848 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8b0e5-a3f0-45da-8a68-2664373d1e4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:41.849745 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8b0e5-a3f0-45da-8a68-2664373d1e4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:41.851290 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8b0e5-a3f0-45da-8a68-2664373d1e4e service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:41.861212 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1062/2151] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:42.679152 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248818e4-4b9f-4902-bb6d-478b423397cf None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:06:42.680764 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-248818e4-4b9f-4902-bb6d-478b423397cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:42.692622 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248818e4-4b9f-4902-bb6d-478b423397cf None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:06:42.696304 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980d7ca-9278-4d11-a91b-fffc790d2bdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:06:42.696968 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980d7ca-9278-4d11-a91b-fffc790d2bdb service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:06:42.697248 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980d7ca-9278-4d11-a91b-fffc790d2bdb service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:06:42.697519 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980d7ca-9278-4d11-a91b-fffc790d2bdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:06:42.699276 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b980d7ca-9278-4d11-a91b-fffc790d2bdb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:06:42.762023 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b980d7ca-9278-4d11-a91b-fffc790d2bdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:06:42.763483 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b980d7ca-9278-4d11-a91b-fffc790d2bdb service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:06:42.773445 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1090/2152] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:06:42 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:06:51.856774 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:52.768620 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=48 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:17.865981 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8b0e5-a3f0-45da-8a68-2664373d1e4e service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:17.867518 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-89a8b0e5-a3f0-45da-8a68-2664373d1e4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:17.935248 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8b0e5-a3f0-45da-8a68-2664373d1e4e service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:17.939878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39672dda-035f-43e2-928b-9f0668338131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:17.940754 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39672dda-035f-43e2-928b-9f0668338131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:17.941038 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39672dda-035f-43e2-928b-9f0668338131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:17.941317 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39672dda-035f-43e2-928b-9f0668338131 admin admin] PATH_INFO: `/v3/users/6512f7cf03db456f9e6b8e611c3efa0c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:17.942506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39672dda-035f-43e2-928b-9f0668338131 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6512f7cf03db456f9e6b8e611c3efa0c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:17.944469 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39672dda-035f-43e2-928b-9f0668338131 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:17.997309 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-39672dda-035f-43e2-928b-9f0668338131 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6512f7cf03db456f9e6b8e611c3efa0c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:18.004138 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-39672dda-035f-43e2-928b-9f0668338131 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6512f7cf03db456f9e6b8e611c3efa0c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:18.016429 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-39672dda-035f-43e2-928b-9f0668338131 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6512f7cf03db456f9e6b8e611c3efa0c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:18.017208 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-39672dda-035f-43e2-928b-9f0668338131 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6512f7cf03db456f9e6b8e611c3efa0c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:18.017839 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-39672dda-035f-43e2-928b-9f0668338131 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6512f7cf03db456f9e6b8e611c3efa0c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:18.036145 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1063/2153] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:07:17 2022] DELETE /identity/v3/users/6512f7cf03db456f9e6b8e611c3efa0c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:18.041498 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c7b62-515d-4190-b7c3-b7bceaf619b6 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:18.042063 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c7b62-515d-4190-b7c3-b7bceaf619b6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:18.042063 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c7b62-515d-4190-b7c3-b7bceaf619b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:18.058782 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a45c7b62-515d-4190-b7c3-b7bceaf619b6 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:18.060072 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a45c7b62-515d-4190-b7c3-b7bceaf619b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:18.117990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1091/2154] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:18.128179 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39672dda-035f-43e2-928b-9f0668338131 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:18.129819 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-39672dda-035f-43e2-928b-9f0668338131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:18.188472 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39672dda-035f-43e2-928b-9f0668338131 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:18.192215 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf4231-a321-4761-a3e4-e68ecd1d9267 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:18.192863 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf4231-a321-4761-a3e4-e68ecd1d9267 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:18.193193 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf4231-a321-4761-a3e4-e68ecd1d9267 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:18.193460 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf4231-a321-4761-a3e4-e68ecd1d9267 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:18.205201 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf4231-a321-4761-a3e4-e68ecd1d9267 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:18.207233 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf4231-a321-4761-a3e4-e68ecd1d9267 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:18.219216 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1064/2155] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:07:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 15:07:18.500080 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c7b62-515d-4190-b7c3-b7bceaf619b6 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:18.501541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a45c7b62-515d-4190-b7c3-b7bceaf619b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:18.514767 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c7b62-515d-4190-b7c3-b7bceaf619b6 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:18.519569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d9c86-aefd-4481-98a7-0142dd6d4400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:18.520447 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d9c86-aefd-4481-98a7-0142dd6d4400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:18.520761 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d9c86-aefd-4481-98a7-0142dd6d4400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:18.521015 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d9c86-aefd-4481-98a7-0142dd6d4400 admin admin] PATH_INFO: `/v3/projects/ce5252c2c10640f5867c55c12f7224b9` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:18.522205 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d9c86-aefd-4481-98a7-0142dd6d4400 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce5252c2c10640f5867c55c12f7224b9)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:18.524217 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d9c86-aefd-4481-98a7-0142dd6d4400 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:18.571113 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-327d9c86-aefd-4481-98a7-0142dd6d4400 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce5252c2c10640f5867c55c12f7224b9', 'request_id': 'req-327d9c86-aefd-4481-98a7-0142dd6d4400'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:18.576709 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-327d9c86-aefd-4481-98a7-0142dd6d4400 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce5252c2c10640f5867c55c12f7224b9', 'request_id': 'req-327d9c86-aefd-4481-98a7-0142dd6d4400'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:18.583407 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-327d9c86-aefd-4481-98a7-0142dd6d4400 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce5252c2c10640f5867c55c12f7224b9', 'request_id': 'req-327d9c86-aefd-4481-98a7-0142dd6d4400'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:18.600102 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-327d9c86-aefd-4481-98a7-0142dd6d4400 admin admin] The token cache is being invalidate because project ce5252c2c10640f5867c55c12f7224b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:07:18.600396 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-327d9c86-aefd-4481-98a7-0142dd6d4400 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:18.601062 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-327d9c86-aefd-4481-98a7-0142dd6d4400 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:18.602628 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1092/2156] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:07:18 2022] DELETE /identity/v3/projects/ce5252c2c10640f5867c55c12f7224b9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:18.608337 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653b2e0-7069-4cb7-8db2-cbc35df44e9e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:18.609133 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653b2e0-7069-4cb7-8db2-cbc35df44e9e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:18.609133 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653b2e0-7069-4cb7-8db2-cbc35df44e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:18.628301 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-7653b2e0-7069-4cb7-8db2-cbc35df44e9e None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:18.629525 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7653b2e0-7069-4cb7-8db2-cbc35df44e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:18.648386 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:18.695809 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1065/2157] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:18.703924 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5a4cd-9965-40bc-8249-23a591ddbc61 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:18.704219 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5a4cd-9965-40bc-8249-23a591ddbc61 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:18.704501 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5a4cd-9965-40bc-8249-23a591ddbc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:18.722783 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-57b5a4cd-9965-40bc-8249-23a591ddbc61 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:18.724041 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-57b5a4cd-9965-40bc-8249-23a591ddbc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:18.732435 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1093/2158] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:07:18.736773 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653b2e0-7069-4cb7-8db2-cbc35df44e9e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:18.750226 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653b2e0-7069-4cb7-8db2-cbc35df44e9e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:18.754812 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd72e4c-0eb9-4cbf-b460-32c248e40aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:18.755505 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd72e4c-0eb9-4cbf-b460-32c248e40aec admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:18.755798 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd72e4c-0eb9-4cbf-b460-32c248e40aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:18.756082 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd72e4c-0eb9-4cbf-b460-32c248e40aec admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:18.756814 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd72e4c-0eb9-4cbf-b460-32c248e40aec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:07:18.757187 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd72e4c-0eb9-4cbf-b460-32c248e40aec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:18.759342 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd72e4c-0eb9-4cbf-b460-32c248e40aec admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:18.776552 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1066/2159] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 15:07:18.780609 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5a4cd-9965-40bc-8249-23a591ddbc61 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:18.790308 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5a4cd-9965-40bc-8249-23a591ddbc61 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:18.795305 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612b0ee-5ca4-4dd6-90d7-5d30fdcbf863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:18.796129 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612b0ee-5ca4-4dd6-90d7-5d30fdcbf863 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:18.796544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612b0ee-5ca4-4dd6-90d7-5d30fdcbf863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:18.796921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612b0ee-5ca4-4dd6-90d7-5d30fdcbf863 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:18.797616 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8612b0ee-5ca4-4dd6-90d7-5d30fdcbf863 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:18.799578 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8612b0ee-5ca4-4dd6-90d7-5d30fdcbf863 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:18.833006 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1094/2160] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:07:18 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:07:18.837007 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd72e4c-0eb9-4cbf-b460-32c248e40aec admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:18.847808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd72e4c-0eb9-4cbf-b460-32c248e40aec admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:18.917807 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e37cb-0e72-4607-82a3-260de09fb61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:18.918568 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e37cb-0e72-4607-82a3-260de09fb61c admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:18.919074 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e37cb-0e72-4607-82a3-260de09fb61c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:18.921368 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e37cb-0e72-4607-82a3-260de09fb61c admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:18.922181 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e37cb-0e72-4607-82a3-260de09fb61c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:18.924591 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e37cb-0e72-4607-82a3-260de09fb61c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:18.953675 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1067/2161] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:07:18 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:07:18.957844 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612b0ee-5ca4-4dd6-90d7-5d30fdcbf863 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:18.970134 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612b0ee-5ca4-4dd6-90d7-5d30fdcbf863 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:18.978497 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32cd4ef-ddd5-4710-b621-b5e8d954e6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:18.979167 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cd4ef-ddd5-4710-b621-b5e8d954e6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:18.979504 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cd4ef-ddd5-4710-b621-b5e8d954e6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:18.979780 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cd4ef-ddd5-4710-b621-b5e8d954e6f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:18.980508 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32cd4ef-ddd5-4710-b621-b5e8d954e6f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:18.988664 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32cd4ef-ddd5-4710-b621-b5e8d954e6f9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:19.005375 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1095/2162] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:07:19.009157 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e37cb-0e72-4607-82a3-260de09fb61c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:19.020185 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e37cb-0e72-4607-82a3-260de09fb61c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:19.024982 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d720a4-919a-4e6c-83a7-13763cb1078c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:19.025599 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d720a4-919a-4e6c-83a7-13763cb1078c admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:19.025891 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d720a4-919a-4e6c-83a7-13763cb1078c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:19.026171 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d720a4-919a-4e6c-83a7-13763cb1078c admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:19.026898 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d720a4-919a-4e6c-83a7-13763cb1078c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:19.028539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d720a4-919a-4e6c-83a7-13763cb1078c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:19.039722 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1068/2163] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:07:19.043672 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32cd4ef-ddd5-4710-b621-b5e8d954e6f9 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:19.056961 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32cd4ef-ddd5-4710-b621-b5e8d954e6f9 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:19.062742 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadc311-2c99-44e8-bec2-e07a5cb49824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:19.063666 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadc311-2c99-44e8-bec2-e07a5cb49824 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:19.064149 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d720a4-919a-4e6c-83a7-13763cb1078c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:19.065950 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c4d720a4-919a-4e6c-83a7-13763cb1078c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:19.067509 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadc311-2c99-44e8-bec2-e07a5cb49824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:19.067801 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadc311-2c99-44e8-bec2-e07a5cb49824 admin admin] PATH_INFO: `/v3/projects/7b292769048d41e2b1459d7ce22ae4a8/users/ae76c84eb6e24e499a283d5985a37e60/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:19.086427 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cadc311-2c99-44e8-bec2-e07a5cb49824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b292769048d41e2b1459d7ce22ae4a8, user_id=ae76c84eb6e24e499a283d5985a37e60, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:19.086697 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d720a4-919a-4e6c-83a7-13763cb1078c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:19.093165 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd6a35-6e37-4c36-9836-d673d97171f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:19.093401 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cadc311-2c99-44e8-bec2-e07a5cb49824 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:19.095029 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd6a35-6e37-4c36-9836-d673d97171f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:19.095961 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd6a35-6e37-4c36-9836-d673d97171f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:19.096428 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd6a35-6e37-4c36-9836-d673d97171f2 admin admin] PATH_INFO: `/v3/users/294fb8c5f9414199a14b5d436732db86` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:19.099064 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd6a35-6e37-4c36-9836-d673d97171f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=294fb8c5f9414199a14b5d436732db86)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:19.101905 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd6a35-6e37-4c36-9836-d673d97171f2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:19.110425 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1096/2164] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:07:19 2022] PUT /identity/v3/projects/7b292769048d41e2b1459d7ce22ae4a8/users/ae76c84eb6e24e499a283d5985a37e60/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:19.122062 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedb9d9-c7a8-48a4-b3bf-2f8806a73e46 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:19.122425 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedb9d9-c7a8-48a4-b3bf-2f8806a73e46 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:19.122794 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedb9d9-c7a8-48a4-b3bf-2f8806a73e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:19.151567 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-cdcd6a35-6e37-4c36-9836-d673d97171f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '294fb8c5f9414199a14b5d436732db86'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:19.151755 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-beedb9d9-c7a8-48a4-b3bf-2f8806a73e46 None None] MFA Rules not processed for user `ae76c84eb6e24e499a283d5985a37e60`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:19.152898 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-beedb9d9-c7a8-48a4-b3bf-2f8806a73e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:19.158575 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-cdcd6a35-6e37-4c36-9836-d673d97171f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '294fb8c5f9414199a14b5d436732db86'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:19.161078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:19.172421 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-cdcd6a35-6e37-4c36-9836-d673d97171f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '294fb8c5f9414199a14b5d436732db86'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:19.173125 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-cdcd6a35-6e37-4c36-9836-d673d97171f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '294fb8c5f9414199a14b5d436732db86'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:19.174087 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-cdcd6a35-6e37-4c36-9836-d673d97171f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '294fb8c5f9414199a14b5d436732db86'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:19.183650 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:19.191459 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1069/2165] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:07:19 2022] DELETE /identity/v3/users/294fb8c5f9414199a14b5d436732db86 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:19.193065 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabda421-50ed-4fdc-9f61-55ba0067d310 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:19.193357 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabda421-50ed-4fdc-9f61-55ba0067d310 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:19.193838 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabda421-50ed-4fdc-9f61-55ba0067d310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:19.213623 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-cabda421-50ed-4fdc-9f61-55ba0067d310 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:19.214877 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-cabda421-50ed-4fdc-9f61-55ba0067d310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:19.221382 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1097/2166] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:07:19.225819 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedb9d9-c7a8-48a4-b3bf-2f8806a73e46 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:19.227750 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-beedb9d9-c7a8-48a4-b3bf-2f8806a73e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:19.281683 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1070/2167] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:19.292171 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabda421-50ed-4fdc-9f61-55ba0067d310 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:19.293555 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-cabda421-50ed-4fdc-9f61-55ba0067d310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:19.298099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedb9d9-c7a8-48a4-b3bf-2f8806a73e46 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:19.303377 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a18b72-62cb-4e17-8ffe-fdd53082f616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:19.304357 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a18b72-62cb-4e17-8ffe-fdd53082f616 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:19.304648 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a18b72-62cb-4e17-8ffe-fdd53082f616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:19.304941 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a18b72-62cb-4e17-8ffe-fdd53082f616 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:19.305847 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a18b72-62cb-4e17-8ffe-fdd53082f616 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:19.307987 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a18b72-62cb-4e17-8ffe-fdd53082f616 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:19.336006 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1098/2168] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:07:19 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:07:19.340423 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a18b72-62cb-4e17-8ffe-fdd53082f616 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:19.362386 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabda421-50ed-4fdc-9f61-55ba0067d310 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:19.409766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a18b72-62cb-4e17-8ffe-fdd53082f616 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:19.415976 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ec706-baf6-49f6-88bd-f3cb5c1b6899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:19.416677 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ec706-baf6-49f6-88bd-f3cb5c1b6899 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:19.416860 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede4a1e-08d4-4970-936d-4020cb928716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:19.416977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ec706-baf6-49f6-88bd-f3cb5c1b6899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:19.417221 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ec706-baf6-49f6-88bd-f3cb5c1b6899 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:19.417479 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede4a1e-08d4-4970-936d-4020cb928716 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:19.417751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede4a1e-08d4-4970-936d-4020cb928716 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:19.418027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede4a1e-08d4-4970-936d-4020cb928716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:19.418130 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ec706-baf6-49f6-88bd-f3cb5c1b6899 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:19.420073 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ec706-baf6-49f6-88bd-f3cb5c1b6899 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:19.427596 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede4a1e-08d4-4970-936d-4020cb928716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:19.429153 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede4a1e-08d4-4970-936d-4020cb928716 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:19.440365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1071/2169] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:07:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 15:07:19.469321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1099/2170] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:07:19 2022] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:07:19.470406 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede4a1e-08d4-4970-936d-4020cb928716 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:19.483795 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede4a1e-08d4-4970-936d-4020cb928716 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:19.489375 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39705de-148f-4aa6-b724-5cc15ce388a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:19.490204 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39705de-148f-4aa6-b724-5cc15ce388a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:19.490530 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39705de-148f-4aa6-b724-5cc15ce388a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:19.490699 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39705de-148f-4aa6-b724-5cc15ce388a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:19.491624 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39705de-148f-4aa6-b724-5cc15ce388a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:19.493440 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39705de-148f-4aa6-b724-5cc15ce388a2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:19.505559 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1072/2171] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:07:19.511477 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ec706-baf6-49f6-88bd-f3cb5c1b6899 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:19.518563 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:19.524392 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ec706-baf6-49f6-88bd-f3cb5c1b6899 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:19.531073 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e75f4-0697-4756-98a0-119696976246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:19.531575 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e75f4-0697-4756-98a0-119696976246 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:19.531931 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e75f4-0697-4756-98a0-119696976246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:19.532335 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e75f4-0697-4756-98a0-119696976246 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:19.533248 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e75f4-0697-4756-98a0-119696976246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:19.535003 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e75f4-0697-4756-98a0-119696976246 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:19.549031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1100/2172] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:07:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:07:19.553670 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39705de-148f-4aa6-b724-5cc15ce388a2 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:19.625127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39705de-148f-4aa6-b724-5cc15ce388a2 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:19.630630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849419ef-d470-4ef0-b430-452985c9738e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:19.631563 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849419ef-d470-4ef0-b430-452985c9738e admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:19.632023 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849419ef-d470-4ef0-b430-452985c9738e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:19.633163 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849419ef-d470-4ef0-b430-452985c9738e admin admin] PATH_INFO: `/v3/projects/97fe2574ee70458d97078d5615054eb4/users/365c7b10574747a283ba5e9870242b86/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:19.637932 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:19.652569 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849419ef-d470-4ef0-b430-452985c9738e admin admin] RBAC: Authorizing `identity:create_grant(project_id=97fe2574ee70458d97078d5615054eb4, user_id=365c7b10574747a283ba5e9870242b86, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:19.655654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849419ef-d470-4ef0-b430-452985c9738e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:19.677376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1073/2173] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:07:19 2022] PUT /identity/v3/projects/97fe2574ee70458d97078d5615054eb4/users/365c7b10574747a283ba5e9870242b86/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:07:19.687862 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000d1ba-cf0c-4feb-8aa1-54840bab6bd8 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:19.688046 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000d1ba-cf0c-4feb-8aa1-54840bab6bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:19.688332 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000d1ba-cf0c-4feb-8aa1-54840bab6bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:19.722755 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-6000d1ba-cf0c-4feb-8aa1-54840bab6bd8 None None] MFA Rules not processed for user `365c7b10574747a283ba5e9870242b86`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:19.724159 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6000d1ba-cf0c-4feb-8aa1-54840bab6bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:19.748895 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849419ef-d470-4ef0-b430-452985c9738e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:19.752866 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-849419ef-d470-4ef0-b430-452985c9738e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:19.812861 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1101/2174] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:19.817200 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000d1ba-cf0c-4feb-8aa1-54840bab6bd8 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:19.840645 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849419ef-d470-4ef0-b430-452985c9738e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:19.846994 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7940c9-1331-4018-bc1b-058189ee1f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:19.847891 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7940c9-1331-4018-bc1b-058189ee1f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:19.848177 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7940c9-1331-4018-bc1b-058189ee1f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:19.848452 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7940c9-1331-4018-bc1b-058189ee1f90 admin admin] PATH_INFO: `/v3/projects/c2ef58d90a9945eca7132189425cb0c8` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:19.849620 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7940c9-1331-4018-bc1b-058189ee1f90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2ef58d90a9945eca7132189425cb0c8)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:19.852229 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7940c9-1331-4018-bc1b-058189ee1f90 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:19.882458 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000d1ba-cf0c-4feb-8aa1-54840bab6bd8 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:19.887129 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229eaf7-9eee-4ae1-a1bb-13c0dc8ea8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:19.887823 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229eaf7-9eee-4ae1-a1bb-13c0dc8ea8a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:19.888109 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229eaf7-9eee-4ae1-a1bb-13c0dc8ea8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:19.888385 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229eaf7-9eee-4ae1-a1bb-13c0dc8ea8a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:19.889081 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229eaf7-9eee-4ae1-a1bb-13c0dc8ea8a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:19.890990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229eaf7-9eee-4ae1-a1bb-13c0dc8ea8a0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:19.898660 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ab7940c9-1331-4018-bc1b-058189ee1f90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2ef58d90a9945eca7132189425cb0c8', 'request_id': 'req-ab7940c9-1331-4018-bc1b-058189ee1f90'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:19.907380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ab7940c9-1331-4018-bc1b-058189ee1f90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2ef58d90a9945eca7132189425cb0c8', 'request_id': 'req-ab7940c9-1331-4018-bc1b-058189ee1f90'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:19.915099 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ab7940c9-1331-4018-bc1b-058189ee1f90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2ef58d90a9945eca7132189425cb0c8', 'request_id': 'req-ab7940c9-1331-4018-bc1b-058189ee1f90'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:19.919560 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1102/2175] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:07:19 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:07:19.920738 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229eaf7-9eee-4ae1-a1bb-13c0dc8ea8a0 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:19.928814 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ab7940c9-1331-4018-bc1b-058189ee1f90 admin admin] The token cache is being invalidate because project c2ef58d90a9945eca7132189425cb0c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:07:19.929682 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ab7940c9-1331-4018-bc1b-058189ee1f90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:19.930355 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ab7940c9-1331-4018-bc1b-058189ee1f90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:19.932226 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1074/2176] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:07:19 2022] DELETE /identity/v3/projects/c2ef58d90a9945eca7132189425cb0c8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:07:19.987941 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229eaf7-9eee-4ae1-a1bb-13c0dc8ea8a0 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:19.993160 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c2220-8f0f-4891-8ab6-6d67cad766e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:19.994029 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c2220-8f0f-4891-8ab6-6d67cad766e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:19.994311 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c2220-8f0f-4891-8ab6-6d67cad766e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:19.994587 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c2220-8f0f-4891-8ab6-6d67cad766e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:19.995585 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c2220-8f0f-4891-8ab6-6d67cad766e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:19.997567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c2220-8f0f-4891-8ab6-6d67cad766e5 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:20.016604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:20.025871 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1103/2177] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:07:19 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:07:20.029086 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7940c9-1331-4018-bc1b-058189ee1f90 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:20.030891 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ab7940c9-1331-4018-bc1b-058189ee1f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:20.111774 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7940c9-1331-4018-bc1b-058189ee1f90 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:20.117005 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1b4fb-5a32-4d5c-b0fb-1cc60b22e402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:20.117698 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1b4fb-5a32-4d5c-b0fb-1cc60b22e402 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:20.117986 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1b4fb-5a32-4d5c-b0fb-1cc60b22e402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:20.118265 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1b4fb-5a32-4d5c-b0fb-1cc60b22e402 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:20.119050 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1b4fb-5a32-4d5c-b0fb-1cc60b22e402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:20.121036 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1b4fb-5a32-4d5c-b0fb-1cc60b22e402 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:20.132998 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1075/2178] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:07:20.137559 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c2220-8f0f-4891-8ab6-6d67cad766e5 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:20.151647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c2220-8f0f-4891-8ab6-6d67cad766e5 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:20.158005 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953dc66-4447-437a-a217-1895bae2ada2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:20.158907 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953dc66-4447-437a-a217-1895bae2ada2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:20.159288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953dc66-4447-437a-a217-1895bae2ada2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:20.159652 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953dc66-4447-437a-a217-1895bae2ada2 admin admin] PATH_INFO: `/v3/projects/79cc4040f9f446e5b4fb7d2ceb187146/users/2ba3466450f74adaa7706a3415e9a97d/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:20.176719 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953dc66-4447-437a-a217-1895bae2ada2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79cc4040f9f446e5b4fb7d2ceb187146, user_id=2ba3466450f74adaa7706a3415e9a97d, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:20.179600 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953dc66-4447-437a-a217-1895bae2ada2 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:20.201287 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1104/2179] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:07:20 2022] PUT /identity/v3/projects/79cc4040f9f446e5b4fb7d2ceb187146/users/2ba3466450f74adaa7706a3415e9a97d/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:20.202308 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1b4fb-5a32-4d5c-b0fb-1cc60b22e402 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:20.213167 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1b4fb-5a32-4d5c-b0fb-1cc60b22e402 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:20.221505 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:20.275164 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaebc3-7ab7-471b-b42b-ee38bf6eced5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:20.275870 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaebc3-7ab7-471b-b42b-ee38bf6eced5 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:20.276163 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaebc3-7ab7-471b-b42b-ee38bf6eced5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:20.276577 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaebc3-7ab7-471b-b42b-ee38bf6eced5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:20.277955 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aaebc3-7ab7-471b-b42b-ee38bf6eced5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:20.279770 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aaebc3-7ab7-471b-b42b-ee38bf6eced5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:20.294340 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1076/2180] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:07:20.298523 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953dc66-4447-437a-a217-1895bae2ada2 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:20.309134 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953dc66-4447-437a-a217-1895bae2ada2 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:20.321101 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7ed19-259f-4cc3-8228-f34a3e1f154f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:20.322010 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7ed19-259f-4cc3-8228-f34a3e1f154f admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:20.322289 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7ed19-259f-4cc3-8228-f34a3e1f154f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:20.322738 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7ed19-259f-4cc3-8228-f34a3e1f154f admin admin] PATH_INFO: `/v3/projects/79cc4040f9f446e5b4fb7d2ceb187146/users/2ba3466450f74adaa7706a3415e9a97d/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:20.325124 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7ed19-259f-4cc3-8228-f34a3e1f154f admin admin] RBAC: Authorizing `identity:create_grant(project_id=79cc4040f9f446e5b4fb7d2ceb187146, user_id=2ba3466450f74adaa7706a3415e9a97d, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:20.327850 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7ed19-259f-4cc3-8228-f34a3e1f154f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:20.340103 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1105/2181] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:07:20 2022] PUT /identity/v3/projects/79cc4040f9f446e5b4fb7d2ceb187146/users/2ba3466450f74adaa7706a3415e9a97d/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:20.351817 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e5d2e-3dfd-4322-a452-05eeafa41ee3 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:20.352120 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e5d2e-3dfd-4322-a452-05eeafa41ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:20.352407 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e5d2e-3dfd-4322-a452-05eeafa41ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:20.381951 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-917e5d2e-3dfd-4322-a452-05eeafa41ee3 None None] MFA Rules not processed for user `2ba3466450f74adaa7706a3415e9a97d`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:20.383805 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-917e5d2e-3dfd-4322-a452-05eeafa41ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:20.461597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1077/2182] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:20.472923 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7ed19-259f-4cc3-8228-f34a3e1f154f admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:20.474573 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d2b7ed19-259f-4cc3-8228-f34a3e1f154f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:20.547819 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7ed19-259f-4cc3-8228-f34a3e1f154f admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:20.551445 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba53bed-adfc-4693-9578-a619ae6d27a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:20.552086 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba53bed-adfc-4693-9578-a619ae6d27a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:20.552372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba53bed-adfc-4693-9578-a619ae6d27a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:20.552650 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba53bed-adfc-4693-9578-a619ae6d27a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:20.554476 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0ba53bed-adfc-4693-9578-a619ae6d27a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:20.613221 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba53bed-adfc-4693-9578-a619ae6d27a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:20.614657 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba53bed-adfc-4693-9578-a619ae6d27a9 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:20.623695 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1106/2183] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:07:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:07:21.273182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e5d2e-3dfd-4322-a452-05eeafa41ee3 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:21.274635 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-917e5d2e-3dfd-4322-a452-05eeafa41ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:21.348047 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e5d2e-3dfd-4322-a452-05eeafa41ee3 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:21.355766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a61a8a-c926-452d-b110-3f2cdea8999d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:21.356681 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a61a8a-c926-452d-b110-3f2cdea8999d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:21.356914 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a61a8a-c926-452d-b110-3f2cdea8999d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:21.357192 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a61a8a-c926-452d-b110-3f2cdea8999d admin admin] PATH_INFO: `/v3/users/31a575c410ff4657bd5f647fb63d9a71` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:21.358472 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a61a8a-c926-452d-b110-3f2cdea8999d admin admin] RBAC: Authorizing `identity:delete_user(user_id=31a575c410ff4657bd5f647fb63d9a71)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:21.360514 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a61a8a-c926-452d-b110-3f2cdea8999d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:21.407332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:21.424076 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-03a61a8a-c926-452d-b110-3f2cdea8999d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31a575c410ff4657bd5f647fb63d9a71'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:21.433890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-03a61a8a-c926-452d-b110-3f2cdea8999d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31a575c410ff4657bd5f647fb63d9a71'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:21.446448 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-03a61a8a-c926-452d-b110-3f2cdea8999d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31a575c410ff4657bd5f647fb63d9a71'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:21.447164 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-03a61a8a-c926-452d-b110-3f2cdea8999d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31a575c410ff4657bd5f647fb63d9a71'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:21.447830 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-03a61a8a-c926-452d-b110-3f2cdea8999d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31a575c410ff4657bd5f647fb63d9a71'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:21.461809 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1078/2184] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:07:21 2022] DELETE /identity/v3/users/31a575c410ff4657bd5f647fb63d9a71 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:21.466350 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcd179-842a-4515-a37b-821c627a6472 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:21.466823 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcd179-842a-4515-a37b-821c627a6472 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:21.466944 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcd179-842a-4515-a37b-821c627a6472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:21.493866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-c5dcd179-842a-4515-a37b-821c627a6472 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:21.495418 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c5dcd179-842a-4515-a37b-821c627a6472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:21.547733 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:21.562410 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1107/2185] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:21.573001 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a61a8a-c926-452d-b110-3f2cdea8999d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:21.574350 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-03a61a8a-c926-452d-b110-3f2cdea8999d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:21.657132 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a61a8a-c926-452d-b110-3f2cdea8999d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:21.660875 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964a353-38cd-458f-be35-cd9aecc9da06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:21.661518 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964a353-38cd-458f-be35-cd9aecc9da06 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:21.661804 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964a353-38cd-458f-be35-cd9aecc9da06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:21.662077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964a353-38cd-458f-be35-cd9aecc9da06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:21.671011 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964a353-38cd-458f-be35-cd9aecc9da06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:21.672476 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964a353-38cd-458f-be35-cd9aecc9da06 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:21.682273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1079/2186] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:07:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:07:21.947414 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dcd179-842a-4515-a37b-821c627a6472 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:21.949021 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c5dcd179-842a-4515-a37b-821c627a6472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:21.967211 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dcd179-842a-4515-a37b-821c627a6472 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:21.972137 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9fcb05-20fc-4a0f-ad52-346b0b2f3a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:21.972996 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9fcb05-20fc-4a0f-ad52-346b0b2f3a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:21.973284 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9fcb05-20fc-4a0f-ad52-346b0b2f3a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:21.973568 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9fcb05-20fc-4a0f-ad52-346b0b2f3a95 admin admin] PATH_INFO: `/v3/projects/a5cd8fe83b9541ca903a480f81349b16` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:21.974925 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9fcb05-20fc-4a0f-ad52-346b0b2f3a95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5cd8fe83b9541ca903a480f81349b16)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:21.977448 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9fcb05-20fc-4a0f-ad52-346b0b2f3a95 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:22.030994 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4a9fcb05-20fc-4a0f-ad52-346b0b2f3a95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5cd8fe83b9541ca903a480f81349b16', 'request_id': 'req-4a9fcb05-20fc-4a0f-ad52-346b0b2f3a95'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:22.036419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4a9fcb05-20fc-4a0f-ad52-346b0b2f3a95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5cd8fe83b9541ca903a480f81349b16', 'request_id': 'req-4a9fcb05-20fc-4a0f-ad52-346b0b2f3a95'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:22.043368 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4a9fcb05-20fc-4a0f-ad52-346b0b2f3a95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5cd8fe83b9541ca903a480f81349b16', 'request_id': 'req-4a9fcb05-20fc-4a0f-ad52-346b0b2f3a95'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:22.056770 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4a9fcb05-20fc-4a0f-ad52-346b0b2f3a95 admin admin] The token cache is being invalidate because project a5cd8fe83b9541ca903a480f81349b16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:07:22.057061 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4a9fcb05-20fc-4a0f-ad52-346b0b2f3a95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:22.057690 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4a9fcb05-20fc-4a0f-ad52-346b0b2f3a95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:22.059303 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1108/2187] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:07:21 2022] DELETE /identity/v3/projects/a5cd8fe83b9541ca903a480f81349b16 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:22.070132 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964a353-38cd-458f-be35-cd9aecc9da06 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:22.073328 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964a353-38cd-458f-be35-cd9aecc9da06 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:22.120375 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9fcb05-20fc-4a0f-ad52-346b0b2f3a95 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:22.121911 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4a9fcb05-20fc-4a0f-ad52-346b0b2f3a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:22.140181 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb095ff9-8d0f-45e1-bdee-4b7a48b7defb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:22.141068 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb095ff9-8d0f-45e1-bdee-4b7a48b7defb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:22.141353 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb095ff9-8d0f-45e1-bdee-4b7a48b7defb admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:22.141629 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb095ff9-8d0f-45e1-bdee-4b7a48b7defb admin admin] PATH_INFO: `/v3/users/837e63dc218b4710a98ea949bc0a926a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:22.142831 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb095ff9-8d0f-45e1-bdee-4b7a48b7defb admin admin] RBAC: Authorizing `identity:delete_user(user_id=837e63dc218b4710a98ea949bc0a926a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:22.145274 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb095ff9-8d0f-45e1-bdee-4b7a48b7defb admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:22.189580 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:22.190415 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9fcb05-20fc-4a0f-ad52-346b0b2f3a95 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:22.194755 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27eb0f-b7ae-46ae-9185-3382693fcbf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:22.196213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27eb0f-b7ae-46ae-9185-3382693fcbf0 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:22.196573 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27eb0f-b7ae-46ae-9185-3382693fcbf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:22.197276 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27eb0f-b7ae-46ae-9185-3382693fcbf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:22.199391 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9e27eb0f-b7ae-46ae-9185-3382693fcbf0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:22.204307 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bb095ff9-8d0f-45e1-bdee-4b7a48b7defb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '837e63dc218b4710a98ea949bc0a926a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:22.213028 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bb095ff9-8d0f-45e1-bdee-4b7a48b7defb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '837e63dc218b4710a98ea949bc0a926a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:22.231990 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bb095ff9-8d0f-45e1-bdee-4b7a48b7defb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '837e63dc218b4710a98ea949bc0a926a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:22.232726 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bb095ff9-8d0f-45e1-bdee-4b7a48b7defb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '837e63dc218b4710a98ea949bc0a926a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:22.233356 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-bb095ff9-8d0f-45e1-bdee-4b7a48b7defb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '837e63dc218b4710a98ea949bc0a926a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:22.252379 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1080/2188] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:07:22 2022] DELETE /identity/v3/users/837e63dc218b4710a98ea949bc0a926a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:22.284239 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27eb0f-b7ae-46ae-9185-3382693fcbf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:22.285063 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27eb0f-b7ae-46ae-9185-3382693fcbf0 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:22.297000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1109/2189] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:07:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 15:07:22.588485 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb095ff9-8d0f-45e1-bdee-4b7a48b7defb admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:22.589919 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bb095ff9-8d0f-45e1-bdee-4b7a48b7defb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:22.681753 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb095ff9-8d0f-45e1-bdee-4b7a48b7defb admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:22.688011 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fe549-4a5b-4ec4-b82f-3a7bfd460594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:22.689228 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fe549-4a5b-4ec4-b82f-3a7bfd460594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:22.689576 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fe549-4a5b-4ec4-b82f-3a7bfd460594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:22.689959 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fe549-4a5b-4ec4-b82f-3a7bfd460594 admin admin] PATH_INFO: `/v3/projects/826698f3537e489bb85fda47779f11fd` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:22.691363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fe549-4a5b-4ec4-b82f-3a7bfd460594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=826698f3537e489bb85fda47779f11fd)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:22.695043 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fe549-4a5b-4ec4-b82f-3a7bfd460594 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:22.764706 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-799fe549-4a5b-4ec4-b82f-3a7bfd460594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '826698f3537e489bb85fda47779f11fd', 'request_id': 'req-799fe549-4a5b-4ec4-b82f-3a7bfd460594'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:22.781579 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-799fe549-4a5b-4ec4-b82f-3a7bfd460594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '826698f3537e489bb85fda47779f11fd', 'request_id': 'req-799fe549-4a5b-4ec4-b82f-3a7bfd460594'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:22.792087 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-799fe549-4a5b-4ec4-b82f-3a7bfd460594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '826698f3537e489bb85fda47779f11fd', 'request_id': 'req-799fe549-4a5b-4ec4-b82f-3a7bfd460594'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:22.809738 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-799fe549-4a5b-4ec4-b82f-3a7bfd460594 admin admin] The token cache is being invalidate because project 826698f3537e489bb85fda47779f11fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:07:22.810051 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-799fe549-4a5b-4ec4-b82f-3a7bfd460594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:22.810927 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-799fe549-4a5b-4ec4-b82f-3a7bfd460594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:22.812844 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1081/2190] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:07:22 2022] DELETE /identity/v3/projects/826698f3537e489bb85fda47779f11fd => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:22.817673 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b0c02-d888-42b5-84b2-2e382a865a37 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:22.818135 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b0c02-d888-42b5-84b2-2e382a865a37 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:22.818780 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b0c02-d888-42b5-84b2-2e382a865a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:22.871326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:22.878632 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f45b0c02-d888-42b5-84b2-2e382a865a37 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:22.880097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f45b0c02-d888-42b5-84b2-2e382a865a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:22.962195 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1110/2191] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:07:22.971310 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2059a2a-7399-4668-8ddf-ec656c290dc8 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:22.971606 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2059a2a-7399-4668-8ddf-ec656c290dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:22.971889 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2059a2a-7399-4668-8ddf-ec656c290dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:22.991789 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c2059a2a-7399-4668-8ddf-ec656c290dc8 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:22.992895 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c2059a2a-7399-4668-8ddf-ec656c290dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:23.002422 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1082/2192] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:23.006950 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b0c02-d888-42b5-84b2-2e382a865a37 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:23.021060 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b0c02-d888-42b5-84b2-2e382a865a37 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:23.025918 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361de1e-f9f1-4ba2-ab7d-d69ab7658f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:23.026638 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361de1e-f9f1-4ba2-ab7d-d69ab7658f4c admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:23.026931 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361de1e-f9f1-4ba2-ab7d-d69ab7658f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:23.027224 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361de1e-f9f1-4ba2-ab7d-d69ab7658f4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:23.027983 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361de1e-f9f1-4ba2-ab7d-d69ab7658f4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:07:23.028296 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361de1e-f9f1-4ba2-ab7d-d69ab7658f4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:23.030127 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361de1e-f9f1-4ba2-ab7d-d69ab7658f4c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:23.051662 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1111/2193] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:07:23.052733 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2059a2a-7399-4668-8ddf-ec656c290dc8 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:23.053552 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361de1e-f9f1-4ba2-ab7d-d69ab7658f4c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:23.054640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c2059a2a-7399-4668-8ddf-ec656c290dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:23.065085 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361de1e-f9f1-4ba2-ab7d-d69ab7658f4c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:23.071386 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0aaff-8a53-4ac2-b726-87e9ee6f259a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:23.072644 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0aaff-8a53-4ac2-b726-87e9ee6f259a admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:23.072928 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0aaff-8a53-4ac2-b726-87e9ee6f259a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:23.073203 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0aaff-8a53-4ac2-b726-87e9ee6f259a admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:23.074078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0aaff-8a53-4ac2-b726-87e9ee6f259a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:23.076033 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0aaff-8a53-4ac2-b726-87e9ee6f259a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:23.107633 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:23.112733 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1112/2194] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:07:23 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:07:23.118025 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0aaff-8a53-4ac2-b726-87e9ee6f259a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:23.130744 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2059a2a-7399-4668-8ddf-ec656c290dc8 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:23.184317 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a727c-dae6-49df-ae31-aa741e6bd26a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:23.185118 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a727c-dae6-49df-ae31-aa741e6bd26a service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:23.185409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a727c-dae6-49df-ae31-aa741e6bd26a service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:23.185689 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a727c-dae6-49df-ae31-aa741e6bd26a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:23.186454 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0aaff-8a53-4ac2-b726-87e9ee6f259a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:23.187605 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4e7a727c-dae6-49df-ae31-aa741e6bd26a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:23.191134 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e9c0e-1769-4136-92d9-58175e5fc027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:23.191829 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e9c0e-1769-4136-92d9-58175e5fc027 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:23.192113 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e9c0e-1769-4136-92d9-58175e5fc027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:23.192388 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e9c0e-1769-4136-92d9-58175e5fc027 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:23.193082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e9c0e-1769-4136-92d9-58175e5fc027 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:23.195679 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e9c0e-1769-4136-92d9-58175e5fc027 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:23.218325 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1113/2195] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:07:23 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:07:23.222021 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e9c0e-1769-4136-92d9-58175e5fc027 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:23.232240 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e9c0e-1769-4136-92d9-58175e5fc027 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:23.237011 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c3b0a-e5ba-46a3-a2e1-116474a93246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:23.237667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c3b0a-e5ba-46a3-a2e1-116474a93246 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:23.238011 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c3b0a-e5ba-46a3-a2e1-116474a93246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:23.238295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c3b0a-e5ba-46a3-a2e1-116474a93246 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:23.239018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c3b0a-e5ba-46a3-a2e1-116474a93246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:23.240902 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c3b0a-e5ba-46a3-a2e1-116474a93246 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:23.255452 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1114/2196] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 15:07:23.258298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c3b0a-e5ba-46a3-a2e1-116474a93246 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:23.268272 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c3b0a-e5ba-46a3-a2e1-116474a93246 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:23.271229 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a727c-dae6-49df-ae31-aa741e6bd26a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:23.272971 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a727c-dae6-49df-ae31-aa741e6bd26a service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:23.273081 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5011e2-61e2-444e-b9c6-bb19a461ee67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:23.273716 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5011e2-61e2-444e-b9c6-bb19a461ee67 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:23.274002 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5011e2-61e2-444e-b9c6-bb19a461ee67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:23.274274 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5011e2-61e2-444e-b9c6-bb19a461ee67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:23.274991 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5011e2-61e2-444e-b9c6-bb19a461ee67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:23.276612 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5011e2-61e2-444e-b9c6-bb19a461ee67 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:23.283122 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1083/2197] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:07:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 15:07:23.288728 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1115/2198] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:07:23.292821 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a727c-dae6-49df-ae31-aa741e6bd26a service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:23.305366 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a727c-dae6-49df-ae31-aa741e6bd26a service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:23.311395 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78b54a-904f-4831-9aeb-c935d9c0a1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:23.313001 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78b54a-904f-4831-9aeb-c935d9c0a1a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:23.313458 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78b54a-904f-4831-9aeb-c935d9c0a1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:23.313921 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78b54a-904f-4831-9aeb-c935d9c0a1a1 admin admin] PATH_INFO: `/v3/projects/dffea974c5a84f31a77f900a6bfcd57d/users/a8078421f3bd4f2eb8e5cd6a7fbe2959/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:23.347187 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78b54a-904f-4831-9aeb-c935d9c0a1a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dffea974c5a84f31a77f900a6bfcd57d, user_id=a8078421f3bd4f2eb8e5cd6a7fbe2959, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:23.351250 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78b54a-904f-4831-9aeb-c935d9c0a1a1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:23.374822 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1084/2199] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:07:23 2022] PUT /identity/v3/projects/dffea974c5a84f31a77f900a6bfcd57d/users/a8078421f3bd4f2eb8e5cd6a7fbe2959/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:23.385142 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5688b2-f9e6-4922-ab77-08290ba44005 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:23.385815 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5688b2-f9e6-4922-ab77-08290ba44005 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:23.386587 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5688b2-f9e6-4922-ab77-08290ba44005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:23.426686 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-0d5688b2-f9e6-4922-ab77-08290ba44005 None None] MFA Rules not processed for user `a8078421f3bd4f2eb8e5cd6a7fbe2959`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:23.428489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0d5688b2-f9e6-4922-ab77-08290ba44005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:23.472679 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:23.515991 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1116/2200] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:23.520223 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78b54a-904f-4831-9aeb-c935d9c0a1a1 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:23.589410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78b54a-904f-4831-9aeb-c935d9c0a1a1 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:23.594064 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec309eb-e081-4b21-89d1-f8d56bebdc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:23.594739 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec309eb-e081-4b21-89d1-f8d56bebdc19 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:23.595024 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec309eb-e081-4b21-89d1-f8d56bebdc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:23.595335 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec309eb-e081-4b21-89d1-f8d56bebdc19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:23.596043 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec309eb-e081-4b21-89d1-f8d56bebdc19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:23.597965 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec309eb-e081-4b21-89d1-f8d56bebdc19 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:23.625346 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1085/2201] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:07:23 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:07:23.629066 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5688b2-f9e6-4922-ab77-08290ba44005 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:23.639527 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5688b2-f9e6-4922-ab77-08290ba44005 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:23.707085 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e2ef6-be05-4056-9f69-23aed72d3345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:23.707855 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e2ef6-be05-4056-9f69-23aed72d3345 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:23.708204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e2ef6-be05-4056-9f69-23aed72d3345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:23.708546 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e2ef6-be05-4056-9f69-23aed72d3345 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:23.709407 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e2ef6-be05-4056-9f69-23aed72d3345 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:23.712548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e2ef6-be05-4056-9f69-23aed72d3345 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:23.736516 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1117/2202] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:07:23 2022] POST /identity/v3/users => generated 300 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:07:23.740989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec309eb-e081-4b21-89d1-f8d56bebdc19 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:23.748493 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:23.754527 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec309eb-e081-4b21-89d1-f8d56bebdc19 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:23.760916 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb9835-c9ef-4818-99b6-57a42ce6452c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:23.761790 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb9835-c9ef-4818-99b6-57a42ce6452c admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:23.762079 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb9835-c9ef-4818-99b6-57a42ce6452c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:23.762360 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb9835-c9ef-4818-99b6-57a42ce6452c admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:23.763146 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb9835-c9ef-4818-99b6-57a42ce6452c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:23.764943 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb9835-c9ef-4818-99b6-57a42ce6452c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:23.780030 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1086/2203] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:07:23.781382 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e2ef6-be05-4056-9f69-23aed72d3345 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:23.794168 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e2ef6-be05-4056-9f69-23aed72d3345 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:23.800079 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44391a26-88e1-4c4a-a82d-4b925d833e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:23.801139 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44391a26-88e1-4c4a-a82d-4b925d833e2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:23.801657 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44391a26-88e1-4c4a-a82d-4b925d833e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:23.802029 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44391a26-88e1-4c4a-a82d-4b925d833e2b admin admin] PATH_INFO: `/v3/projects/38808ef9df2c4bfd96315c8c29e47c95/users/4296af229b44493091944a2dca14aff5/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:23.819857 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44391a26-88e1-4c4a-a82d-4b925d833e2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=38808ef9df2c4bfd96315c8c29e47c95, user_id=4296af229b44493091944a2dca14aff5, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:23.822589 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44391a26-88e1-4c4a-a82d-4b925d833e2b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:23.842134 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1118/2204] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:07:23 2022] PUT /identity/v3/projects/38808ef9df2c4bfd96315c8c29e47c95/users/4296af229b44493091944a2dca14aff5/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:23.846746 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb9835-c9ef-4818-99b6-57a42ce6452c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:23.857519 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb9835-c9ef-4818-99b6-57a42ce6452c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:23.931412 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b71487-e9c6-471d-8ac1-43391708f659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:23.932257 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b71487-e9c6-471d-8ac1-43391708f659 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:23.932434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b71487-e9c6-471d-8ac1-43391708f659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:23.933028 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b71487-e9c6-471d-8ac1-43391708f659 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:23.933884 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b71487-e9c6-471d-8ac1-43391708f659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:23.935729 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b71487-e9c6-471d-8ac1-43391708f659 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:23.949487 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1087/2205] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:07:23.953276 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44391a26-88e1-4c4a-a82d-4b925d833e2b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:23.965174 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44391a26-88e1-4c4a-a82d-4b925d833e2b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:23.970845 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c2490-ee03-4b89-b709-b5a4f27b29b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:23.972371 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c2490-ee03-4b89-b709-b5a4f27b29b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:23.972650 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c2490-ee03-4b89-b709-b5a4f27b29b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:23.972930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c2490-ee03-4b89-b709-b5a4f27b29b6 admin admin] PATH_INFO: `/v3/projects/38808ef9df2c4bfd96315c8c29e47c95/users/4296af229b44493091944a2dca14aff5/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:23.977241 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c2490-ee03-4b89-b709-b5a4f27b29b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38808ef9df2c4bfd96315c8c29e47c95, user_id=4296af229b44493091944a2dca14aff5, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:23.980298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c2490-ee03-4b89-b709-b5a4f27b29b6 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:23.993054 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1119/2206] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:07:23 2022] PUT /identity/v3/projects/38808ef9df2c4bfd96315c8c29e47c95/users/4296af229b44493091944a2dca14aff5/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:24.003726 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061eb60-0a1b-40c7-825e-a09dd3616790 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:24.004104 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061eb60-0a1b-40c7-825e-a09dd3616790 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:24.004460 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061eb60-0a1b-40c7-825e-a09dd3616790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:24.032817 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b061eb60-0a1b-40c7-825e-a09dd3616790 None None] MFA Rules not processed for user `4296af229b44493091944a2dca14aff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:24.033730 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b061eb60-0a1b-40c7-825e-a09dd3616790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:24.106160 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1088/2207] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:24.118409 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c2490-ee03-4b89-b709-b5a4f27b29b6 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:24.179583 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c2490-ee03-4b89-b709-b5a4f27b29b6 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:24.183678 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea4573-1017-439b-9ce7-1897a3337136 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:24.184136 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea4573-1017-439b-9ce7-1897a3337136 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:24.184423 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea4573-1017-439b-9ce7-1897a3337136 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:24.184773 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea4573-1017-439b-9ce7-1897a3337136 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:24.194545 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea4573-1017-439b-9ce7-1897a3337136 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:24.196105 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea4573-1017-439b-9ce7-1897a3337136 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:24.206308 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1120/2208] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:07:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:07:24.272008 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061eb60-0a1b-40c7-825e-a09dd3616790 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:24.290999 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea4573-1017-439b-9ce7-1897a3337136 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:24.292436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-abea4573-1017-439b-9ce7-1897a3337136 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:24.329171 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:24.348638 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061eb60-0a1b-40c7-825e-a09dd3616790 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:24.354069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3d393-45e9-4278-957e-8db5365db3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:24.354944 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3d393-45e9-4278-957e-8db5365db3ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:24.355268 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3d393-45e9-4278-957e-8db5365db3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:24.355552 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3d393-45e9-4278-957e-8db5365db3ac admin admin] PATH_INFO: `/v3/users/a8078421f3bd4f2eb8e5cd6a7fbe2959` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:24.356793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3d393-45e9-4278-957e-8db5365db3ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8078421f3bd4f2eb8e5cd6a7fbe2959)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:24.358731 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3d393-45e9-4278-957e-8db5365db3ac admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:24.374349 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea4573-1017-439b-9ce7-1897a3337136 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:24.377181 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:24.383927 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b06d8-3034-4cac-b5d2-326ba493701c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:24.385264 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b06d8-3034-4cac-b5d2-326ba493701c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:24.385713 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b06d8-3034-4cac-b5d2-326ba493701c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:24.385988 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b06d8-3034-4cac-b5d2-326ba493701c admin admin] PATH_INFO: `/v3/users/4713bf0cfe8a4ddcb174d721df8d5d73` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:24.387313 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b06d8-3034-4cac-b5d2-326ba493701c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4713bf0cfe8a4ddcb174d721df8d5d73)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:24.389555 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b06d8-3034-4cac-b5d2-326ba493701c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:24.411009 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-cbb3d393-45e9-4278-957e-8db5365db3ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8078421f3bd4f2eb8e5cd6a7fbe2959'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:24.419357 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-cbb3d393-45e9-4278-957e-8db5365db3ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8078421f3bd4f2eb8e5cd6a7fbe2959'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:24.434432 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-cbb3d393-45e9-4278-957e-8db5365db3ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8078421f3bd4f2eb8e5cd6a7fbe2959'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:24.435142 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-cbb3d393-45e9-4278-957e-8db5365db3ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8078421f3bd4f2eb8e5cd6a7fbe2959'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:24.439982 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-cbb3d393-45e9-4278-957e-8db5365db3ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8078421f3bd4f2eb8e5cd6a7fbe2959'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:24.449618 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b48b06d8-3034-4cac-b5d2-326ba493701c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4713bf0cfe8a4ddcb174d721df8d5d73'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:24.450665 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b48b06d8-3034-4cac-b5d2-326ba493701c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4713bf0cfe8a4ddcb174d721df8d5d73'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:24.451338 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b48b06d8-3034-4cac-b5d2-326ba493701c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4713bf0cfe8a4ddcb174d721df8d5d73'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:24.455470 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1089/2209] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:07:24 2022] DELETE /identity/v3/users/a8078421f3bd4f2eb8e5cd6a7fbe2959 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:24.460448 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37a350-84ae-4b59-a9da-b1e5505efe25 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:24.460772 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37a350-84ae-4b59-a9da-b1e5505efe25 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:24.461031 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37a350-84ae-4b59-a9da-b1e5505efe25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:24.463147 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b48b06d8-3034-4cac-b5d2-326ba493701c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4713bf0cfe8a4ddcb174d721df8d5d73'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:24.477544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b48b06d8-3034-4cac-b5d2-326ba493701c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4713bf0cfe8a4ddcb174d721df8d5d73'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:24.479846 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-3b37a350-84ae-4b59-a9da-b1e5505efe25 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:24.481055 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3b37a350-84ae-4b59-a9da-b1e5505efe25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:24.494549 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1121/2210] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:07:24 2022] DELETE /identity/v3/users/4713bf0cfe8a4ddcb174d721df8d5d73 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:07:24.552799 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1090/2211] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:24.563087 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b06d8-3034-4cac-b5d2-326ba493701c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:24.564771 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b48b06d8-3034-4cac-b5d2-326ba493701c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:24.643274 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b06d8-3034-4cac-b5d2-326ba493701c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:24.650125 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4dd85-86c5-4d59-a1fb-1a297b7e58be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:24.650771 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4dd85-86c5-4d59-a1fb-1a297b7e58be service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:24.651056 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4dd85-86c5-4d59-a1fb-1a297b7e58be service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:24.651444 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4dd85-86c5-4d59-a1fb-1a297b7e58be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:24.713111 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37a350-84ae-4b59-a9da-b1e5505efe25 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:24.714558 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3b37a350-84ae-4b59-a9da-b1e5505efe25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:24.735114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37a350-84ae-4b59-a9da-b1e5505efe25 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:24.783098 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:24.788937 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4dd85-86c5-4d59-a1fb-1a297b7e58be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:24.792165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4dd85-86c5-4d59-a1fb-1a297b7e58be service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:24.807428 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1122/2212] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:07:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 15:07:24.820581 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86bdc3-644b-4d6a-a9e9-3f5fef7ec5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:24.821475 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86bdc3-644b-4d6a-a9e9-3f5fef7ec5d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:24.821755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86bdc3-644b-4d6a-a9e9-3f5fef7ec5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:24.822101 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86bdc3-644b-4d6a-a9e9-3f5fef7ec5d9 admin admin] PATH_INFO: `/v3/projects/7dae251faaae4c60be49e940d842099c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:24.823397 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86bdc3-644b-4d6a-a9e9-3f5fef7ec5d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dae251faaae4c60be49e940d842099c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:24.825332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86bdc3-644b-4d6a-a9e9-3f5fef7ec5d9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:24.865990 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:24.877105 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7c86bdc3-644b-4d6a-a9e9-3f5fef7ec5d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dae251faaae4c60be49e940d842099c', 'request_id': 'req-7c86bdc3-644b-4d6a-a9e9-3f5fef7ec5d9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:24.884878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7c86bdc3-644b-4d6a-a9e9-3f5fef7ec5d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dae251faaae4c60be49e940d842099c', 'request_id': 'req-7c86bdc3-644b-4d6a-a9e9-3f5fef7ec5d9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:24.891424 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7c86bdc3-644b-4d6a-a9e9-3f5fef7ec5d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dae251faaae4c60be49e940d842099c', 'request_id': 'req-7c86bdc3-644b-4d6a-a9e9-3f5fef7ec5d9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:24.903034 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7c86bdc3-644b-4d6a-a9e9-3f5fef7ec5d9 admin admin] The token cache is being invalidate because project 7dae251faaae4c60be49e940d842099c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:07:24.903376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7c86bdc3-644b-4d6a-a9e9-3f5fef7ec5d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:24.904046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7c86bdc3-644b-4d6a-a9e9-3f5fef7ec5d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:24.905738 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1091/2213] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:07:24 2022] DELETE /identity/v3/projects/7dae251faaae4c60be49e940d842099c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:24.909639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4dd85-86c5-4d59-a1fb-1a297b7e58be service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:24.919375 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4dd85-86c5-4d59-a1fb-1a297b7e58be service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:24.998426 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fdf66-fa09-4f51-8361-b84b81bebfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:24.999337 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fdf66-fa09-4f51-8361-b84b81bebfea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:24.999769 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fdf66-fa09-4f51-8361-b84b81bebfea admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:25.000054 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fdf66-fa09-4f51-8361-b84b81bebfea admin admin] PATH_INFO: `/v3/users/ff1be6e9ae6740878232b3c50f956008` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:25.001922 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fdf66-fa09-4f51-8361-b84b81bebfea admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff1be6e9ae6740878232b3c50f956008)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:25.004541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fdf66-fa09-4f51-8361-b84b81bebfea admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:25.079181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d29fdf66-fa09-4f51-8361-b84b81bebfea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff1be6e9ae6740878232b3c50f956008'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:25.080270 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d29fdf66-fa09-4f51-8361-b84b81bebfea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff1be6e9ae6740878232b3c50f956008'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:25.080950 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d29fdf66-fa09-4f51-8361-b84b81bebfea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff1be6e9ae6740878232b3c50f956008'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:25.097928 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d29fdf66-fa09-4f51-8361-b84b81bebfea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff1be6e9ae6740878232b3c50f956008'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:25.113109 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d29fdf66-fa09-4f51-8361-b84b81bebfea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff1be6e9ae6740878232b3c50f956008'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:25.128038 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1123/2214] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:07:24 2022] DELETE /identity/v3/users/ff1be6e9ae6740878232b3c50f956008 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:25.188287 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86bdc3-644b-4d6a-a9e9-3f5fef7ec5d9 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:25.189730 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-7c86bdc3-644b-4d6a-a9e9-3f5fef7ec5d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:25.221890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86bdc3-644b-4d6a-a9e9-3f5fef7ec5d9 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:25.288429 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929584e-92bd-452e-816a-bdcc1b1abe6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:25.289309 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929584e-92bd-452e-816a-bdcc1b1abe6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:25.289592 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929584e-92bd-452e-816a-bdcc1b1abe6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:25.289869 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929584e-92bd-452e-816a-bdcc1b1abe6a admin admin] PATH_INFO: `/v3/projects/dffea974c5a84f31a77f900a6bfcd57d` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:25.291101 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929584e-92bd-452e-816a-bdcc1b1abe6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dffea974c5a84f31a77f900a6bfcd57d)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:25.293103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929584e-92bd-452e-816a-bdcc1b1abe6a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:25.334385 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fdf66-fa09-4f51-8361-b84b81bebfea admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:25.335988 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d29fdf66-fa09-4f51-8361-b84b81bebfea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:25.352829 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fdf66-fa09-4f51-8361-b84b81bebfea admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:25.363966 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a929584e-92bd-452e-816a-bdcc1b1abe6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dffea974c5a84f31a77f900a6bfcd57d', 'request_id': 'req-a929584e-92bd-452e-816a-bdcc1b1abe6a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:25.372859 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a929584e-92bd-452e-816a-bdcc1b1abe6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dffea974c5a84f31a77f900a6bfcd57d', 'request_id': 'req-a929584e-92bd-452e-816a-bdcc1b1abe6a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:25.379534 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a929584e-92bd-452e-816a-bdcc1b1abe6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dffea974c5a84f31a77f900a6bfcd57d', 'request_id': 'req-a929584e-92bd-452e-816a-bdcc1b1abe6a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:25.398515 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a929584e-92bd-452e-816a-bdcc1b1abe6a admin admin] The token cache is being invalidate because project dffea974c5a84f31a77f900a6bfcd57d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:07:25.398802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a929584e-92bd-452e-816a-bdcc1b1abe6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:25.399490 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a929584e-92bd-452e-816a-bdcc1b1abe6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:25.401673 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1092/2215] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:07:25 2022] DELETE /identity/v3/projects/dffea974c5a84f31a77f900a6bfcd57d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:25.406362 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929584e-92bd-452e-816a-bdcc1b1abe6a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:25.408071 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a929584e-92bd-452e-816a-bdcc1b1abe6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:25.419684 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7818193-c26b-47b7-98d8-78082bbfb12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:25.420443 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7818193-c26b-47b7-98d8-78082bbfb12c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:25.420727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7818193-c26b-47b7-98d8-78082bbfb12c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:25.421012 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7818193-c26b-47b7-98d8-78082bbfb12c admin admin] PATH_INFO: `/v3/projects/f790c0f33c96410a84745135173145be` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:25.422224 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7818193-c26b-47b7-98d8-78082bbfb12c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f790c0f33c96410a84745135173145be)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:25.424253 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7818193-c26b-47b7-98d8-78082bbfb12c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:25.440972 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:25.470599 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:25.474240 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b7818193-c26b-47b7-98d8-78082bbfb12c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f790c0f33c96410a84745135173145be', 'request_id': 'req-b7818193-c26b-47b7-98d8-78082bbfb12c'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:25.477191 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929584e-92bd-452e-816a-bdcc1b1abe6a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:25.479989 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b7818193-c26b-47b7-98d8-78082bbfb12c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f790c0f33c96410a84745135173145be', 'request_id': 'req-b7818193-c26b-47b7-98d8-78082bbfb12c'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:25.486881 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b7818193-c26b-47b7-98d8-78082bbfb12c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f790c0f33c96410a84745135173145be', 'request_id': 'req-b7818193-c26b-47b7-98d8-78082bbfb12c'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:25.501016 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b7818193-c26b-47b7-98d8-78082bbfb12c admin admin] The token cache is being invalidate because project f790c0f33c96410a84745135173145be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:07:25.501392 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b7818193-c26b-47b7-98d8-78082bbfb12c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:25.502090 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-b7818193-c26b-47b7-98d8-78082bbfb12c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:25.503740 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1124/2216] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:07:25 2022] DELETE /identity/v3/projects/f790c0f33c96410a84745135173145be => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:25.508947 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332d5ae-5cc0-43ef-835f-9ba6526ea2e2 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:25.509240 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332d5ae-5cc0-43ef-835f-9ba6526ea2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:25.509524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332d5ae-5cc0-43ef-835f-9ba6526ea2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:25.527679 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-3332d5ae-5cc0-43ef-835f-9ba6526ea2e2 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:25.528883 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3332d5ae-5cc0-43ef-835f-9ba6526ea2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:25.537174 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844c751-6060-4882-833d-2069a0cbcd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:25.538590 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844c751-6060-4882-833d-2069a0cbcd74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:25.538878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844c751-6060-4882-833d-2069a0cbcd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:25.539156 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844c751-6060-4882-833d-2069a0cbcd74 admin admin] PATH_INFO: `/v3/users/4296af229b44493091944a2dca14aff5` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:25.540397 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844c751-6060-4882-833d-2069a0cbcd74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4296af229b44493091944a2dca14aff5)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:25.542330 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844c751-6060-4882-833d-2069a0cbcd74 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:25.589653 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e844c751-6060-4882-833d-2069a0cbcd74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4296af229b44493091944a2dca14aff5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:25.590289 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1125/2217] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:07:25.596423 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e844c751-6060-4882-833d-2069a0cbcd74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4296af229b44493091944a2dca14aff5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:25.597673 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b3759-1c2e-4072-bd24-95b1397e8435 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:25.597963 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b3759-1c2e-4072-bd24-95b1397e8435 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:25.598247 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b3759-1c2e-4072-bd24-95b1397e8435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:25.608487 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e844c751-6060-4882-833d-2069a0cbcd74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4296af229b44493091944a2dca14aff5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:25.609188 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e844c751-6060-4882-833d-2069a0cbcd74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4296af229b44493091944a2dca14aff5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:25.609820 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-e844c751-6060-4882-833d-2069a0cbcd74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4296af229b44493091944a2dca14aff5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:25.619004 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-821b3759-1c2e-4072-bd24-95b1397e8435 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:25.620503 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-821b3759-1c2e-4072-bd24-95b1397e8435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:25.623541 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1093/2218] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:07:25 2022] DELETE /identity/v3/users/4296af229b44493091944a2dca14aff5 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:07:25.686329 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1126/2219] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:07:25.691149 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844c751-6060-4882-833d-2069a0cbcd74 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:25.703233 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844c751-6060-4882-833d-2069a0cbcd74 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:25.708076 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d924ee0-c5e0-42b5-90b2-a6e4832cf822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:25.708739 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d924ee0-c5e0-42b5-90b2-a6e4832cf822 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:25.709174 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d924ee0-c5e0-42b5-90b2-a6e4832cf822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:25.709431 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d924ee0-c5e0-42b5-90b2-a6e4832cf822 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:25.710235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d924ee0-c5e0-42b5-90b2-a6e4832cf822 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:07:25.710661 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d924ee0-c5e0-42b5-90b2-a6e4832cf822 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:25.712330 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d924ee0-c5e0-42b5-90b2-a6e4832cf822 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:25.726716 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1094/2220] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:07:25.729904 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b3759-1c2e-4072-bd24-95b1397e8435 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:25.738947 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b3759-1c2e-4072-bd24-95b1397e8435 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:25.747077 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc20c2-a323-4fa1-a464-04e366a83a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:25.747514 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc20c2-a323-4fa1-a464-04e366a83a22 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:25.747806 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc20c2-a323-4fa1-a464-04e366a83a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:25.748084 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc20c2-a323-4fa1-a464-04e366a83a22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:25.748781 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc20c2-a323-4fa1-a464-04e366a83a22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:25.750724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc20c2-a323-4fa1-a464-04e366a83a22 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:25.784011 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1127/2221] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:07:25 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:07:25.788714 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d924ee0-c5e0-42b5-90b2-a6e4832cf822 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:25.799902 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d924ee0-c5e0-42b5-90b2-a6e4832cf822 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:25.870803 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de3d10-a45d-4a74-879a-1613132c41c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:25.871509 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de3d10-a45d-4a74-879a-1613132c41c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:25.871798 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de3d10-a45d-4a74-879a-1613132c41c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:25.872081 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de3d10-a45d-4a74-879a-1613132c41c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:25.872774 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de3d10-a45d-4a74-879a-1613132c41c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:25.875177 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de3d10-a45d-4a74-879a-1613132c41c8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:25.893283 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:25.904932 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1095/2222] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:07:25 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:07:25.909939 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc20c2-a323-4fa1-a464-04e366a83a22 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:25.926757 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc20c2-a323-4fa1-a464-04e366a83a22 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:25.926858 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de3d10-a45d-4a74-879a-1613132c41c8 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:25.926858 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c1de3d10-a45d-4a74-879a-1613132c41c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:25.930510 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283866a9-6c21-4bf2-8d5d-28b04f312e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:25.931322 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283866a9-6c21-4bf2-8d5d-28b04f312e6e admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:25.931717 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283866a9-6c21-4bf2-8d5d-28b04f312e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:25.932183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283866a9-6c21-4bf2-8d5d-28b04f312e6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:25.933114 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283866a9-6c21-4bf2-8d5d-28b04f312e6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:25.935315 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283866a9-6c21-4bf2-8d5d-28b04f312e6e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:25.947265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1128/2223] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:07:25.951036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283866a9-6c21-4bf2-8d5d-28b04f312e6e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:25.955388 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de3d10-a45d-4a74-879a-1613132c41c8 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:25.961046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a7786-b29f-4ffa-a4a4-820d898789f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:25.961985 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a7786-b29f-4ffa-a4a4-820d898789f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:25.962265 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a7786-b29f-4ffa-a4a4-820d898789f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:25.962542 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a7786-b29f-4ffa-a4a4-820d898789f5 admin admin] PATH_INFO: `/v3/projects/38808ef9df2c4bfd96315c8c29e47c95` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:25.962686 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283866a9-6c21-4bf2-8d5d-28b04f312e6e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:25.963969 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a7786-b29f-4ffa-a4a4-820d898789f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38808ef9df2c4bfd96315c8c29e47c95)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:25.966415 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a7786-b29f-4ffa-a4a4-820d898789f5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:25.968209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d46c47-9857-4e85-b1c0-c2e50b87ba23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:25.968876 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d46c47-9857-4e85-b1c0-c2e50b87ba23 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:25.969161 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d46c47-9857-4e85-b1c0-c2e50b87ba23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:25.969436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d46c47-9857-4e85-b1c0-c2e50b87ba23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:25.970266 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d46c47-9857-4e85-b1c0-c2e50b87ba23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:25.971974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d46c47-9857-4e85-b1c0-c2e50b87ba23 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:25.979101 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:25.987482 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1129/2224] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:07:25.988392 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d46c47-9857-4e85-b1c0-c2e50b87ba23 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:26.000771 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d46c47-9857-4e85-b1c0-c2e50b87ba23 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:26.006631 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4152f82-3a14-4c26-a219-f5e28acbee96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:26.007860 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4152f82-3a14-4c26-a219-f5e28acbee96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:26.008225 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4152f82-3a14-4c26-a219-f5e28acbee96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:26.008547 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4152f82-3a14-4c26-a219-f5e28acbee96 admin admin] PATH_INFO: `/v3/projects/dff19d5dda9442cfa384209ee20c22ae/users/fdfbe32b77bd46f4aa9b6401f898f691/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:26.026064 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4152f82-3a14-4c26-a219-f5e28acbee96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dff19d5dda9442cfa384209ee20c22ae, user_id=fdfbe32b77bd46f4aa9b6401f898f691, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:26.028790 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4152f82-3a14-4c26-a219-f5e28acbee96 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:26.031129 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-963a7786-b29f-4ffa-a4a4-820d898789f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38808ef9df2c4bfd96315c8c29e47c95', 'request_id': 'req-963a7786-b29f-4ffa-a4a4-820d898789f5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:26.041326 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-963a7786-b29f-4ffa-a4a4-820d898789f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38808ef9df2c4bfd96315c8c29e47c95', 'request_id': 'req-963a7786-b29f-4ffa-a4a4-820d898789f5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:26.043996 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1130/2225] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:07:25 2022] PUT /identity/v3/projects/dff19d5dda9442cfa384209ee20c22ae/users/fdfbe32b77bd46f4aa9b6401f898f691/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:26.048792 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-963a7786-b29f-4ffa-a4a4-820d898789f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38808ef9df2c4bfd96315c8c29e47c95', 'request_id': 'req-963a7786-b29f-4ffa-a4a4-820d898789f5'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:26.054574 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbf278-095e-4dce-864c-1bfbb5ff677d None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:26.054862 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbf278-095e-4dce-864c-1bfbb5ff677d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:26.055137 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbf278-095e-4dce-864c-1bfbb5ff677d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:26.063748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-963a7786-b29f-4ffa-a4a4-820d898789f5 admin admin] The token cache is being invalidate because project 38808ef9df2c4bfd96315c8c29e47c95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:07:26.064114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-963a7786-b29f-4ffa-a4a4-820d898789f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:26.064871 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-963a7786-b29f-4ffa-a4a4-820d898789f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:26.066693 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1096/2226] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:07:25 2022] DELETE /identity/v3/projects/38808ef9df2c4bfd96315c8c29e47c95 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:26.072176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf6b70-6eb4-45d5-b99c-67f3f1c76f17 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:26.072857 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf6b70-6eb4-45d5-b99c-67f3f1c76f17 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:26.073382 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf6b70-6eb4-45d5-b99c-67f3f1c76f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:26.083295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-04dbf278-095e-4dce-864c-1bfbb5ff677d None None] MFA Rules not processed for user `fdfbe32b77bd46f4aa9b6401f898f691`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:26.084713 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-04dbf278-095e-4dce-864c-1bfbb5ff677d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:26.103465 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-29bf6b70-6eb4-45d5-b99c-67f3f1c76f17 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:26.105607 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-29bf6b70-6eb4-45d5-b99c-67f3f1c76f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:26.162361 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1131/2227] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:07:26.182350 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dbf278-095e-4dce-864c-1bfbb5ff677d None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:26.184494 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-04dbf278-095e-4dce-864c-1bfbb5ff677d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:26.186081 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1097/2228] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:07:26.198855 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2c18f-a222-4419-808f-7561116864a2 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:26.199420 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2c18f-a222-4419-808f-7561116864a2 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:26.199879 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2c18f-a222-4419-808f-7561116864a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:26.221774 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-37b2c18f-a222-4419-808f-7561116864a2 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:26.223053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-37b2c18f-a222-4419-808f-7561116864a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:26.233409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1098/2229] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:26.237564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2c18f-a222-4419-808f-7561116864a2 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:26.250263 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2c18f-a222-4419-808f-7561116864a2 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:26.261675 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dbf278-095e-4dce-864c-1bfbb5ff677d None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:26.264199 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f945668-fcf4-4a71-91c4-4378115e478c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:26.265969 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f945668-fcf4-4a71-91c4-4378115e478c admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:26.266491 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f945668-fcf4-4a71-91c4-4378115e478c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:26.267010 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f945668-fcf4-4a71-91c4-4378115e478c admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:26.268163 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f945668-fcf4-4a71-91c4-4378115e478c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:07:26.268625 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f945668-fcf4-4a71-91c4-4378115e478c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:26.269279 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61d371-f5e3-4a92-99db-5f3f785f421d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:26.270051 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61d371-f5e3-4a92-99db-5f3f785f421d service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:26.270334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61d371-f5e3-4a92-99db-5f3f785f421d service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:26.270669 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61d371-f5e3-4a92-99db-5f3f785f421d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:26.271433 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f945668-fcf4-4a71-91c4-4378115e478c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:26.294678 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1099/2230] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 15:07:26.298231 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f945668-fcf4-4a71-91c4-4378115e478c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:26.298771 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61d371-f5e3-4a92-99db-5f3f785f421d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:26.300270 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61d371-f5e3-4a92-99db-5f3f785f421d service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:26.311031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1132/2231] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:07:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 15:07:26.333200 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f945668-fcf4-4a71-91c4-4378115e478c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:26.336153 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61d371-f5e3-4a92-99db-5f3f785f421d service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:26.338105 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4c61d371-f5e3-4a92-99db-5f3f785f421d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:26.342514 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38965563-d6b7-4ab1-a01a-c0228cbd6d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:26.343335 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38965563-d6b7-4ab1-a01a-c0228cbd6d2b admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:26.344138 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38965563-d6b7-4ab1-a01a-c0228cbd6d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:26.345084 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38965563-d6b7-4ab1-a01a-c0228cbd6d2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:26.345597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38965563-d6b7-4ab1-a01a-c0228cbd6d2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:26.348044 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38965563-d6b7-4ab1-a01a-c0228cbd6d2b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:26.358827 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61d371-f5e3-4a92-99db-5f3f785f421d service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:26.365765 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59650e26-ce38-4da5-a5b4-2144ae7e1c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:26.367543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59650e26-ce38-4da5-a5b4-2144ae7e1c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:26.367677 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59650e26-ce38-4da5-a5b4-2144ae7e1c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:26.367929 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59650e26-ce38-4da5-a5b4-2144ae7e1c39 admin admin] PATH_INFO: `/v3/users/fdfbe32b77bd46f4aa9b6401f898f691` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:26.369587 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59650e26-ce38-4da5-a5b4-2144ae7e1c39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdfbe32b77bd46f4aa9b6401f898f691)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:26.372655 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59650e26-ce38-4da5-a5b4-2144ae7e1c39 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:26.388789 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1100/2232] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:07:26 2022] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:07:26.393386 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38965563-d6b7-4ab1-a01a-c0228cbd6d2b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:26.443448 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-59650e26-ce38-4da5-a5b4-2144ae7e1c39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdfbe32b77bd46f4aa9b6401f898f691'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:26.443448 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-59650e26-ce38-4da5-a5b4-2144ae7e1c39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdfbe32b77bd46f4aa9b6401f898f691'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:26.443448 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-59650e26-ce38-4da5-a5b4-2144ae7e1c39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdfbe32b77bd46f4aa9b6401f898f691'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:26.446172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-59650e26-ce38-4da5-a5b4-2144ae7e1c39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdfbe32b77bd46f4aa9b6401f898f691'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:26.455555 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:26.457415 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:26.464659 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-59650e26-ce38-4da5-a5b4-2144ae7e1c39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdfbe32b77bd46f4aa9b6401f898f691'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:26.479333 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1133/2233] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:07:26 2022] DELETE /identity/v3/users/fdfbe32b77bd46f4aa9b6401f898f691 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:07:26.483606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eeec4a-b24d-4738-8c83-15f7d04cdfd4 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:26.484069 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eeec4a-b24d-4738-8c83-15f7d04cdfd4 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:26.484351 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eeec4a-b24d-4738-8c83-15f7d04cdfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:26.484529 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38965563-d6b7-4ab1-a01a-c0228cbd6d2b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:26.502737 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-47eeec4a-b24d-4738-8c83-15f7d04cdfd4 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:26.504139 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-47eeec4a-b24d-4738-8c83-15f7d04cdfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:26.547122 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e52e2f-a016-4f9d-bc76-78c44b692d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:26.547869 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e52e2f-a016-4f9d-bc76-78c44b692d0a admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:26.548162 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e52e2f-a016-4f9d-bc76-78c44b692d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:26.548475 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e52e2f-a016-4f9d-bc76-78c44b692d0a admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:26.549194 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e52e2f-a016-4f9d-bc76-78c44b692d0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:26.551417 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e52e2f-a016-4f9d-bc76-78c44b692d0a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:26.571649 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1101/2234] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:07:26 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:07:26.571947 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1134/2235] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:07:26.575876 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e52e2f-a016-4f9d-bc76-78c44b692d0a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:26.577495 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b9e52e2f-a016-4f9d-bc76-78c44b692d0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:26.581547 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eeec4a-b24d-4738-8c83-15f7d04cdfd4 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:26.582844 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-47eeec4a-b24d-4738-8c83-15f7d04cdfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:26.589664 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e52e2f-a016-4f9d-bc76-78c44b692d0a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:26.594595 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110207d-063c-4353-996f-b3764a924b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:26.595287 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110207d-063c-4353-996f-b3764a924b3e admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:26.595576 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110207d-063c-4353-996f-b3764a924b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:26.595854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110207d-063c-4353-996f-b3764a924b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:26.596608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f110207d-063c-4353-996f-b3764a924b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:26.598203 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f110207d-063c-4353-996f-b3764a924b3e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:26.608264 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1102/2236] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 15:07:26.611930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110207d-063c-4353-996f-b3764a924b3e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:26.621675 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110207d-063c-4353-996f-b3764a924b3e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:26.626363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e88a15-c799-42f7-86ca-f274050389ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:26.627002 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e88a15-c799-42f7-86ca-f274050389ae admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:26.627326 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e88a15-c799-42f7-86ca-f274050389ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:26.627628 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e88a15-c799-42f7-86ca-f274050389ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:26.628372 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e88a15-c799-42f7-86ca-f274050389ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:26.629952 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e88a15-c799-42f7-86ca-f274050389ae admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:26.640923 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eeec4a-b24d-4738-8c83-15f7d04cdfd4 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:26.641080 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1103/2237] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 15:07:26.644785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e88a15-c799-42f7-86ca-f274050389ae admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:26.644927 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32dc93-a085-40dc-a0fb-320cd412876d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:26.645702 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32dc93-a085-40dc-a0fb-320cd412876d service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:26.645987 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32dc93-a085-40dc-a0fb-320cd412876d service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:26.646265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32dc93-a085-40dc-a0fb-320cd412876d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:26.654564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e88a15-c799-42f7-86ca-f274050389ae admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:26.656148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a32dc93-a085-40dc-a0fb-320cd412876d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:26.657674 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a32dc93-a085-40dc-a0fb-320cd412876d service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:26.659890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186694c4-ea63-4a28-8361-3e5856212e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:26.660749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186694c4-ea63-4a28-8361-3e5856212e7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:26.661038 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186694c4-ea63-4a28-8361-3e5856212e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:26.661315 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186694c4-ea63-4a28-8361-3e5856212e7b admin admin] PATH_INFO: `/v3/projects/0089bf367acd48868afea67bfd19a5f7/users/b3dd7d4e0477424296a4fb3f53c048be/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:26.667792 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1135/2238] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:07:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:07:26.676985 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186694c4-ea63-4a28-8361-3e5856212e7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0089bf367acd48868afea67bfd19a5f7, user_id=b3dd7d4e0477424296a4fb3f53c048be, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:26.680252 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186694c4-ea63-4a28-8361-3e5856212e7b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:26.693646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1104/2239] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:07:26 2022] PUT /identity/v3/projects/0089bf367acd48868afea67bfd19a5f7/users/b3dd7d4e0477424296a4fb3f53c048be/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:07:26.704492 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a90dd3-7be8-4bc0-8aa2-a0a36d3cc218 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:26.704725 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a90dd3-7be8-4bc0-8aa2-a0a36d3cc218 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:26.705030 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a90dd3-7be8-4bc0-8aa2-a0a36d3cc218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:26.732607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e5a90dd3-7be8-4bc0-8aa2-a0a36d3cc218 None None] MFA Rules not processed for user `b3dd7d4e0477424296a4fb3f53c048be`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:26.733870 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e5a90dd3-7be8-4bc0-8aa2-a0a36d3cc218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:26.810848 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1136/2240] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:26.812777 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186694c4-ea63-4a28-8361-3e5856212e7b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:26.878745 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186694c4-ea63-4a28-8361-3e5856212e7b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:26.884109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8621bfe-055f-4c7e-841b-5c4d02611291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:26.884802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8621bfe-055f-4c7e-841b-5c4d02611291 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:26.885088 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8621bfe-055f-4c7e-841b-5c4d02611291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:26.885365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8621bfe-055f-4c7e-841b-5c4d02611291 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:26.886058 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8621bfe-055f-4c7e-841b-5c4d02611291 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:26.888010 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8621bfe-055f-4c7e-841b-5c4d02611291 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:26.915177 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1105/2241] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:07:26 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:07:26.919338 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a90dd3-7be8-4bc0-8aa2-a0a36d3cc218 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:26.932272 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a90dd3-7be8-4bc0-8aa2-a0a36d3cc218 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:26.938614 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8621bfe-055f-4c7e-841b-5c4d02611291 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:26.940406 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c8621bfe-055f-4c7e-841b-5c4d02611291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:26.943792 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:26.966354 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:27.003581 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dcea5f-765a-49d6-886c-fe5748895972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:27.004261 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcea5f-765a-49d6-886c-fe5748895972 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:27.004547 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcea5f-765a-49d6-886c-fe5748895972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:27.004827 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcea5f-765a-49d6-886c-fe5748895972 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:27.005537 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dcea5f-765a-49d6-886c-fe5748895972 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:27.008100 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dcea5f-765a-49d6-886c-fe5748895972 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:27.020858 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8621bfe-055f-4c7e-841b-5c4d02611291 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:27.025915 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4c293-28e1-46b5-b4af-50d1d8a90c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:27.026778 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4c293-28e1-46b5-b4af-50d1d8a90c55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:27.027065 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4c293-28e1-46b5-b4af-50d1d8a90c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:27.027375 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4c293-28e1-46b5-b4af-50d1d8a90c55 admin admin] PATH_INFO: `/v3/projects/dff19d5dda9442cfa384209ee20c22ae` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:27.028550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4c293-28e1-46b5-b4af-50d1d8a90c55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dff19d5dda9442cfa384209ee20c22ae)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:27.031732 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1137/2242] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:07:26 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:07:27.031865 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4c293-28e1-46b5-b4af-50d1d8a90c55 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:27.033052 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dcea5f-765a-49d6-886c-fe5748895972 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:27.042831 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dcea5f-765a-49d6-886c-fe5748895972 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:27.047441 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb72207-85b9-4adc-89ac-3372d3e9af09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:27.048077 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb72207-85b9-4adc-89ac-3372d3e9af09 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:27.048354 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb72207-85b9-4adc-89ac-3372d3e9af09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:27.048657 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb72207-85b9-4adc-89ac-3372d3e9af09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:27.049383 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb72207-85b9-4adc-89ac-3372d3e9af09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:27.050929 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb72207-85b9-4adc-89ac-3372d3e9af09 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:27.064911 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1138/2243] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 15:07:27.066222 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb72207-85b9-4adc-89ac-3372d3e9af09 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:27.076240 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb72207-85b9-4adc-89ac-3372d3e9af09 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:27.079366 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-76f4c293-28e1-46b5-b4af-50d1d8a90c55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dff19d5dda9442cfa384209ee20c22ae', 'request_id': 'req-76f4c293-28e1-46b5-b4af-50d1d8a90c55'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:27.086771 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-76f4c293-28e1-46b5-b4af-50d1d8a90c55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dff19d5dda9442cfa384209ee20c22ae', 'request_id': 'req-76f4c293-28e1-46b5-b4af-50d1d8a90c55'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:27.093543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-76f4c293-28e1-46b5-b4af-50d1d8a90c55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dff19d5dda9442cfa384209ee20c22ae', 'request_id': 'req-76f4c293-28e1-46b5-b4af-50d1d8a90c55'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:27.105477 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-76f4c293-28e1-46b5-b4af-50d1d8a90c55 admin admin] The token cache is being invalidate because project dff19d5dda9442cfa384209ee20c22ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:07:27.105764 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-76f4c293-28e1-46b5-b4af-50d1d8a90c55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:27.106448 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-76f4c293-28e1-46b5-b4af-50d1d8a90c55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:27.108308 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1106/2244] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:07:26 2022] DELETE /identity/v3/projects/dff19d5dda9442cfa384209ee20c22ae => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:27.112727 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9ba1d-0bc7-4d02-a627-8ad7b2091ad5 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:27.113027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9ba1d-0bc7-4d02-a627-8ad7b2091ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:27.113314 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9ba1d-0bc7-4d02-a627-8ad7b2091ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:27.131945 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-33a9ba1d-0bc7-4d02-a627-8ad7b2091ad5 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:27.133156 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-33a9ba1d-0bc7-4d02-a627-8ad7b2091ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:27.135625 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb9f6f-5dbb-48c7-804f-b7d6ff4a92c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:27.136292 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb9f6f-5dbb-48c7-804f-b7d6ff4a92c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:27.136573 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb9f6f-5dbb-48c7-804f-b7d6ff4a92c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:27.136849 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb9f6f-5dbb-48c7-804f-b7d6ff4a92c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:27.137569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb9f6f-5dbb-48c7-804f-b7d6ff4a92c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:27.139192 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb9f6f-5dbb-48c7-804f-b7d6ff4a92c6 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:27.141269 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1107/2245] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:07:27.148488 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7772f-1e78-4545-ac41-27e0cda538e9 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:27.148782 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7772f-1e78-4545-ac41-27e0cda538e9 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:27.149086 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7772f-1e78-4545-ac41-27e0cda538e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:27.149654 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1139/2246] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 15:07:27.153536 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb9f6f-5dbb-48c7-804f-b7d6ff4a92c6 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:27.155298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c3bb9f6f-5dbb-48c7-804f-b7d6ff4a92c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:27.167752 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-78e7772f-1e78-4545-ac41-27e0cda538e9 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:27.171149 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb9f6f-5dbb-48c7-804f-b7d6ff4a92c6 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:27.171269 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-78e7772f-1e78-4545-ac41-27e0cda538e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:27.172908 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f9732-db3d-444d-a5ec-ac22bd14ebd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:27.173786 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f9732-db3d-444d-a5ec-ac22bd14ebd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:27.174066 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f9732-db3d-444d-a5ec-ac22bd14ebd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:27.174341 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f9732-db3d-444d-a5ec-ac22bd14ebd6 admin admin] PATH_INFO: `/v3/projects/fb2930d1b0b74e07aec8185190a78e42/users/6746896cfda545599df7640800b244f5/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:27.179890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1108/2247] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:07:27.184109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7772f-1e78-4545-ac41-27e0cda538e9 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:27.192990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f9732-db3d-444d-a5ec-ac22bd14ebd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb2930d1b0b74e07aec8185190a78e42, user_id=6746896cfda545599df7640800b244f5, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:27.193805 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7772f-1e78-4545-ac41-27e0cda538e9 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:27.195749 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f9732-db3d-444d-a5ec-ac22bd14ebd6 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:27.198515 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0560b4-ae8f-4bd2-9bbd-557f41986cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:27.199172 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0560b4-ae8f-4bd2-9bbd-557f41986cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:27.199490 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0560b4-ae8f-4bd2-9bbd-557f41986cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:27.199764 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0560b4-ae8f-4bd2-9bbd-557f41986cf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:27.200488 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0560b4-ae8f-4bd2-9bbd-557f41986cf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:07:27.200820 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0560b4-ae8f-4bd2-9bbd-557f41986cf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:27.202426 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0560b4-ae8f-4bd2-9bbd-557f41986cf7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:27.212522 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1140/2248] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:07:27 2022] PUT /identity/v3/projects/fb2930d1b0b74e07aec8185190a78e42/users/6746896cfda545599df7640800b244f5/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:07:27.221441 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1109/2249] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 15:07:27.221567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f9732-db3d-444d-a5ec-ac22bd14ebd6 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:27.228479 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f8d64-f0a5-4f23-bce8-417e9156019d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:27.228925 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f8d64-f0a5-4f23-bce8-417e9156019d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:27.229213 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f8d64-f0a5-4f23-bce8-417e9156019d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:27.257973 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-aa8f8d64-f0a5-4f23-bce8-417e9156019d None None] MFA Rules not processed for user `6746896cfda545599df7640800b244f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:27.259221 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-aa8f8d64-f0a5-4f23-bce8-417e9156019d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:27.302775 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f9732-db3d-444d-a5ec-ac22bd14ebd6 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:27.309198 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79057cb3-60c7-4246-8d65-0824085c2ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:27.309891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79057cb3-60c7-4246-8d65-0824085c2ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:27.311333 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79057cb3-60c7-4246-8d65-0824085c2ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:27.312010 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79057cb3-60c7-4246-8d65-0824085c2ea1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:27.312753 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79057cb3-60c7-4246-8d65-0824085c2ea1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:27.315462 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79057cb3-60c7-4246-8d65-0824085c2ea1 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:27.324240 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:27.344323 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1141/2250] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:07:27 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:07:27.345232 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1110/2251] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:27.345645 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79057cb3-60c7-4246-8d65-0824085c2ea1 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:27.348986 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-79057cb3-60c7-4246-8d65-0824085c2ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:27.351624 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f8d64-f0a5-4f23-bce8-417e9156019d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:27.367660 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f8d64-f0a5-4f23-bce8-417e9156019d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:27.375112 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:27.426503 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79057cb3-60c7-4246-8d65-0824085c2ea1 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:27.431099 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5970572-051c-4bf7-9ef6-5a081f5685c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:27.431336 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f7699-7f99-45f4-9d13-3573db909e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:27.431811 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5970572-051c-4bf7-9ef6-5a081f5685c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:27.432100 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5970572-051c-4bf7-9ef6-5a081f5685c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:27.432256 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f7699-7f99-45f4-9d13-3573db909e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:27.432365 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5970572-051c-4bf7-9ef6-5a081f5685c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:27.432535 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f7699-7f99-45f4-9d13-3573db909e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:27.432807 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f7699-7f99-45f4-9d13-3573db909e9d admin admin] PATH_INFO: `/v3/users/ae76c84eb6e24e499a283d5985a37e60` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:27.433054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5970572-051c-4bf7-9ef6-5a081f5685c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:27.434065 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f7699-7f99-45f4-9d13-3573db909e9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae76c84eb6e24e499a283d5985a37e60)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:27.435029 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5970572-051c-4bf7-9ef6-5a081f5685c7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:27.436235 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f7699-7f99-45f4-9d13-3573db909e9d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:27.461515 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1111/2252] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:07:27 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:07:27.462956 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5970572-051c-4bf7-9ef6-5a081f5685c7 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:27.476182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5970572-051c-4bf7-9ef6-5a081f5685c7 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:27.482331 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78161311-8e3b-4d0f-99e6-882a70113501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:27.483286 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78161311-8e3b-4d0f-99e6-882a70113501 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:27.483782 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78161311-8e3b-4d0f-99e6-882a70113501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:27.484255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78161311-8e3b-4d0f-99e6-882a70113501 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:27.485125 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78161311-8e3b-4d0f-99e6-882a70113501 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:27.487231 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78161311-8e3b-4d0f-99e6-882a70113501 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:27.503333 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9f0f7699-7f99-45f4-9d13-3573db909e9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae76c84eb6e24e499a283d5985a37e60'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:27.504384 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9f0f7699-7f99-45f4-9d13-3573db909e9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae76c84eb6e24e499a283d5985a37e60'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:27.504735 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9f0f7699-7f99-45f4-9d13-3573db909e9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae76c84eb6e24e499a283d5985a37e60'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:27.513914 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9f0f7699-7f99-45f4-9d13-3573db909e9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae76c84eb6e24e499a283d5985a37e60'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:27.518342 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1112/2253] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:07:27 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:07:27.519191 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78161311-8e3b-4d0f-99e6-882a70113501 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:27.523504 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-78161311-8e3b-4d0f-99e6-882a70113501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:27.532994 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9f0f7699-7f99-45f4-9d13-3573db909e9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae76c84eb6e24e499a283d5985a37e60'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:27.550376 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1142/2254] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:07:27 2022] DELETE /identity/v3/users/ae76c84eb6e24e499a283d5985a37e60 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:27.551334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f7699-7f99-45f4-9d13-3573db909e9d admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:27.552747 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9f0f7699-7f99-45f4-9d13-3573db909e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:27.602428 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78161311-8e3b-4d0f-99e6-882a70113501 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:27.641870 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f7699-7f99-45f4-9d13-3573db909e9d admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:27.646898 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8945c6-0f9e-4795-992d-4ec8c2c6af14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:27.648238 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8945c6-0f9e-4795-992d-4ec8c2c6af14 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:27.648594 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8945c6-0f9e-4795-992d-4ec8c2c6af14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:27.648903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8945c6-0f9e-4795-992d-4ec8c2c6af14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:27.649638 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8945c6-0f9e-4795-992d-4ec8c2c6af14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:27.651614 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8945c6-0f9e-4795-992d-4ec8c2c6af14 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:27.663384 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1143/2255] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:07:27.664193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8945c6-0f9e-4795-992d-4ec8c2c6af14 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:27.665866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0a8945c6-0f9e-4795-992d-4ec8c2c6af14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:27.674802 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:27.679172 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7539b9-8cb5-465e-a0dd-f20684135224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:27.680137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7539b9-8cb5-465e-a0dd-f20684135224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:27.680421 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7539b9-8cb5-465e-a0dd-f20684135224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:27.680696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7539b9-8cb5-465e-a0dd-f20684135224 admin admin] PATH_INFO: `/v3/users/d61127ff76414a27900dea9e42198bf7` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:27.681516 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8945c6-0f9e-4795-992d-4ec8c2c6af14 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:27.682157 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7539b9-8cb5-465e-a0dd-f20684135224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d61127ff76414a27900dea9e42198bf7)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:27.683979 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7539b9-8cb5-465e-a0dd-f20684135224 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:27.688722 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa144d5d-eaad-400f-ab36-04c4e48492e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:27.689559 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa144d5d-eaad-400f-ab36-04c4e48492e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:27.689850 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa144d5d-eaad-400f-ab36-04c4e48492e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:27.690133 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa144d5d-eaad-400f-ab36-04c4e48492e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:27.690833 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa144d5d-eaad-400f-ab36-04c4e48492e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:27.692790 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa144d5d-eaad-400f-ab36-04c4e48492e7 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:27.714322 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:27.715092 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1144/2256] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:07:27 2022] POST /identity/v3/users => generated 296 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:07:27.716428 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc955b-9690-4ce4-b7e0-92f1b51cf0c7 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:27.716723 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc955b-9690-4ce4-b7e0-92f1b51cf0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:27.717003 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc955b-9690-4ce4-b7e0-92f1b51cf0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:27.737812 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-0fbc955b-9690-4ce4-b7e0-92f1b51cf0c7 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:27.738181 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9b7539b9-8cb5-465e-a0dd-f20684135224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd61127ff76414a27900dea9e42198bf7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:27.738951 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0fbc955b-9690-4ce4-b7e0-92f1b51cf0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:27.746505 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9b7539b9-8cb5-465e-a0dd-f20684135224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd61127ff76414a27900dea9e42198bf7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:27.748962 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1145/2257] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:27.749567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc955b-9690-4ce4-b7e0-92f1b51cf0c7 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:27.760714 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9b7539b9-8cb5-465e-a0dd-f20684135224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd61127ff76414a27900dea9e42198bf7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:27.761773 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9b7539b9-8cb5-465e-a0dd-f20684135224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd61127ff76414a27900dea9e42198bf7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:27.762611 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9b7539b9-8cb5-465e-a0dd-f20684135224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd61127ff76414a27900dea9e42198bf7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:27.768331 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc955b-9690-4ce4-b7e0-92f1b51cf0c7 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:27.773545 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c67ce-7213-486b-9d5d-b737463ab984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:27.774251 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c67ce-7213-486b-9d5d-b737463ab984 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:27.774535 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c67ce-7213-486b-9d5d-b737463ab984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:27.774810 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c67ce-7213-486b-9d5d-b737463ab984 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:27.775251 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1113/2258] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:07:27 2022] DELETE /identity/v3/users/d61127ff76414a27900dea9e42198bf7 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:27.778371 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c67ce-7213-486b-9d5d-b737463ab984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:27.778485 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7539b9-8cb5-465e-a0dd-f20684135224 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:27.778579 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c67ce-7213-486b-9d5d-b737463ab984 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:27.778662 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9b7539b9-8cb5-465e-a0dd-f20684135224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:27.791733 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1146/2259] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:07:27.791733 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c67ce-7213-486b-9d5d-b737463ab984 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:27.793440 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-708c67ce-7213-486b-9d5d-b737463ab984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:27.847843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7539b9-8cb5-465e-a0dd-f20684135224 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:27.853362 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c67ce-7213-486b-9d5d-b737463ab984 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:27.854197 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d607243-4e7d-41ce-b6e1-ab4c2e9b2100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:27.854955 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d607243-4e7d-41ce-b6e1-ab4c2e9b2100 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:27.855296 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d607243-4e7d-41ce-b6e1-ab4c2e9b2100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:27.855606 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d607243-4e7d-41ce-b6e1-ab4c2e9b2100 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:27.856376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d607243-4e7d-41ce-b6e1-ab4c2e9b2100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:27.857968 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d607243-4e7d-41ce-b6e1-ab4c2e9b2100 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:27.870010 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1114/2260] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:07:27.871620 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5407c-596f-430c-b83d-058a20f123e6 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:27.872015 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5407c-596f-430c-b83d-058a20f123e6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:27.872203 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5407c-596f-430c-b83d-058a20f123e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:27.891717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-64a5407c-596f-430c-b83d-058a20f123e6 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:27.892930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-64a5407c-596f-430c-b83d-058a20f123e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:27.900603 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1115/2261] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:27.906556 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5407c-596f-430c-b83d-058a20f123e6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:27.906556 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-64a5407c-596f-430c-b83d-058a20f123e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:27.908016 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7671f-f016-4d38-861b-b210a99b2481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:27.908637 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7671f-f016-4d38-861b-b210a99b2481 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:27.908920 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7671f-f016-4d38-861b-b210a99b2481 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:27.909187 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7671f-f016-4d38-861b-b210a99b2481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:27.911283 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5bc7671f-f016-4d38-861b-b210a99b2481 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:27.919116 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5407c-596f-430c-b83d-058a20f123e6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:27.923907 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7671f-f016-4d38-861b-b210a99b2481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:27.924362 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623ee29-961e-43e3-bb54-608ecfa2f808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:27.925004 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623ee29-961e-43e3-bb54-608ecfa2f808 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:27.925282 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623ee29-961e-43e3-bb54-608ecfa2f808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:27.925384 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7671f-f016-4d38-861b-b210a99b2481 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:27.925558 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623ee29-961e-43e3-bb54-608ecfa2f808 admin admin] PATH_INFO: `/v3/projects/2e062c65073344019b40ed7da5bddb0a/users/7553e981c59d4aff91526c41f557c804/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:27.935682 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1147/2262] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:07:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:07:27.936597 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7671f-f016-4d38-861b-b210a99b2481 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:27.942288 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7623ee29-961e-43e3-bb54-608ecfa2f808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e062c65073344019b40ed7da5bddb0a, user_id=7553e981c59d4aff91526c41f557c804, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:27.945240 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7623ee29-961e-43e3-bb54-608ecfa2f808 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:27.945982 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7671f-f016-4d38-861b-b210a99b2481 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:27.950809 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc22f2-338c-49dd-9399-b718dd605d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:27.951777 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc22f2-338c-49dd-9399-b718dd605d2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:27.951993 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc22f2-338c-49dd-9399-b718dd605d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:27.952277 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc22f2-338c-49dd-9399-b718dd605d2e admin admin] PATH_INFO: `/v3/projects/61bf044212cb427fb5fe0b8773d0159d/users/fbc4dc0698df4f12bb26e0e475369c26/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:27.962723 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1116/2263] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:07:27 2022] PUT /identity/v3/projects/2e062c65073344019b40ed7da5bddb0a/users/7553e981c59d4aff91526c41f557c804/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:27.968073 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623ee29-961e-43e3-bb54-608ecfa2f808 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:27.973922 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc22f2-338c-49dd-9399-b718dd605d2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=61bf044212cb427fb5fe0b8773d0159d, user_id=fbc4dc0698df4f12bb26e0e475369c26, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:27.977219 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc22f2-338c-49dd-9399-b718dd605d2e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:27.997219 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1148/2264] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:07:27 2022] PUT /identity/v3/projects/61bf044212cb427fb5fe0b8773d0159d/users/fbc4dc0698df4f12bb26e0e475369c26/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:27.997219 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48409d44-f959-4018-95df-549fe9ec352c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:27.997219 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48409d44-f959-4018-95df-549fe9ec352c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:27.997639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48409d44-f959-4018-95df-549fe9ec352c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:28.027761 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-48409d44-f959-4018-95df-549fe9ec352c None None] MFA Rules not processed for user `7553e981c59d4aff91526c41f557c804`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:28.029104 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-48409d44-f959-4018-95df-549fe9ec352c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:28.035708 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623ee29-961e-43e3-bb54-608ecfa2f808 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:28.058555 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:28.090434 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:28.101268 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef8cac-8ba1-4b2b-a7a3-95abc79e521a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:28.102091 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef8cac-8ba1-4b2b-a7a3-95abc79e521a service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:28.102403 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef8cac-8ba1-4b2b-a7a3-95abc79e521a service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:28.102779 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef8cac-8ba1-4b2b-a7a3-95abc79e521a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:28.110282 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1149/2265] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:28.110282 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48409d44-f959-4018-95df-549fe9ec352c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:28.188907 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48409d44-f959-4018-95df-549fe9ec352c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:28.195514 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388471b-560c-4832-8fe4-5bac7dd1fc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:28.196405 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388471b-560c-4832-8fe4-5bac7dd1fc98 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:28.196699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388471b-560c-4832-8fe4-5bac7dd1fc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:28.196977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388471b-560c-4832-8fe4-5bac7dd1fc98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:28.197713 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388471b-560c-4832-8fe4-5bac7dd1fc98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:28.199473 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388471b-560c-4832-8fe4-5bac7dd1fc98 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:28.204677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef8cac-8ba1-4b2b-a7a3-95abc79e521a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:28.206306 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef8cac-8ba1-4b2b-a7a3-95abc79e521a service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:28.213721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1150/2266] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:07:28.213721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388471b-560c-4832-8fe4-5bac7dd1fc98 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:28.215613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c388471b-560c-4832-8fe4-5bac7dd1fc98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:28.217731 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1117/2267] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:07:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:07:28.218660 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef8cac-8ba1-4b2b-a7a3-95abc79e521a service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:28.229945 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef8cac-8ba1-4b2b-a7a3-95abc79e521a service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:28.237757 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6dd6a0-f108-4439-8197-217bf3d1bf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:28.237757 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6dd6a0-f108-4439-8197-217bf3d1bf3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:28.238026 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6dd6a0-f108-4439-8197-217bf3d1bf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:28.238109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6dd6a0-f108-4439-8197-217bf3d1bf3d admin admin] PATH_INFO: `/v3/projects/61bf044212cb427fb5fe0b8773d0159d/users/fbc4dc0698df4f12bb26e0e475369c26/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:28.240328 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6dd6a0-f108-4439-8197-217bf3d1bf3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=61bf044212cb427fb5fe0b8773d0159d, user_id=fbc4dc0698df4f12bb26e0e475369c26, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:28.243762 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6dd6a0-f108-4439-8197-217bf3d1bf3d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:28.258275 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1118/2268] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:07:28 2022] PUT /identity/v3/projects/61bf044212cb427fb5fe0b8773d0159d/users/fbc4dc0698df4f12bb26e0e475369c26/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:28.268025 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6dd6a0-f108-4439-8197-217bf3d1bf3d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:28.269894 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3d6dd6a0-f108-4439-8197-217bf3d1bf3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:28.291292 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388471b-560c-4832-8fe4-5bac7dd1fc98 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:28.369760 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6dd6a0-f108-4439-8197-217bf3d1bf3d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:28.373315 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0df032-addd-4947-a428-2bd9afca90a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:28.373655 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0df032-addd-4947-a428-2bd9afca90a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:28.374016 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0df032-addd-4947-a428-2bd9afca90a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:28.374424 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0df032-addd-4947-a428-2bd9afca90a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:28.375785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c155547-199a-4486-a2b6-5a0799d9fc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:28.376704 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c155547-199a-4486-a2b6-5a0799d9fc1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:28.376988 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c155547-199a-4486-a2b6-5a0799d9fc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:28.377265 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c155547-199a-4486-a2b6-5a0799d9fc1a admin admin] PATH_INFO: `/v3/projects/7b292769048d41e2b1459d7ce22ae4a8` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:28.378626 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c155547-199a-4486-a2b6-5a0799d9fc1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b292769048d41e2b1459d7ce22ae4a8)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:28.380637 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c155547-199a-4486-a2b6-5a0799d9fc1a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:28.440660 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4c155547-199a-4486-a2b6-5a0799d9fc1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b292769048d41e2b1459d7ce22ae4a8', 'request_id': 'req-4c155547-199a-4486-a2b6-5a0799d9fc1a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:28.449438 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0df032-addd-4947-a428-2bd9afca90a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:28.450930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0df032-addd-4947-a428-2bd9afca90a6 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:28.451191 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4c155547-199a-4486-a2b6-5a0799d9fc1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b292769048d41e2b1459d7ce22ae4a8', 'request_id': 'req-4c155547-199a-4486-a2b6-5a0799d9fc1a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:28.455914 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:28.460468 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4c155547-199a-4486-a2b6-5a0799d9fc1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b292769048d41e2b1459d7ce22ae4a8', 'request_id': 'req-4c155547-199a-4486-a2b6-5a0799d9fc1a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:28.462183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1151/2269] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:07:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:07:28.462806 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aa5e1-843c-4bb2-a264-f7f68596aa0a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:28.463227 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aa5e1-843c-4bb2-a264-f7f68596aa0a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:28.463403 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778aa5e1-843c-4bb2-a264-f7f68596aa0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:28.463977 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:28.476896 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4c155547-199a-4486-a2b6-5a0799d9fc1a admin admin] The token cache is being invalidate because project 7b292769048d41e2b1459d7ce22ae4a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:07:28.477264 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4c155547-199a-4486-a2b6-5a0799d9fc1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:28.478413 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4c155547-199a-4486-a2b6-5a0799d9fc1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:28.480768 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1119/2270] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:07:28 2022] DELETE /identity/v3/projects/7b292769048d41e2b1459d7ce22ae4a8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:07:28.484783 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c155547-199a-4486-a2b6-5a0799d9fc1a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:28.487340 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4c155547-199a-4486-a2b6-5a0799d9fc1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:28.496405 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-778aa5e1-843c-4bb2-a264-f7f68596aa0a None None] MFA Rules not processed for user `fbc4dc0698df4f12bb26e0e475369c26`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:28.498249 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-778aa5e1-843c-4bb2-a264-f7f68596aa0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:28.578956 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c155547-199a-4486-a2b6-5a0799d9fc1a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:28.584272 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b89e4-d2c2-49c9-8129-20be0b1e93dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:28.585566 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b89e4-d2c2-49c9-8129-20be0b1e93dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:28.586079 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b89e4-d2c2-49c9-8129-20be0b1e93dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:28.586704 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b89e4-d2c2-49c9-8129-20be0b1e93dc admin admin] PATH_INFO: `/v3/users/365c7b10574747a283ba5e9870242b86` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:28.589051 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b89e4-d2c2-49c9-8129-20be0b1e93dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=365c7b10574747a283ba5e9870242b86)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:28.592285 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b89e4-d2c2-49c9-8129-20be0b1e93dc admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:28.600272 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1152/2271] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:28.601643 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aa5e1-843c-4bb2-a264-f7f68596aa0a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:28.603420 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-778aa5e1-843c-4bb2-a264-f7f68596aa0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:28.619470 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778aa5e1-843c-4bb2-a264-f7f68596aa0a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:28.624899 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9d428-a50e-44a3-a092-b83107bd8bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:28.625774 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9d428-a50e-44a3-a092-b83107bd8bfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:28.626057 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9d428-a50e-44a3-a092-b83107bd8bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:28.626332 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9d428-a50e-44a3-a092-b83107bd8bfe admin admin] PATH_INFO: `/v3/projects/f5114816fa9a41afb81957930a2ded12` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:28.627624 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9d428-a50e-44a3-a092-b83107bd8bfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5114816fa9a41afb81957930a2ded12)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:28.629679 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9d428-a50e-44a3-a092-b83107bd8bfe admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:28.689700 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-977b89e4-d2c2-49c9-8129-20be0b1e93dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '365c7b10574747a283ba5e9870242b86'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:28.696573 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f8a9d428-a50e-44a3-a092-b83107bd8bfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5114816fa9a41afb81957930a2ded12', 'request_id': 'req-f8a9d428-a50e-44a3-a092-b83107bd8bfe'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:28.697598 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-977b89e4-d2c2-49c9-8129-20be0b1e93dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '365c7b10574747a283ba5e9870242b86'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:28.704039 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f8a9d428-a50e-44a3-a092-b83107bd8bfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5114816fa9a41afb81957930a2ded12', 'request_id': 'req-f8a9d428-a50e-44a3-a092-b83107bd8bfe'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:28.712960 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-977b89e4-d2c2-49c9-8129-20be0b1e93dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '365c7b10574747a283ba5e9870242b86'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:28.713305 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f8a9d428-a50e-44a3-a092-b83107bd8bfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5114816fa9a41afb81957930a2ded12', 'request_id': 'req-f8a9d428-a50e-44a3-a092-b83107bd8bfe'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:28.714316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-977b89e4-d2c2-49c9-8129-20be0b1e93dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '365c7b10574747a283ba5e9870242b86'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:28.715116 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-977b89e4-d2c2-49c9-8129-20be0b1e93dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '365c7b10574747a283ba5e9870242b86'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:28.731302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f8a9d428-a50e-44a3-a092-b83107bd8bfe admin admin] The token cache is being invalidate because project f5114816fa9a41afb81957930a2ded12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:07:28.731930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f8a9d428-a50e-44a3-a092-b83107bd8bfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:28.733053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f8a9d428-a50e-44a3-a092-b83107bd8bfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:28.735991 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1153/2272] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:07:28 2022] DELETE /identity/v3/projects/f5114816fa9a41afb81957930a2ded12 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:28.737029 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9d428-a50e-44a3-a092-b83107bd8bfe admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:28.738786 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f8a9d428-a50e-44a3-a092-b83107bd8bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:28.743542 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1120/2273] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:07:28 2022] DELETE /identity/v3/users/365c7b10574747a283ba5e9870242b86 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:28.748081 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a811ba6-9c86-42bf-9bf2-604a44ff03a5 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:28.748374 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a811ba6-9c86-42bf-9bf2-604a44ff03a5 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:28.748710 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a811ba6-9c86-42bf-9bf2-604a44ff03a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:28.769778 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1a811ba6-9c86-42bf-9bf2-604a44ff03a5 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:28.770998 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1a811ba6-9c86-42bf-9bf2-604a44ff03a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:28.840513 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9d428-a50e-44a3-a092-b83107bd8bfe admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:28.862386 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1121/2274] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:28.880519 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b6b4b-7096-4fec-9558-2d70a32c8933 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:28.880860 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b6b4b-7096-4fec-9558-2d70a32c8933 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:28.881166 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b6b4b-7096-4fec-9558-2d70a32c8933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:28.885958 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:28.923795 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-671b6b4b-7096-4fec-9558-2d70a32c8933 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:28.925383 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-671b6b4b-7096-4fec-9558-2d70a32c8933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:28.933246 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce41ca-844e-4bb5-9762-93ff2751c980 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:28.933970 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce41ca-844e-4bb5-9762-93ff2751c980 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:28.934311 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce41ca-844e-4bb5-9762-93ff2751c980 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:28.934681 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce41ca-844e-4bb5-9762-93ff2751c980 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:28.937032 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ebce41ca-844e-4bb5-9762-93ff2751c980 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:28.937652 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1122/2275] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:28.942003 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b6b4b-7096-4fec-9558-2d70a32c8933 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:28.950075 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:28.956265 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b6b4b-7096-4fec-9558-2d70a32c8933 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:28.964636 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16239886-880f-4510-a079-d9b3ee1bb10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:28.965693 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16239886-880f-4510-a079-d9b3ee1bb10f admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:28.966211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16239886-880f-4510-a079-d9b3ee1bb10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:28.966795 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16239886-880f-4510-a079-d9b3ee1bb10f admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:28.968231 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16239886-880f-4510-a079-d9b3ee1bb10f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:07:28.968666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16239886-880f-4510-a079-d9b3ee1bb10f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:28.971179 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16239886-880f-4510-a079-d9b3ee1bb10f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:28.987510 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1123/2276] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 15:07:28.990857 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16239886-880f-4510-a079-d9b3ee1bb10f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:29.008707 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16239886-880f-4510-a079-d9b3ee1bb10f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:29.015339 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59676da-e21e-4e50-9f3e-d1d0743917ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:29.015948 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59676da-e21e-4e50-9f3e-d1d0743917ce admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:29.016233 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59676da-e21e-4e50-9f3e-d1d0743917ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:29.016510 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59676da-e21e-4e50-9f3e-d1d0743917ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:29.017239 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59676da-e21e-4e50-9f3e-d1d0743917ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:29.019384 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59676da-e21e-4e50-9f3e-d1d0743917ce admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:29.036526 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce41ca-844e-4bb5-9762-93ff2751c980 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:29.039958 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce41ca-844e-4bb5-9762-93ff2751c980 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:29.054601 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1154/2277] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:07:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:07:29.059907 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1124/2278] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:07:28 2022] POST /identity/v3/projects => generated 397 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:07:29.064237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce41ca-844e-4bb5-9762-93ff2751c980 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:29.074936 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce41ca-844e-4bb5-9762-93ff2751c980 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:29.107078 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59676da-e21e-4e50-9f3e-d1d0743917ce admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:29.108884 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e59676da-e21e-4e50-9f3e-d1d0743917ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:29.148851 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1529565-197b-44be-9a18-7f98608ed076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:29.150200 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1529565-197b-44be-9a18-7f98608ed076 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:29.151346 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1529565-197b-44be-9a18-7f98608ed076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:29.151638 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1529565-197b-44be-9a18-7f98608ed076 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:29.152372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1529565-197b-44be-9a18-7f98608ed076 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:29.154323 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1529565-197b-44be-9a18-7f98608ed076 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:29.185519 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1155/2279] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:07:29 2022] POST /identity/v3/users => generated 299 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:07:29.185519 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1529565-197b-44be-9a18-7f98608ed076 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:29.185519 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d1529565-197b-44be-9a18-7f98608ed076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:29.186175 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59676da-e21e-4e50-9f3e-d1d0743917ce admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:29.191237 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326fb9f-5e15-435b-80e3-3793d8f44765 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:29.191872 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326fb9f-5e15-435b-80e3-3793d8f44765 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:29.192134 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326fb9f-5e15-435b-80e3-3793d8f44765 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:29.192410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326fb9f-5e15-435b-80e3-3793d8f44765 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:29.197705 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1529565-197b-44be-9a18-7f98608ed076 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:29.200568 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1326fb9f-5e15-435b-80e3-3793d8f44765 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:29.202803 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77423a-e942-4861-b1e0-41bc95d3e909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:29.203734 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77423a-e942-4861-b1e0-41bc95d3e909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:29.204035 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77423a-e942-4861-b1e0-41bc95d3e909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:29.204325 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77423a-e942-4861-b1e0-41bc95d3e909 admin admin] PATH_INFO: `/v3/projects/97fe2574ee70458d97078d5615054eb4` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:29.205786 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77423a-e942-4861-b1e0-41bc95d3e909 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97fe2574ee70458d97078d5615054eb4)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:29.207942 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77423a-e942-4861-b1e0-41bc95d3e909 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:29.263606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1d77423a-e942-4861-b1e0-41bc95d3e909 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97fe2574ee70458d97078d5615054eb4', 'request_id': 'req-1d77423a-e942-4861-b1e0-41bc95d3e909'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:29.270508 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1d77423a-e942-4861-b1e0-41bc95d3e909 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97fe2574ee70458d97078d5615054eb4', 'request_id': 'req-1d77423a-e942-4861-b1e0-41bc95d3e909'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:29.271539 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:29.278677 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1d77423a-e942-4861-b1e0-41bc95d3e909 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97fe2574ee70458d97078d5615054eb4', 'request_id': 'req-1d77423a-e942-4861-b1e0-41bc95d3e909'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:29.284100 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1326fb9f-5e15-435b-80e3-3793d8f44765 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:29.285560 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1326fb9f-5e15-435b-80e3-3793d8f44765 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:29.297152 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1125/2280] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:07:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:07:29.297999 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326fb9f-5e15-435b-80e3-3793d8f44765 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:29.308698 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1d77423a-e942-4861-b1e0-41bc95d3e909 admin admin] The token cache is being invalidate because project 97fe2574ee70458d97078d5615054eb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:07:29.309037 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1d77423a-e942-4861-b1e0-41bc95d3e909 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:29.309843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1d77423a-e942-4861-b1e0-41bc95d3e909 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:29.316804 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1156/2281] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:07:29 2022] DELETE /identity/v3/projects/97fe2574ee70458d97078d5615054eb4 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:29.321452 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77423a-e942-4861-b1e0-41bc95d3e909 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:29.322558 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326fb9f-5e15-435b-80e3-3793d8f44765 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:29.323666 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1d77423a-e942-4861-b1e0-41bc95d3e909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:29.422593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77423a-e942-4861-b1e0-41bc95d3e909 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:29.425795 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ebe8a-b929-42e9-88ee-580b53f26f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:29.426804 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ebe8a-b929-42e9-88ee-580b53f26f50 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:29.427321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ebe8a-b929-42e9-88ee-580b53f26f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:29.428076 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ebe8a-b929-42e9-88ee-580b53f26f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:29.428563 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ebe8a-b929-42e9-88ee-580b53f26f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:29.431063 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56458e5-6be9-40af-b5a5-d3599d6016b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:29.431570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ebe8a-b929-42e9-88ee-580b53f26f50 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:29.433668 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56458e5-6be9-40af-b5a5-d3599d6016b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:29.434898 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56458e5-6be9-40af-b5a5-d3599d6016b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:29.435373 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56458e5-6be9-40af-b5a5-d3599d6016b5 admin admin] PATH_INFO: `/v3/users/2ba3466450f74adaa7706a3415e9a97d` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:29.437394 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56458e5-6be9-40af-b5a5-d3599d6016b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ba3466450f74adaa7706a3415e9a97d)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:29.440360 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56458e5-6be9-40af-b5a5-d3599d6016b5 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:29.443869 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1126/2282] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:07:29.448133 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ebe8a-b929-42e9-88ee-580b53f26f50 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:29.450505 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-675ebe8a-b929-42e9-88ee-580b53f26f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:29.469065 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ebe8a-b929-42e9-88ee-580b53f26f50 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:29.475817 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27e924-2da1-4b90-a729-35eb3f31ed6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:29.477004 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27e924-2da1-4b90-a729-35eb3f31ed6b admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:29.477296 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27e924-2da1-4b90-a729-35eb3f31ed6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:29.477585 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27e924-2da1-4b90-a729-35eb3f31ed6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:29.478400 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a27e924-2da1-4b90-a729-35eb3f31ed6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:29.480133 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a27e924-2da1-4b90-a729-35eb3f31ed6b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:29.492208 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1127/2283] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 15:07:29.497467 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27e924-2da1-4b90-a729-35eb3f31ed6b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:29.512190 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d56458e5-6be9-40af-b5a5-d3599d6016b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ba3466450f74adaa7706a3415e9a97d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:29.512890 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d56458e5-6be9-40af-b5a5-d3599d6016b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ba3466450f74adaa7706a3415e9a97d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:29.513594 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d56458e5-6be9-40af-b5a5-d3599d6016b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ba3466450f74adaa7706a3415e9a97d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:29.516066 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27e924-2da1-4b90-a729-35eb3f31ed6b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:29.524535 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0228806-6eca-48db-952f-13c3111e39ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:29.524725 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0228806-6eca-48db-952f-13c3111e39ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:29.525201 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0228806-6eca-48db-952f-13c3111e39ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:29.525471 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0228806-6eca-48db-952f-13c3111e39ad admin admin] PATH_INFO: `/v3/projects/95a67bc5817346af8f7f3f8d2cff3625/users/91eeb6af56f64003b2f700350663e968/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:29.526451 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d56458e5-6be9-40af-b5a5-d3599d6016b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ba3466450f74adaa7706a3415e9a97d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:29.529467 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:29.543191 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0228806-6eca-48db-952f-13c3111e39ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a67bc5817346af8f7f3f8d2cff3625, user_id=91eeb6af56f64003b2f700350663e968, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:29.546246 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-d56458e5-6be9-40af-b5a5-d3599d6016b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ba3466450f74adaa7706a3415e9a97d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:29.546481 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0228806-6eca-48db-952f-13c3111e39ad admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:29.563972 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1128/2284] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:07:29 2022] PUT /identity/v3/projects/95a67bc5817346af8f7f3f8d2cff3625/users/91eeb6af56f64003b2f700350663e968/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:29.573575 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1157/2285] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:07:29 2022] DELETE /identity/v3/users/2ba3466450f74adaa7706a3415e9a97d => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:07:29.574957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a9d90-60bc-40e2-b460-a919842bc40f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:29.575289 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a9d90-60bc-40e2-b460-a919842bc40f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:29.575570 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a9d90-60bc-40e2-b460-a919842bc40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:29.609372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e01a9d90-60bc-40e2-b460-a919842bc40f None None] MFA Rules not processed for user `91eeb6af56f64003b2f700350663e968`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:29.610659 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e01a9d90-60bc-40e2-b460-a919842bc40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:29.694726 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:29.740579 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1158/2286] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:07:29.770681 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0228806-6eca-48db-952f-13c3111e39ad admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:29.774879 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a0228806-6eca-48db-952f-13c3111e39ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:29.859366 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0228806-6eca-48db-952f-13c3111e39ad admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:29.924829 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbdfd9-2b97-40e8-85f5-8532de978b5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:29.925695 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbdfd9-2b97-40e8-85f5-8532de978b5d service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:29.926139 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbdfd9-2b97-40e8-85f5-8532de978b5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:29.926434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbdfd9-2b97-40e8-85f5-8532de978b5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:29.937543 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbdfd9-2b97-40e8-85f5-8532de978b5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:29.939187 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbdfd9-2b97-40e8-85f5-8532de978b5d service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:29.950509 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1129/2287] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:07:29 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:07:30.002867 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a9d90-60bc-40e2-b460-a919842bc40f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:30.004440 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e01a9d90-60bc-40e2-b460-a919842bc40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:30.096825 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a9d90-60bc-40e2-b460-a919842bc40f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:30.102410 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e1165-879d-41ee-b627-e49f165d6a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:30.103531 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e1165-879d-41ee-b627-e49f165d6a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:30.103883 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e1165-879d-41ee-b627-e49f165d6a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:30.104246 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e1165-879d-41ee-b627-e49f165d6a33 admin admin] PATH_INFO: `/v3/projects/79cc4040f9f446e5b4fb7d2ceb187146` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:30.105625 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e1165-879d-41ee-b627-e49f165d6a33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79cc4040f9f446e5b4fb7d2ceb187146)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:30.107649 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e1165-879d-41ee-b627-e49f165d6a33 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:30.169354 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8f1e1165-879d-41ee-b627-e49f165d6a33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79cc4040f9f446e5b4fb7d2ceb187146', 'request_id': 'req-8f1e1165-879d-41ee-b627-e49f165d6a33'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:30.176314 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8f1e1165-879d-41ee-b627-e49f165d6a33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79cc4040f9f446e5b4fb7d2ceb187146', 'request_id': 'req-8f1e1165-879d-41ee-b627-e49f165d6a33'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:30.184487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8f1e1165-879d-41ee-b627-e49f165d6a33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79cc4040f9f446e5b4fb7d2ceb187146', 'request_id': 'req-8f1e1165-879d-41ee-b627-e49f165d6a33'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:30.207282 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8f1e1165-879d-41ee-b627-e49f165d6a33 admin admin] The token cache is being invalidate because project 79cc4040f9f446e5b4fb7d2ceb187146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:07:30.207647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8f1e1165-879d-41ee-b627-e49f165d6a33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:30.208381 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-8f1e1165-879d-41ee-b627-e49f165d6a33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:30.210030 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1159/2288] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:07:30 2022] DELETE /identity/v3/projects/79cc4040f9f446e5b4fb7d2ceb187146 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:31.240454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbdfd9-2b97-40e8-85f5-8532de978b5d service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:31.241924 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-09fbdfd9-2b97-40e8-85f5-8532de978b5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:31.261844 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbdfd9-2b97-40e8-85f5-8532de978b5d service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:31.319733 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f0c91-29f8-4f96-92cc-4dcccac1dc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:31.320662 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f0c91-29f8-4f96-92cc-4dcccac1dc2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:31.320977 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f0c91-29f8-4f96-92cc-4dcccac1dc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:31.321293 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f0c91-29f8-4f96-92cc-4dcccac1dc2d admin admin] PATH_INFO: `/v3/users/7553e981c59d4aff91526c41f557c804` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:31.323076 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f0c91-29f8-4f96-92cc-4dcccac1dc2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7553e981c59d4aff91526c41f557c804)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:31.325458 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f0c91-29f8-4f96-92cc-4dcccac1dc2d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:31.378011 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:31.378725 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1e5f0c91-29f8-4f96-92cc-4dcccac1dc2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7553e981c59d4aff91526c41f557c804'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:31.390643 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1e5f0c91-29f8-4f96-92cc-4dcccac1dc2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7553e981c59d4aff91526c41f557c804'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:31.406852 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1e5f0c91-29f8-4f96-92cc-4dcccac1dc2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7553e981c59d4aff91526c41f557c804'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:31.409979 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1e5f0c91-29f8-4f96-92cc-4dcccac1dc2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7553e981c59d4aff91526c41f557c804'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:31.410506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1e5f0c91-29f8-4f96-92cc-4dcccac1dc2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7553e981c59d4aff91526c41f557c804'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:31.427679 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1130/2289] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:07:31 2022] DELETE /identity/v3/users/7553e981c59d4aff91526c41f557c804 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:31.432752 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07859380-f961-4bb3-9032-09531c868a87 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:31.433249 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07859380-f961-4bb3-9032-09531c868a87 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:31.433574 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07859380-f961-4bb3-9032-09531c868a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:31.453053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-07859380-f961-4bb3-9032-09531c868a87 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:31.454257 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-07859380-f961-4bb3-9032-09531c868a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:31.512832 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1160/2290] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:31.522679 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f0c91-29f8-4f96-92cc-4dcccac1dc2d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:31.523927 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1e5f0c91-29f8-4f96-92cc-4dcccac1dc2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:31.583571 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f0c91-29f8-4f96-92cc-4dcccac1dc2d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:31.588356 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f8ca5-af67-4150-bba0-4ea1515a6891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:31.589048 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f8ca5-af67-4150-bba0-4ea1515a6891 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:31.589342 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f8ca5-af67-4150-bba0-4ea1515a6891 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:31.589627 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f8ca5-af67-4150-bba0-4ea1515a6891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:31.599633 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f8ca5-af67-4150-bba0-4ea1515a6891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:31.601613 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f8ca5-af67-4150-bba0-4ea1515a6891 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:31.611247 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1131/2291] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:07:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:07:31.901041 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07859380-f961-4bb3-9032-09531c868a87 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:31.902520 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-07859380-f961-4bb3-9032-09531c868a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:31.915481 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07859380-f961-4bb3-9032-09531c868a87 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:31.920472 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4611f5-ee26-40f6-930f-e2a2832a216c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:31.921345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4611f5-ee26-40f6-930f-e2a2832a216c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:31.921622 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4611f5-ee26-40f6-930f-e2a2832a216c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:31.921893 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4611f5-ee26-40f6-930f-e2a2832a216c admin admin] PATH_INFO: `/v3/projects/2e062c65073344019b40ed7da5bddb0a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:31.923106 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4611f5-ee26-40f6-930f-e2a2832a216c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e062c65073344019b40ed7da5bddb0a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:31.925064 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4611f5-ee26-40f6-930f-e2a2832a216c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:31.949643 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:31.974904 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-fc4611f5-ee26-40f6-930f-e2a2832a216c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e062c65073344019b40ed7da5bddb0a', 'request_id': 'req-fc4611f5-ee26-40f6-930f-e2a2832a216c'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:31.981093 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-fc4611f5-ee26-40f6-930f-e2a2832a216c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e062c65073344019b40ed7da5bddb0a', 'request_id': 'req-fc4611f5-ee26-40f6-930f-e2a2832a216c'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:31.987116 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-fc4611f5-ee26-40f6-930f-e2a2832a216c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e062c65073344019b40ed7da5bddb0a', 'request_id': 'req-fc4611f5-ee26-40f6-930f-e2a2832a216c'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:31.999686 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-fc4611f5-ee26-40f6-930f-e2a2832a216c admin admin] The token cache is being invalidate because project 2e062c65073344019b40ed7da5bddb0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:07:31.999972 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-fc4611f5-ee26-40f6-930f-e2a2832a216c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:32.000588 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-fc4611f5-ee26-40f6-930f-e2a2832a216c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:32.002136 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1161/2292] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:07:31 2022] DELETE /identity/v3/projects/2e062c65073344019b40ed7da5bddb0a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:32.007156 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be83fd-ebdb-422f-9c6f-51b17d223d86 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:32.007487 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be83fd-ebdb-422f-9c6f-51b17d223d86 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:32.007775 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be83fd-ebdb-422f-9c6f-51b17d223d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:32.025429 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b5be83fd-ebdb-422f-9c6f-51b17d223d86 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:32.026647 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b5be83fd-ebdb-422f-9c6f-51b17d223d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:32.085131 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1132/2293] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:32.093976 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07bbdd-40c0-480f-b5c0-a66c07fe83f9 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:32.094302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07bbdd-40c0-480f-b5c0-a66c07fe83f9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:32.094586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07bbdd-40c0-480f-b5c0-a66c07fe83f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:32.114270 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-fd07bbdd-40c0-480f-b5c0-a66c07fe83f9 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:32.115505 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-fd07bbdd-40c0-480f-b5c0-a66c07fe83f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:32.123653 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1162/2294] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:32.128089 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be83fd-ebdb-422f-9c6f-51b17d223d86 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:32.137681 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be83fd-ebdb-422f-9c6f-51b17d223d86 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:32.147983 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ea9d3-263c-4151-afdb-0c74509347d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:32.148654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ea9d3-263c-4151-afdb-0c74509347d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:32.148971 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ea9d3-263c-4151-afdb-0c74509347d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:32.149252 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ea9d3-263c-4151-afdb-0c74509347d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:32.149996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ea9d3-263c-4151-afdb-0c74509347d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:07:32.150308 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ea9d3-263c-4151-afdb-0c74509347d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:32.151976 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ea9d3-263c-4151-afdb-0c74509347d1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:32.164539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1133/2295] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:07:32.169075 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07bbdd-40c0-480f-b5c0-a66c07fe83f9 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:32.178348 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07bbdd-40c0-480f-b5c0-a66c07fe83f9 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:32.183053 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e33f7e-decd-45f1-a6ca-1abebb38f6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:32.183731 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e33f7e-decd-45f1-a6ca-1abebb38f6ea admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:32.184017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e33f7e-decd-45f1-a6ca-1abebb38f6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:32.184295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e33f7e-decd-45f1-a6ca-1abebb38f6ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:32.184987 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e33f7e-decd-45f1-a6ca-1abebb38f6ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:32.186884 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e33f7e-decd-45f1-a6ca-1abebb38f6ea admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:32.212049 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1163/2296] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:07:32 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:07:32.216174 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ea9d3-263c-4151-afdb-0c74509347d1 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:32.226550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ea9d3-263c-4151-afdb-0c74509347d1 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:32.275108 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:32.289052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0b9ff-a47a-4cfa-8069-84b16a72debd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:32.289751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0b9ff-a47a-4cfa-8069-84b16a72debd admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:32.290516 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0b9ff-a47a-4cfa-8069-84b16a72debd admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:32.290802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0b9ff-a47a-4cfa-8069-84b16a72debd admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:32.291583 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0b9ff-a47a-4cfa-8069-84b16a72debd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:32.294466 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0b9ff-a47a-4cfa-8069-84b16a72debd admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:32.325006 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1134/2297] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:07:32 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:07:32.328365 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e33f7e-decd-45f1-a6ca-1abebb38f6ea admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:32.343098 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e33f7e-decd-45f1-a6ca-1abebb38f6ea admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:32.349315 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdd8ca-72c2-4b50-86fe-c3c8eda10178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:32.350332 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdd8ca-72c2-4b50-86fe-c3c8eda10178 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:32.350770 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdd8ca-72c2-4b50-86fe-c3c8eda10178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:32.351055 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdd8ca-72c2-4b50-86fe-c3c8eda10178 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:32.352084 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebdd8ca-72c2-4b50-86fe-c3c8eda10178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:32.353924 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebdd8ca-72c2-4b50-86fe-c3c8eda10178 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:32.366219 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1164/2298] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:07:32.371466 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0b9ff-a47a-4cfa-8069-84b16a72debd admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:32.379129 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdd8ca-72c2-4b50-86fe-c3c8eda10178 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:32.380893 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2ebdd8ca-72c2-4b50-86fe-c3c8eda10178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:32.384084 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0b9ff-a47a-4cfa-8069-84b16a72debd admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:32.389253 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23307360-67f5-4000-a8c5-6d32d775fbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:32.390048 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23307360-67f5-4000-a8c5-6d32d775fbfa admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:32.390422 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23307360-67f5-4000-a8c5-6d32d775fbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:32.390762 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23307360-67f5-4000-a8c5-6d32d775fbfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:32.391648 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23307360-67f5-4000-a8c5-6d32d775fbfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:32.393389 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23307360-67f5-4000-a8c5-6d32d775fbfa admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:32.397961 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdd8ca-72c2-4b50-86fe-c3c8eda10178 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:32.403996 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d731c0a-61f7-4fc4-9dd4-b016a70f9659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:32.405865 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1135/2299] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:07:32.407425 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d731c0a-61f7-4fc4-9dd4-b016a70f9659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:32.407736 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d731c0a-61f7-4fc4-9dd4-b016a70f9659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:32.408022 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d731c0a-61f7-4fc4-9dd4-b016a70f9659 admin admin] PATH_INFO: `/v3/users/b3dd7d4e0477424296a4fb3f53c048be` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:32.409711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d731c0a-61f7-4fc4-9dd4-b016a70f9659 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3dd7d4e0477424296a4fb3f53c048be)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:32.410085 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23307360-67f5-4000-a8c5-6d32d775fbfa admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:32.411708 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d731c0a-61f7-4fc4-9dd4-b016a70f9659 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:32.423436 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23307360-67f5-4000-a8c5-6d32d775fbfa admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:32.431646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfde1e1-efa5-40d6-9873-20bccba3b9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:32.432559 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfde1e1-efa5-40d6-9873-20bccba3b9a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:32.432965 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfde1e1-efa5-40d6-9873-20bccba3b9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:32.433259 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfde1e1-efa5-40d6-9873-20bccba3b9a8 admin admin] PATH_INFO: `/v3/projects/a73643c10b6b43f5b5c63b2d9e10731c/users/388454b40b234c08ab6b69a29e435b39/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:32.453255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfde1e1-efa5-40d6-9873-20bccba3b9a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a73643c10b6b43f5b5c63b2d9e10731c, user_id=388454b40b234c08ab6b69a29e435b39, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:32.456039 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfde1e1-efa5-40d6-9873-20bccba3b9a8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:32.468184 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1d731c0a-61f7-4fc4-9dd4-b016a70f9659 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3dd7d4e0477424296a4fb3f53c048be'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:32.468842 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1d731c0a-61f7-4fc4-9dd4-b016a70f9659 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3dd7d4e0477424296a4fb3f53c048be'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:32.470134 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1d731c0a-61f7-4fc4-9dd4-b016a70f9659 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3dd7d4e0477424296a4fb3f53c048be'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:32.473292 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1136/2300] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:07:32 2022] PUT /identity/v3/projects/a73643c10b6b43f5b5c63b2d9e10731c/users/388454b40b234c08ab6b69a29e435b39/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:07:32.479598 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1d731c0a-61f7-4fc4-9dd4-b016a70f9659 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3dd7d4e0477424296a4fb3f53c048be'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:32.483383 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2848d3-7e90-45c0-b013-6d0f5e2f11d1 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:32.483677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2848d3-7e90-45c0-b013-6d0f5e2f11d1 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:32.483964 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2848d3-7e90-45c0-b013-6d0f5e2f11d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:32.494699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1d731c0a-61f7-4fc4-9dd4-b016a70f9659 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3dd7d4e0477424296a4fb3f53c048be'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:32.512866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1165/2301] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:07:32 2022] DELETE /identity/v3/users/b3dd7d4e0477424296a4fb3f53c048be => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:32.514584 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2c2848d3-7e90-45c0-b013-6d0f5e2f11d1 None None] MFA Rules not processed for user `388454b40b234c08ab6b69a29e435b39`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:32.517102 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f18ed-c02a-475d-8b07-e7ef35f55172 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:32.517398 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f18ed-c02a-475d-8b07-e7ef35f55172 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:32.517729 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f18ed-c02a-475d-8b07-e7ef35f55172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:32.519103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2c2848d3-7e90-45c0-b013-6d0f5e2f11d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:32.537111 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a60f18ed-c02a-475d-8b07-e7ef35f55172 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:32.538489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a60f18ed-c02a-475d-8b07-e7ef35f55172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:32.581878 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:DELETE=17,keystone:SELECT=80,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:32.600569 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1137/2302] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:32.608121 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1166/2303] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:32.616905 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2848d3-7e90-45c0-b013-6d0f5e2f11d1 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:32.618043 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f18ed-c02a-475d-8b07-e7ef35f55172 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:32.618188 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2c2848d3-7e90-45c0-b013-6d0f5e2f11d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:32.619526 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a60f18ed-c02a-475d-8b07-e7ef35f55172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:32.676779 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2848d3-7e90-45c0-b013-6d0f5e2f11d1 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:32.682592 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6346e6-9f39-42c2-8ec9-96d38784027a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1dc1d74631b4d69a3094e4e1e2a0ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:32.683226 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6346e6-9f39-42c2-8ec9-96d38784027a service glance] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:32.683527 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6346e6-9f39-42c2-8ec9-96d38784027a service glance] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:32.683832 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6346e6-9f39-42c2-8ec9-96d38784027a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:32.686927 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f18ed-c02a-475d-8b07-e7ef35f55172 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:32.691099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247e8f8-a546-4fd9-a868-338a537c3b79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:32.691872 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247e8f8-a546-4fd9-a868-338a537c3b79 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:32.692238 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247e8f8-a546-4fd9-a868-338a537c3b79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:32.692569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247e8f8-a546-4fd9-a868-338a537c3b79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:32.693019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6346e6-9f39-42c2-8ec9-96d38784027a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:32.695181 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6346e6-9f39-42c2-8ec9-96d38784027a service glance] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:32.703103 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247e8f8-a546-4fd9-a868-338a537c3b79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:32.704641 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247e8f8-a546-4fd9-a868-338a537c3b79 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:32.710806 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1138/2304] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:07:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:07:32.714914 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1167/2305] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:07:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:07:33.001151 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6346e6-9f39-42c2-8ec9-96d38784027a service glance] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:33.002768 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9b6346e6-9f39-42c2-8ec9-96d38784027a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:33.020116 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6346e6-9f39-42c2-8ec9-96d38784027a service glance] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:33.024827 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60a728-bbae-449b-96c2-561947208785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:33.025693 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60a728-bbae-449b-96c2-561947208785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:33.025988 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60a728-bbae-449b-96c2-561947208785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:33.026269 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60a728-bbae-449b-96c2-561947208785 admin admin] PATH_INFO: `/v3/projects/0089bf367acd48868afea67bfd19a5f7` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:33.027495 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60a728-bbae-449b-96c2-561947208785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0089bf367acd48868afea67bfd19a5f7)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:33.029524 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60a728-bbae-449b-96c2-561947208785 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:33.072911 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:33.085758 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-eb60a728-bbae-449b-96c2-561947208785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0089bf367acd48868afea67bfd19a5f7', 'request_id': 'req-eb60a728-bbae-449b-96c2-561947208785'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:33.096714 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-eb60a728-bbae-449b-96c2-561947208785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0089bf367acd48868afea67bfd19a5f7', 'request_id': 'req-eb60a728-bbae-449b-96c2-561947208785'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:33.106092 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-eb60a728-bbae-449b-96c2-561947208785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0089bf367acd48868afea67bfd19a5f7', 'request_id': 'req-eb60a728-bbae-449b-96c2-561947208785'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:33.118340 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-eb60a728-bbae-449b-96c2-561947208785 admin admin] The token cache is being invalidate because project 0089bf367acd48868afea67bfd19a5f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:07:33.118796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-eb60a728-bbae-449b-96c2-561947208785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:33.119492 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-eb60a728-bbae-449b-96c2-561947208785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:33.121306 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1139/2306] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:07:32 2022] DELETE /identity/v3/projects/0089bf367acd48868afea67bfd19a5f7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:33.125330 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247e8f8-a546-4fd9-a868-338a537c3b79 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:33.135703 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247e8f8-a546-4fd9-a868-338a537c3b79 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:33.201277 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35fac9-9e6c-4efa-822f-7b3cac6be21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:33.202220 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35fac9-9e6c-4efa-822f-7b3cac6be21f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:33.202576 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35fac9-9e6c-4efa-822f-7b3cac6be21f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:33.202928 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35fac9-9e6c-4efa-822f-7b3cac6be21f admin admin] PATH_INFO: `/v3/users/6746896cfda545599df7640800b244f5` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:33.204253 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35fac9-9e6c-4efa-822f-7b3cac6be21f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6746896cfda545599df7640800b244f5)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:33.206310 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35fac9-9e6c-4efa-822f-7b3cac6be21f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:33.262227 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5c35fac9-9e6c-4efa-822f-7b3cac6be21f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6746896cfda545599df7640800b244f5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:33.262937 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5c35fac9-9e6c-4efa-822f-7b3cac6be21f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6746896cfda545599df7640800b244f5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:33.264004 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5c35fac9-9e6c-4efa-822f-7b3cac6be21f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6746896cfda545599df7640800b244f5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:33.276881 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5c35fac9-9e6c-4efa-822f-7b3cac6be21f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6746896cfda545599df7640800b244f5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:33.291684 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5c35fac9-9e6c-4efa-822f-7b3cac6be21f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6746896cfda545599df7640800b244f5'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:33.305158 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1168/2307] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:07:33 2022] DELETE /identity/v3/users/6746896cfda545599df7640800b244f5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:07:33.612723 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60a728-bbae-449b-96c2-561947208785 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:33.615920 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-eb60a728-bbae-449b-96c2-561947208785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:33.631367 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60a728-bbae-449b-96c2-561947208785 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:33.703386 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beef72e-6407-42f7-b85d-4a318374a891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:33.704255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beef72e-6407-42f7-b85d-4a318374a891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:33.704548 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beef72e-6407-42f7-b85d-4a318374a891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:33.704831 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beef72e-6407-42f7-b85d-4a318374a891 admin admin] PATH_INFO: `/v3/projects/fb2930d1b0b74e07aec8185190a78e42` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:33.706005 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beef72e-6407-42f7-b85d-4a318374a891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb2930d1b0b74e07aec8185190a78e42)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:33.707999 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beef72e-6407-42f7-b85d-4a318374a891 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:33.753860 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4beef72e-6407-42f7-b85d-4a318374a891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb2930d1b0b74e07aec8185190a78e42', 'request_id': 'req-4beef72e-6407-42f7-b85d-4a318374a891'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:33.760419 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4beef72e-6407-42f7-b85d-4a318374a891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb2930d1b0b74e07aec8185190a78e42', 'request_id': 'req-4beef72e-6407-42f7-b85d-4a318374a891'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:33.767514 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4beef72e-6407-42f7-b85d-4a318374a891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb2930d1b0b74e07aec8185190a78e42', 'request_id': 'req-4beef72e-6407-42f7-b85d-4a318374a891'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:33.779313 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4beef72e-6407-42f7-b85d-4a318374a891 admin admin] The token cache is being invalidate because project fb2930d1b0b74e07aec8185190a78e42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:07:33.779609 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4beef72e-6407-42f7-b85d-4a318374a891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:33.780267 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4beef72e-6407-42f7-b85d-4a318374a891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:33.781806 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1140/2308] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:07:33 2022] DELETE /identity/v3/projects/fb2930d1b0b74e07aec8185190a78e42 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:33.785685 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35fac9-9e6c-4efa-822f-7b3cac6be21f admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:33.787168 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5c35fac9-9e6c-4efa-822f-7b3cac6be21f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:33.797351 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:33.801324 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35fac9-9e6c-4efa-822f-7b3cac6be21f admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:33.861242 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50817f40-8317-4265-8094-05cbb525351b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:33.862237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50817f40-8317-4265-8094-05cbb525351b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:33.862602 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50817f40-8317-4265-8094-05cbb525351b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:33.862886 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50817f40-8317-4265-8094-05cbb525351b admin admin] PATH_INFO: `/v3/users/fbc4dc0698df4f12bb26e0e475369c26` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:33.864501 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50817f40-8317-4265-8094-05cbb525351b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbc4dc0698df4f12bb26e0e475369c26)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:33.866438 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50817f40-8317-4265-8094-05cbb525351b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:33.915890 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-50817f40-8317-4265-8094-05cbb525351b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbc4dc0698df4f12bb26e0e475369c26'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:33.916618 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-50817f40-8317-4265-8094-05cbb525351b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbc4dc0698df4f12bb26e0e475369c26'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:33.917234 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-50817f40-8317-4265-8094-05cbb525351b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbc4dc0698df4f12bb26e0e475369c26'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:33.926130 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-50817f40-8317-4265-8094-05cbb525351b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbc4dc0698df4f12bb26e0e475369c26'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:33.941707 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-50817f40-8317-4265-8094-05cbb525351b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbc4dc0698df4f12bb26e0e475369c26'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:33.954198 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1169/2309] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:07:33 2022] DELETE /identity/v3/users/fbc4dc0698df4f12bb26e0e475369c26 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:34.220854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beef72e-6407-42f7-b85d-4a318374a891 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:34.222280 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4beef72e-6407-42f7-b85d-4a318374a891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:34.235048 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beef72e-6407-42f7-b85d-4a318374a891 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:34.292138 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:34.302802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa007fb7-bf87-42ba-9f80-def18c49bb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:34.304157 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa007fb7-bf87-42ba-9f80-def18c49bb47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:34.304439 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa007fb7-bf87-42ba-9f80-def18c49bb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:34.304717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa007fb7-bf87-42ba-9f80-def18c49bb47 admin admin] PATH_INFO: `/v3/projects/61bf044212cb427fb5fe0b8773d0159d` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:34.305882 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa007fb7-bf87-42ba-9f80-def18c49bb47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61bf044212cb427fb5fe0b8773d0159d)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:34.307838 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa007fb7-bf87-42ba-9f80-def18c49bb47 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:34.352838 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aa007fb7-bf87-42ba-9f80-def18c49bb47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61bf044212cb427fb5fe0b8773d0159d', 'request_id': 'req-aa007fb7-bf87-42ba-9f80-def18c49bb47'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:34.359459 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aa007fb7-bf87-42ba-9f80-def18c49bb47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61bf044212cb427fb5fe0b8773d0159d', 'request_id': 'req-aa007fb7-bf87-42ba-9f80-def18c49bb47'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:34.365602 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aa007fb7-bf87-42ba-9f80-def18c49bb47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61bf044212cb427fb5fe0b8773d0159d', 'request_id': 'req-aa007fb7-bf87-42ba-9f80-def18c49bb47'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:34.377044 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aa007fb7-bf87-42ba-9f80-def18c49bb47 admin admin] The token cache is being invalidate because project 61bf044212cb427fb5fe0b8773d0159d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:07:34.377332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aa007fb7-bf87-42ba-9f80-def18c49bb47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:34.377968 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aa007fb7-bf87-42ba-9f80-def18c49bb47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:34.380108 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1141/2310] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:07:34 2022] DELETE /identity/v3/projects/61bf044212cb427fb5fe0b8773d0159d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:34.387527 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1549c14-b295-40ca-8d52-863cb61353ad None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:34.387818 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1549c14-b295-40ca-8d52-863cb61353ad None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:34.388098 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1549c14-b295-40ca-8d52-863cb61353ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:34.406321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-c1549c14-b295-40ca-8d52-863cb61353ad None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:34.407569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c1549c14-b295-40ca-8d52-863cb61353ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:34.466275 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1170/2311] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:34.474525 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f607b-ed8e-4328-9450-3ffecfa004a7 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:34.474843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f607b-ed8e-4328-9450-3ffecfa004a7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:34.475096 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f607b-ed8e-4328-9450-3ffecfa004a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:34.494933 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a55f607b-ed8e-4328-9450-3ffecfa004a7 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:34.496468 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a55f607b-ed8e-4328-9450-3ffecfa004a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:34.507862 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1142/2312] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:34.512246 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1549c14-b295-40ca-8d52-863cb61353ad None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:34.521959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1549c14-b295-40ca-8d52-863cb61353ad None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:34.534615 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105a009-050c-4681-8d69-322c3f3e52db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:34.535911 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105a009-050c-4681-8d69-322c3f3e52db admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:34.535911 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105a009-050c-4681-8d69-322c3f3e52db admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:34.536108 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105a009-050c-4681-8d69-322c3f3e52db admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:34.536885 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105a009-050c-4681-8d69-322c3f3e52db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:07:34.537203 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105a009-050c-4681-8d69-322c3f3e52db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:34.539646 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105a009-050c-4681-8d69-322c3f3e52db admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:34.553987 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1171/2313] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:07:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:07:34.558237 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f607b-ed8e-4328-9450-3ffecfa004a7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:34.567987 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f607b-ed8e-4328-9450-3ffecfa004a7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:34.573252 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783a2db-4cc6-4d99-abc1-c4dfc253d351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:34.573914 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783a2db-4cc6-4d99-abc1-c4dfc253d351 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:34.574200 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783a2db-4cc6-4d99-abc1-c4dfc253d351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:34.574478 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783a2db-4cc6-4d99-abc1-c4dfc253d351 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:34.575264 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783a2db-4cc6-4d99-abc1-c4dfc253d351 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:34.580149 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783a2db-4cc6-4d99-abc1-c4dfc253d351 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:34.621567 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1143/2314] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:07:34 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:07:34.625436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105a009-050c-4681-8d69-322c3f3e52db admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:34.637467 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105a009-050c-4681-8d69-322c3f3e52db admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:34.646030 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:34.702640 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24b65d-5de7-459e-bd5f-f6dac8e00c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:34.703329 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24b65d-5de7-459e-bd5f-f6dac8e00c7a admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:34.703612 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24b65d-5de7-459e-bd5f-f6dac8e00c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:34.703888 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24b65d-5de7-459e-bd5f-f6dac8e00c7a admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:34.704580 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24b65d-5de7-459e-bd5f-f6dac8e00c7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:34.706469 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24b65d-5de7-459e-bd5f-f6dac8e00c7a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:34.734447 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1172/2315] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:07:34 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:07:34.735694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783a2db-4cc6-4d99-abc1-c4dfc253d351 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:34.748744 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783a2db-4cc6-4d99-abc1-c4dfc253d351 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:34.754788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65255dc7-dff0-49da-8724-0040feefcf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:34.755594 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65255dc7-dff0-49da-8724-0040feefcf2b admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:34.755887 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65255dc7-dff0-49da-8724-0040feefcf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:34.756175 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65255dc7-dff0-49da-8724-0040feefcf2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:34.756965 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65255dc7-dff0-49da-8724-0040feefcf2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:34.758647 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65255dc7-dff0-49da-8724-0040feefcf2b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:34.773670 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1144/2316] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:07:34.775572 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24b65d-5de7-459e-bd5f-f6dac8e00c7a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:34.792691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24b65d-5de7-459e-bd5f-f6dac8e00c7a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:34.801867 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85e034-8af9-4d76-8f78-4968c7786ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:34.802555 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85e034-8af9-4d76-8f78-4968c7786ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:34.802843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85e034-8af9-4d76-8f78-4968c7786ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:34.805639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85e034-8af9-4d76-8f78-4968c7786ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:34.806357 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b85e034-8af9-4d76-8f78-4968c7786ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:34.808141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b85e034-8af9-4d76-8f78-4968c7786ae8 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:34.821789 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1173/2317] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:07:34.823173 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65255dc7-dff0-49da-8724-0040feefcf2b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:34.834450 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65255dc7-dff0-49da-8724-0040feefcf2b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:34.839530 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2c03f-1976-4343-bba7-bdf3412be19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:34.840515 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2c03f-1976-4343-bba7-bdf3412be19a admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:34.840979 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2c03f-1976-4343-bba7-bdf3412be19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:34.841319 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2c03f-1976-4343-bba7-bdf3412be19a admin admin] PATH_INFO: `/v3/projects/8f7a1fc211304ed3a001282402fa73cc/users/f7d796b832c442c0a2af8ef603879f30/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:34.862471 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2c03f-1976-4343-bba7-bdf3412be19a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f7a1fc211304ed3a001282402fa73cc, user_id=f7d796b832c442c0a2af8ef603879f30, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:34.864840 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d2c03f-1976-4343-bba7-bdf3412be19a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:34.881113 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1145/2318] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:07:34 2022] PUT /identity/v3/projects/8f7a1fc211304ed3a001282402fa73cc/users/f7d796b832c442c0a2af8ef603879f30/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:34.886310 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354b5ed-1a68-468c-9c38-663fc19fa68c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:34.886679 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354b5ed-1a68-468c-9c38-663fc19fa68c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:34.886977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354b5ed-1a68-468c-9c38-663fc19fa68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:34.907761 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f354b5ed-1a68-468c-9c38-663fc19fa68c None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:34.908983 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f354b5ed-1a68-468c-9c38-663fc19fa68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:34.998367 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1174/2319] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:35.005672 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2c03f-1976-4343-bba7-bdf3412be19a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:35.007519 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-65d2c03f-1976-4343-bba7-bdf3412be19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:35.075787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2c03f-1976-4343-bba7-bdf3412be19a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:35.079909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2b6b6-3241-404f-a661-e92837cbf92a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:35.080828 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2b6b6-3241-404f-a661-e92837cbf92a service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:35.080968 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2b6b6-3241-404f-a661-e92837cbf92a service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:35.081157 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2b6b6-3241-404f-a661-e92837cbf92a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:35.093672 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2b6b6-3241-404f-a661-e92837cbf92a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:35.095142 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2b6b6-3241-404f-a661-e92837cbf92a service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:35.112238 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1146/2320] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:07:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:07:35.831142 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce443449-2ae5-48de-9f59-c9b2637f53e8 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:35.831665 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce443449-2ae5-48de-9f59-c9b2637f53e8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:35.831960 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce443449-2ae5-48de-9f59-c9b2637f53e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:35.871714 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ce443449-2ae5-48de-9f59-c9b2637f53e8 None None] MFA Rules not processed for user `f7d796b832c442c0a2af8ef603879f30`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:35.873102 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ce443449-2ae5-48de-9f59-c9b2637f53e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:35.941968 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1175/2321] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:35.954389 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2b6b6-3241-404f-a661-e92837cbf92a service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:35.955859 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e9c2b6b6-3241-404f-a661-e92837cbf92a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:35.981877 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:36.022916 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2b6b6-3241-404f-a661-e92837cbf92a service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:36.026741 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef45dc-a8d7-4007-92fd-e9ade16a9670 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:36.027425 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef45dc-a8d7-4007-92fd-e9ade16a9670 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:36.027715 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef45dc-a8d7-4007-92fd-e9ade16a9670 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:36.027996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef45dc-a8d7-4007-92fd-e9ade16a9670 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:36.036848 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef45dc-a8d7-4007-92fd-e9ade16a9670 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:36.038860 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef45dc-a8d7-4007-92fd-e9ade16a9670 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:36.048038 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1147/2322] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:07:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:07:37.151265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce443449-2ae5-48de-9f59-c9b2637f53e8 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:37.152697 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ce443449-2ae5-48de-9f59-c9b2637f53e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:37.166567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce443449-2ae5-48de-9f59-c9b2637f53e8 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:37.171067 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf43cbd-06cd-408d-b969-47d7ce72cf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:37.171965 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf43cbd-06cd-408d-b969-47d7ce72cf39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:37.172252 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf43cbd-06cd-408d-b969-47d7ce72cf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:37.172530 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf43cbd-06cd-408d-b969-47d7ce72cf39 admin admin] PATH_INFO: `/v3/users/91eeb6af56f64003b2f700350663e968` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:37.173779 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf43cbd-06cd-408d-b969-47d7ce72cf39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91eeb6af56f64003b2f700350663e968)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:37.175770 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf43cbd-06cd-408d-b969-47d7ce72cf39 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:37.189736 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:37.223685 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-cbf43cbd-06cd-408d-b969-47d7ce72cf39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91eeb6af56f64003b2f700350663e968'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:37.224381 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-cbf43cbd-06cd-408d-b969-47d7ce72cf39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91eeb6af56f64003b2f700350663e968'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:37.224987 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-cbf43cbd-06cd-408d-b969-47d7ce72cf39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91eeb6af56f64003b2f700350663e968'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:37.232834 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-cbf43cbd-06cd-408d-b969-47d7ce72cf39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91eeb6af56f64003b2f700350663e968'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:37.244917 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-cbf43cbd-06cd-408d-b969-47d7ce72cf39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91eeb6af56f64003b2f700350663e968'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:37.257573 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1176/2323] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:07:37 2022] DELETE /identity/v3/users/91eeb6af56f64003b2f700350663e968 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:37.262022 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790d170-fd4d-417f-996e-b1e044d7ff07 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:37.262472 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790d170-fd4d-417f-996e-b1e044d7ff07 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:37.262587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790d170-fd4d-417f-996e-b1e044d7ff07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:37.280810 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4790d170-fd4d-417f-996e-b1e044d7ff07 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:37.282027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4790d170-fd4d-417f-996e-b1e044d7ff07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:37.341423 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1148/2324] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:37.351700 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf43cbd-06cd-408d-b969-47d7ce72cf39 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:37.353093 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-cbf43cbd-06cd-408d-b969-47d7ce72cf39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:37.418165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf43cbd-06cd-408d-b969-47d7ce72cf39 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:37.425611 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76564ad0-816e-4081-a04d-ca98809150ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:37.426338 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76564ad0-816e-4081-a04d-ca98809150ae service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:37.426927 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76564ad0-816e-4081-a04d-ca98809150ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:37.427245 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76564ad0-816e-4081-a04d-ca98809150ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:37.439922 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76564ad0-816e-4081-a04d-ca98809150ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:37.441385 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76564ad0-816e-4081-a04d-ca98809150ae service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:37.454497 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1177/2325] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:07:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:07:37.492842 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80dda9a-cb6c-4dce-b8fb-3421f822483e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:37.493144 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80dda9a-cb6c-4dce-b8fb-3421f822483e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:37.493607 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80dda9a-cb6c-4dce-b8fb-3421f822483e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:37.524318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e80dda9a-cb6c-4dce-b8fb-3421f822483e None None] MFA Rules not processed for user `f7d796b832c442c0a2af8ef603879f30`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:37.528644 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e80dda9a-cb6c-4dce-b8fb-3421f822483e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:37.607275 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1149/2326] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:37.843776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76564ad0-816e-4081-a04d-ca98809150ae service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:37.845670 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-76564ad0-816e-4081-a04d-ca98809150ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:37.862490 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76564ad0-816e-4081-a04d-ca98809150ae service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:37.868845 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf9512-9fdb-4115-be8f-51407e14a664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:37.870613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf9512-9fdb-4115-be8f-51407e14a664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:37.870886 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf9512-9fdb-4115-be8f-51407e14a664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:37.871475 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf9512-9fdb-4115-be8f-51407e14a664 admin admin] PATH_INFO: `/v3/projects/95a67bc5817346af8f7f3f8d2cff3625` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:37.872562 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf9512-9fdb-4115-be8f-51407e14a664 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95a67bc5817346af8f7f3f8d2cff3625)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:37.874910 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf9512-9fdb-4115-be8f-51407e14a664 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:37.939567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-baaf9512-9fdb-4115-be8f-51407e14a664 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95a67bc5817346af8f7f3f8d2cff3625', 'request_id': 'req-baaf9512-9fdb-4115-be8f-51407e14a664'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:37.945923 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-baaf9512-9fdb-4115-be8f-51407e14a664 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95a67bc5817346af8f7f3f8d2cff3625', 'request_id': 'req-baaf9512-9fdb-4115-be8f-51407e14a664'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:37.953282 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-baaf9512-9fdb-4115-be8f-51407e14a664 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95a67bc5817346af8f7f3f8d2cff3625', 'request_id': 'req-baaf9512-9fdb-4115-be8f-51407e14a664'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:37.970541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-baaf9512-9fdb-4115-be8f-51407e14a664 admin admin] The token cache is being invalidate because project 95a67bc5817346af8f7f3f8d2cff3625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:07:37.971105 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-baaf9512-9fdb-4115-be8f-51407e14a664 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:37.972102 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-baaf9512-9fdb-4115-be8f-51407e14a664 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:07:37.974325 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1178/2327] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:07:37 2022] DELETE /identity/v3/projects/95a67bc5817346af8f7f3f8d2cff3625 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:37.979311 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e697e-fdab-43aa-8832-f182ea587651 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:37.979616 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e697e-fdab-43aa-8832-f182ea587651 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:37.980032 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e697e-fdab-43aa-8832-f182ea587651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:38.008277 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d51e697e-fdab-43aa-8832-f182ea587651 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:38.009629 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d51e697e-fdab-43aa-8832-f182ea587651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:38.075597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1150/2328] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:38.083690 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e11f71-e182-41ba-a69c-65f7291af8cb None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:38.084045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e11f71-e182-41ba-a69c-65f7291af8cb None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:38.084667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e11f71-e182-41ba-a69c-65f7291af8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:38.105076 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-64e11f71-e182-41ba-a69c-65f7291af8cb None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:38.106615 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-64e11f71-e182-41ba-a69c-65f7291af8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:38.115177 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1179/2329] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:38.120282 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e697e-fdab-43aa-8832-f182ea587651 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:38.133320 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e697e-fdab-43aa-8832-f182ea587651 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:38.138560 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff993f66-fe27-4f67-be6b-78614809f470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:38.139260 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff993f66-fe27-4f67-be6b-78614809f470 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:38.139673 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff993f66-fe27-4f67-be6b-78614809f470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:38.139838 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff993f66-fe27-4f67-be6b-78614809f470 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:38.140584 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff993f66-fe27-4f67-be6b-78614809f470 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:07:38.140903 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff993f66-fe27-4f67-be6b-78614809f470 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:38.142560 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff993f66-fe27-4f67-be6b-78614809f470 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:38.150859 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:38.159398 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1151/2330] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:07:38.163702 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e11f71-e182-41ba-a69c-65f7291af8cb None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:38.177419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e11f71-e182-41ba-a69c-65f7291af8cb None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:38.184470 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6619972-a630-4b61-bd95-ee73738b4ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:38.185640 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6619972-a630-4b61-bd95-ee73738b4ceb admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:38.186119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6619972-a630-4b61-bd95-ee73738b4ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:38.186403 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6619972-a630-4b61-bd95-ee73738b4ceb admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:38.187421 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6619972-a630-4b61-bd95-ee73738b4ceb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:38.190083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6619972-a630-4b61-bd95-ee73738b4ceb admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:38.200546 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:38.225281 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1180/2331] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:07:38 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:07:38.229734 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff993f66-fe27-4f67-be6b-78614809f470 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:38.239920 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff993f66-fe27-4f67-be6b-78614809f470 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:38.313837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b411d-c342-4194-8800-b480f76feb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:38.315148 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b411d-c342-4194-8800-b480f76feb22 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:38.315631 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b411d-c342-4194-8800-b480f76feb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:38.315946 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b411d-c342-4194-8800-b480f76feb22 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:38.316693 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b411d-c342-4194-8800-b480f76feb22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:38.318658 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b411d-c342-4194-8800-b480f76feb22 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:38.343316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1152/2332] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:07:38 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:07:38.346014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6619972-a630-4b61-bd95-ee73738b4ceb admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:38.357051 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6619972-a630-4b61-bd95-ee73738b4ceb admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:38.361774 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7f73c-8041-4469-bd59-cfc45a7c9734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:38.362436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7f73c-8041-4469-bd59-cfc45a7c9734 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:38.362718 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7f73c-8041-4469-bd59-cfc45a7c9734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:38.362992 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7f73c-8041-4469-bd59-cfc45a7c9734 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:38.363754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7f73c-8041-4469-bd59-cfc45a7c9734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:38.365390 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7f73c-8041-4469-bd59-cfc45a7c9734 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:38.376508 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1181/2333] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 15:07:38.380561 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b411d-c342-4194-8800-b480f76feb22 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:38.393457 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b411d-c342-4194-8800-b480f76feb22 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:38.406949 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c74f9-7902-4d98-94d8-a1ad6d82b3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:38.407775 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c74f9-7902-4d98-94d8-a1ad6d82b3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:38.408067 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c74f9-7902-4d98-94d8-a1ad6d82b3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:38.408527 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c74f9-7902-4d98-94d8-a1ad6d82b3d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:38.409464 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c74f9-7902-4d98-94d8-a1ad6d82b3d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:38.411448 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c74f9-7902-4d98-94d8-a1ad6d82b3d0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:38.431411 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1153/2334] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:07:38.435577 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7f73c-8041-4469-bd59-cfc45a7c9734 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:38.447750 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7f73c-8041-4469-bd59-cfc45a7c9734 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:38.452420 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45057977-d4b0-454c-9b5b-7cb456aa50ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:38.453490 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45057977-d4b0-454c-9b5b-7cb456aa50ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:38.453774 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45057977-d4b0-454c-9b5b-7cb456aa50ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:38.454044 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45057977-d4b0-454c-9b5b-7cb456aa50ff admin admin] PATH_INFO: `/v3/projects/2c71bc8f0a164884bc0c046fd1e7faab/users/9877b9bbc14141bba21625fc8f1046d2/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:38.469974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45057977-d4b0-454c-9b5b-7cb456aa50ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c71bc8f0a164884bc0c046fd1e7faab, user_id=9877b9bbc14141bba21625fc8f1046d2, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:38.474074 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45057977-d4b0-454c-9b5b-7cb456aa50ff admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:38.488327 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1182/2335] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:07:38 2022] PUT /identity/v3/projects/2c71bc8f0a164884bc0c046fd1e7faab/users/9877b9bbc14141bba21625fc8f1046d2/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:38.493617 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d494b42-a296-433a-a010-99f9dd9959be None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:38.494046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d494b42-a296-433a-a010-99f9dd9959be None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:38.494453 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d494b42-a296-433a-a010-99f9dd9959be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:38.518096 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4d494b42-a296-433a-a010-99f9dd9959be None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:38.519423 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4d494b42-a296-433a-a010-99f9dd9959be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:38.617507 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1154/2336] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:38.627698 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45057977-d4b0-454c-9b5b-7cb456aa50ff admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:38.629649 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-45057977-d4b0-454c-9b5b-7cb456aa50ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:38.713243 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45057977-d4b0-454c-9b5b-7cb456aa50ff admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:38.716968 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c631d6-7b78-4636-aac5-bcc5bea72369 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:38.717676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c631d6-7b78-4636-aac5-bcc5bea72369 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:38.718078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c631d6-7b78-4636-aac5-bcc5bea72369 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:38.718280 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c631d6-7b78-4636-aac5-bcc5bea72369 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:38.731629 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c631d6-7b78-4636-aac5-bcc5bea72369 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:38.733562 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c631d6-7b78-4636-aac5-bcc5bea72369 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:38.744351 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1183/2337] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:07:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:07:43.183193 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc633d-6dba-435d-851f-9b388e0335eb None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:43.183888 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc633d-6dba-435d-851f-9b388e0335eb None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:43.184191 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc633d-6dba-435d-851f-9b388e0335eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:43.208105 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-37dc633d-6dba-435d-851f-9b388e0335eb None None] MFA Rules not processed for user `e5374c90f38b47fcb611e346f3f2ec69`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:43.211173 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-37dc633d-6dba-435d-851f-9b388e0335eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:43.298284 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1155/2338] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:45.361369 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9daa74-0aa5-4d1b-8fcc-c7ea9bc1aa55 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:45.361906 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9daa74-0aa5-4d1b-8fcc-c7ea9bc1aa55 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:45.361906 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9daa74-0aa5-4d1b-8fcc-c7ea9bc1aa55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:45.397613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ce9daa74-0aa5-4d1b-8fcc-c7ea9bc1aa55 None None] MFA Rules not processed for user `9877b9bbc14141bba21625fc8f1046d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:45.398856 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ce9daa74-0aa5-4d1b-8fcc-c7ea9bc1aa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:45.487317 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1184/2339] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:45.489575 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc633d-6dba-435d-851f-9b388e0335eb None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:45.505083 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc633d-6dba-435d-851f-9b388e0335eb None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:45.510788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677dc3e-8798-421c-adf1-3d83ec864fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:45.511506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677dc3e-8798-421c-adf1-3d83ec864fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:45.511797 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677dc3e-8798-421c-adf1-3d83ec864fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:45.512109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677dc3e-8798-421c-adf1-3d83ec864fa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:45.513019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677dc3e-8798-421c-adf1-3d83ec864fa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:45.514955 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677dc3e-8798-421c-adf1-3d83ec864fa6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:45.541099 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:45.551926 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1156/2340] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:07:45 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:07:45.557487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9daa74-0aa5-4d1b-8fcc-c7ea9bc1aa55 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:45.581076 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9daa74-0aa5-4d1b-8fcc-c7ea9bc1aa55 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:45.658610 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:45.680350 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35d3f0-f381-4af7-896e-e1f14b6dca16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:45.681033 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35d3f0-f381-4af7-896e-e1f14b6dca16 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:45.681370 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35d3f0-f381-4af7-896e-e1f14b6dca16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:45.681643 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35d3f0-f381-4af7-896e-e1f14b6dca16 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:45.682397 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35d3f0-f381-4af7-896e-e1f14b6dca16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:45.684733 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35d3f0-f381-4af7-896e-e1f14b6dca16 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:45.729651 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1185/2341] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:07:45 2022] POST /identity/v3/users => generated 296 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:07:45.733227 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677dc3e-8798-421c-adf1-3d83ec864fa6 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:45.745235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677dc3e-8798-421c-adf1-3d83ec864fa6 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:45.751258 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a99ee6-a813-4639-b51d-6d8d4554762f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:45.752347 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a99ee6-a813-4639-b51d-6d8d4554762f admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:45.752834 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a99ee6-a813-4639-b51d-6d8d4554762f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:45.753319 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a99ee6-a813-4639-b51d-6d8d4554762f admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:45.754252 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a99ee6-a813-4639-b51d-6d8d4554762f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:45.756774 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a99ee6-a813-4639-b51d-6d8d4554762f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:45.775043 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1157/2342] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:07:45.775780 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35d3f0-f381-4af7-896e-e1f14b6dca16 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:45.788262 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35d3f0-f381-4af7-896e-e1f14b6dca16 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:45.795729 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acab306-87c8-4820-90e6-a185df37a85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:45.797044 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acab306-87c8-4820-90e6-a185df37a85e admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:45.797732 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acab306-87c8-4820-90e6-a185df37a85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:45.799081 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acab306-87c8-4820-90e6-a185df37a85e admin admin] PATH_INFO: `/v3/projects/6407de57591f46f290c7c425a5b6c76d/users/91a54df480ce4d60979bf20b62f75867/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:45.850634 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acab306-87c8-4820-90e6-a185df37a85e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6407de57591f46f290c7c425a5b6c76d, user_id=91a54df480ce4d60979bf20b62f75867, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:45.857457 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acab306-87c8-4820-90e6-a185df37a85e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:45.903441 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1186/2343] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:07:45 2022] PUT /identity/v3/projects/6407de57591f46f290c7c425a5b6c76d/users/91a54df480ce4d60979bf20b62f75867/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:07:45.906300 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a99ee6-a813-4639-b51d-6d8d4554762f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:45.919589 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a99ee6-a813-4639-b51d-6d8d4554762f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:46.034100 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac165c74-18e8-4c64-9cc3-0e0e32db85c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:46.034839 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac165c74-18e8-4c64-9cc3-0e0e32db85c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:46.035188 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac165c74-18e8-4c64-9cc3-0e0e32db85c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:46.035509 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac165c74-18e8-4c64-9cc3-0e0e32db85c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:46.036228 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac165c74-18e8-4c64-9cc3-0e0e32db85c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:46.038440 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac165c74-18e8-4c64-9cc3-0e0e32db85c7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:46.051969 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1158/2344] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:07:46.056481 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acab306-87c8-4820-90e6-a185df37a85e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:46.077483 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acab306-87c8-4820-90e6-a185df37a85e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:46.083187 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcdfaf3-1941-4cea-9f86-c87688385979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:46.084249 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdfaf3-1941-4cea-9f86-c87688385979 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:46.084572 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdfaf3-1941-4cea-9f86-c87688385979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:46.088002 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdfaf3-1941-4cea-9f86-c87688385979 admin admin] PATH_INFO: `/v3/projects/6407de57591f46f290c7c425a5b6c76d/users/91a54df480ce4d60979bf20b62f75867/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:46.091763 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcdfaf3-1941-4cea-9f86-c87688385979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6407de57591f46f290c7c425a5b6c76d, user_id=91a54df480ce4d60979bf20b62f75867, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:46.094172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcdfaf3-1941-4cea-9f86-c87688385979 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:46.108911 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1187/2345] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:07:46 2022] PUT /identity/v3/projects/6407de57591f46f290c7c425a5b6c76d/users/91a54df480ce4d60979bf20b62f75867/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:07:48.568739 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c810d-87be-4229-aa2b-1a51165fcf50 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:48.569219 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c810d-87be-4229-aa2b-1a51165fcf50 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:48.569219 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c810d-87be-4229-aa2b-1a51165fcf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:48.615625 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-de8c810d-87be-4229-aa2b-1a51165fcf50 None None] MFA Rules not processed for user `af7838e525a042dfa0357ad1fc58cf21`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:48.617459 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-de8c810d-87be-4229-aa2b-1a51165fcf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:48.808087 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1159/2346] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:54.892927 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd2411-180c-4467-8cd8-d9f9cc161694 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:54.893426 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd2411-180c-4467-8cd8-d9f9cc161694 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:54.893550 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd2411-180c-4467-8cd8-d9f9cc161694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:54.928668 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-45cd2411-180c-4467-8cd8-d9f9cc161694 None None] MFA Rules not processed for user `91a54df480ce4d60979bf20b62f75867`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:07:54.930078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-45cd2411-180c-4467-8cd8-d9f9cc161694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:55.038862 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1188/2347] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:07:54 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:07:55.053118 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c810d-87be-4229-aa2b-1a51165fcf50 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:07:55.055263 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-de8c810d-87be-4229-aa2b-1a51165fcf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:07:55.255397 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:55.262942 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c810d-87be-4229-aa2b-1a51165fcf50 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:07:55.272330 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e4da3-6fc0-4b70-afcc-30b3eecf8d78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:07:55.273108 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e4da3-6fc0-4b70-afcc-30b3eecf8d78 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:07:55.273456 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e4da3-6fc0-4b70-afcc-30b3eecf8d78 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:07:55.273803 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e4da3-6fc0-4b70-afcc-30b3eecf8d78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:07:55.392347 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e4da3-6fc0-4b70-afcc-30b3eecf8d78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:07:55.394081 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e4da3-6fc0-4b70-afcc-30b3eecf8d78 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:07:55.427871 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1160/2348] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:07:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:08:02.937519 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd2411-180c-4467-8cd8-d9f9cc161694 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:08:02.939561 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-45cd2411-180c-4467-8cd8-d9f9cc161694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:08:03.015327 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd2411-180c-4467-8cd8-d9f9cc161694 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:08:03.019975 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a6757-21de-40f3-9709-99bfa623a5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:08:03.021420 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a6757-21de-40f3-9709-99bfa623a5b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:08:03.021705 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a6757-21de-40f3-9709-99bfa623a5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:08:03.021983 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a6757-21de-40f3-9709-99bfa623a5b0 admin admin] PATH_INFO: `/v3/users/388454b40b234c08ab6b69a29e435b39` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:08:03.023228 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a6757-21de-40f3-9709-99bfa623a5b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=388454b40b234c08ab6b69a29e435b39)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:08:03.025207 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a6757-21de-40f3-9709-99bfa623a5b0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:08:03.055675 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:08:03.077978 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c71a6757-21de-40f3-9709-99bfa623a5b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '388454b40b234c08ab6b69a29e435b39'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:08:03.078720 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c71a6757-21de-40f3-9709-99bfa623a5b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '388454b40b234c08ab6b69a29e435b39'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:08:03.079422 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c71a6757-21de-40f3-9709-99bfa623a5b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '388454b40b234c08ab6b69a29e435b39'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:08:03.089267 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c71a6757-21de-40f3-9709-99bfa623a5b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '388454b40b234c08ab6b69a29e435b39'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:08:03.110463 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c71a6757-21de-40f3-9709-99bfa623a5b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '388454b40b234c08ab6b69a29e435b39'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:08:03.132473 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1189/2349] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:08:02 2022] DELETE /identity/v3/users/388454b40b234c08ab6b69a29e435b39 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:08:03.134263 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fc13f-052b-4ce2-b284-1a6d6a603d67 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:08:03.134733 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fc13f-052b-4ce2-b284-1a6d6a603d67 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:08:03.134849 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fc13f-052b-4ce2-b284-1a6d6a603d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:08:03.153024 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c07fc13f-052b-4ce2-b284-1a6d6a603d67 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:08:03.154243 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c07fc13f-052b-4ce2-b284-1a6d6a603d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:08:03.218315 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1161/2350] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:08:03.228060 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a6757-21de-40f3-9709-99bfa623a5b0 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:08:03.229541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c71a6757-21de-40f3-9709-99bfa623a5b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:08:03.303129 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a6757-21de-40f3-9709-99bfa623a5b0 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:08:03.306733 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a99dc4-547b-4597-95f9-9ce8e1def124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:08:03.307477 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a99dc4-547b-4597-95f9-9ce8e1def124 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:08:03.307758 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a99dc4-547b-4597-95f9-9ce8e1def124 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:08:03.308031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a99dc4-547b-4597-95f9-9ce8e1def124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:08:03.324601 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a99dc4-547b-4597-95f9-9ce8e1def124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:08:03.326050 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a99dc4-547b-4597-95f9-9ce8e1def124 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:08:03.336763 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1190/2351] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:08:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:08:03.660433 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fc13f-052b-4ce2-b284-1a6d6a603d67 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:08:03.667285 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c07fc13f-052b-4ce2-b284-1a6d6a603d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:08:03.684099 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fc13f-052b-4ce2-b284-1a6d6a603d67 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:08:03.688941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3d4b8-67eb-4eff-8def-3580f8c9b82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:08:03.689832 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3d4b8-67eb-4eff-8def-3580f8c9b82f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:08:03.690120 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3d4b8-67eb-4eff-8def-3580f8c9b82f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:08:03.690402 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3d4b8-67eb-4eff-8def-3580f8c9b82f admin admin] PATH_INFO: `/v3/projects/a73643c10b6b43f5b5c63b2d9e10731c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:08:03.691671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3d4b8-67eb-4eff-8def-3580f8c9b82f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a73643c10b6b43f5b5c63b2d9e10731c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:08:03.694200 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3d4b8-67eb-4eff-8def-3580f8c9b82f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:08:03.760169 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-91b3d4b8-67eb-4eff-8def-3580f8c9b82f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a73643c10b6b43f5b5c63b2d9e10731c', 'request_id': 'req-91b3d4b8-67eb-4eff-8def-3580f8c9b82f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:08:03.770074 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-91b3d4b8-67eb-4eff-8def-3580f8c9b82f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a73643c10b6b43f5b5c63b2d9e10731c', 'request_id': 'req-91b3d4b8-67eb-4eff-8def-3580f8c9b82f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:08:03.778225 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-91b3d4b8-67eb-4eff-8def-3580f8c9b82f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a73643c10b6b43f5b5c63b2d9e10731c', 'request_id': 'req-91b3d4b8-67eb-4eff-8def-3580f8c9b82f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:08:03.792441 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-91b3d4b8-67eb-4eff-8def-3580f8c9b82f admin admin] The token cache is being invalidate because project a73643c10b6b43f5b5c63b2d9e10731c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:08:03.792928 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-91b3d4b8-67eb-4eff-8def-3580f8c9b82f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:08:03.793490 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-91b3d4b8-67eb-4eff-8def-3580f8c9b82f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:08:03.803567 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1162/2352] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:08:03 2022] DELETE /identity/v3/projects/a73643c10b6b43f5b5c63b2d9e10731c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:08:05.623933 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10bf31f-8dfd-40b9-8d77-f0a7bfdc97f3 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:08:05.624332 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10bf31f-8dfd-40b9-8d77-f0a7bfdc97f3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:08:05.624495 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10bf31f-8dfd-40b9-8d77-f0a7bfdc97f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:08:05.654554 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b10bf31f-8dfd-40b9-8d77-f0a7bfdc97f3 None None] MFA Rules not processed for user `fcd1725924134616b903b3e374d45817`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:08:05.655787 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b10bf31f-8dfd-40b9-8d77-f0a7bfdc97f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:08:05.714288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1191/2353] 10.222.0.24 () {58 vars in 1009 bytes} [Thu May 19 15:08:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:08:05.759347 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3d4b8-67eb-4eff-8def-3580f8c9b82f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:08:05.761686 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-91b3d4b8-67eb-4eff-8def-3580f8c9b82f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:08:05.792898 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:08:05.836742 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3d4b8-67eb-4eff-8def-3580f8c9b82f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:08:05.842104 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb7710-7c93-4418-8d91-6020f29d122f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecbeee0c1cf4c58be6c22aa11d7ff5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:08:05.843067 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb7710-7c93-4418-8d91-6020f29d122f service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:08:05.843392 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb7710-7c93-4418-8d91-6020f29d122f service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:08:05.843893 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb7710-7c93-4418-8d91-6020f29d122f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:08:05.854021 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb7710-7c93-4418-8d91-6020f29d122f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:08:05.855676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb7710-7c93-4418-8d91-6020f29d122f service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:08:05.863721 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1163/2354] 10.222.0.24 () {60 vars in 1384 bytes} [Thu May 19 15:08:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 15:08:15.707436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:DELETE=6,keystone:SELECT=74,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:08:15.860579 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=21 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:08:19.807803 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf8650-c1c7-4f57-a421-2e59331e799c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:08:19.808265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf8650-c1c7-4f57-a421-2e59331e799c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:08:19.808480 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf8650-c1c7-4f57-a421-2e59331e799c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:08:19.826803 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-fadf8650-c1c7-4f57-a421-2e59331e799c None None] MFA Rules not processed for user `9877b9bbc14141bba21625fc8f1046d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:08:19.828039 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-fadf8650-c1c7-4f57-a421-2e59331e799c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:08:19.907665 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1192/2355] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:08:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:08:20.263380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5509d-68bc-4e2a-9b57-7063cc64c9ac None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:08:20.264300 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5509d-68bc-4e2a-9b57-7063cc64c9ac None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:08:20.264605 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5509d-68bc-4e2a-9b57-7063cc64c9ac None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:08:20.266200 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1164/2356] 10.222.0.24 () {54 vars in 921 bytes} [Thu May 19 15:08:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 15:08:20.273649 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015e64e-7bf0-4676-9220-e251c07a5a50 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:08:20.274199 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015e64e-7bf0-4676-9220-e251c07a5a50 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:08:20.274543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015e64e-7bf0-4676-9220-e251c07a5a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:08:20.315691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-4015e64e-7bf0-4676-9220-e251c07a5a50 None None] MFA Rules not processed for user `06fb8bb5aeb143ad95f33c3b43dbd346`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:08:20.317670 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4015e64e-7bf0-4676-9220-e251c07a5a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:08:20.398174 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1193/2357] 10.222.0.24 () {58 vars in 1018 bytes} [Thu May 19 15:08:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:08:20.410031 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5509d-68bc-4e2a-9b57-7063cc64c9ac None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:08:20.411888 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c4d5509d-68bc-4e2a-9b57-7063cc64c9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:08:20.495163 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5509d-68bc-4e2a-9b57-7063cc64c9ac None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:08:20.498811 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5d81b-cf30-4a06-8ea0-d38d8d5cfa1b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1dc1d74631b4d69a3094e4e1e2a0ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:08:20.499591 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5d81b-cf30-4a06-8ea0-d38d8d5cfa1b service glance] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:08:20.499992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5d81b-cf30-4a06-8ea0-d38d8d5cfa1b service glance] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:08:20.500337 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5d81b-cf30-4a06-8ea0-d38d8d5cfa1b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:08:20.511718 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5d81b-cf30-4a06-8ea0-d38d8d5cfa1b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:08:20.513238 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5d81b-cf30-4a06-8ea0-d38d8d5cfa1b service glance] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:08:20.525274 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1165/2358] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:08:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:08:20.593802 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc1636-7e0d-42da-b4d1-61806fa679c6 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:08:20.594327 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc1636-7e0d-42da-b4d1-61806fa679c6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:08:20.594868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc1636-7e0d-42da-b4d1-61806fa679c6 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:08:20.596513 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1194/2359] 10.222.0.24 () {54 vars in 921 bytes} [Thu May 19 15:08:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 15:08:20.601647 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd917bb-56f1-451b-ae38-78c249aacdc0 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:08:20.601942 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd917bb-56f1-451b-ae38-78c249aacdc0 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:08:20.602217 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd917bb-56f1-451b-ae38-78c249aacdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:08:20.638628 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4cd917bb-56f1-451b-ae38-78c249aacdc0 None None] MFA Rules not processed for user `2d089b5ee94e441ebbd084c2581a42df`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:08:20.639995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4cd917bb-56f1-451b-ae38-78c249aacdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:08:20.694778 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1166/2360] 10.222.0.24 () {58 vars in 1018 bytes} [Thu May 19 15:08:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:08:20.706725 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc1636-7e0d-42da-b4d1-61806fa679c6 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:08:20.709013 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2bdc1636-7e0d-42da-b4d1-61806fa679c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:08:20.724341 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc1636-7e0d-42da-b4d1-61806fa679c6 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:08:20.727974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1522215-104c-4274-a170-d6cda44e6fd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:08:20.728615 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1522215-104c-4274-a170-d6cda44e6fd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:08:20.728900 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1522215-104c-4274-a170-d6cda44e6fd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:08:20.729180 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1522215-104c-4274-a170-d6cda44e6fd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:08:20.737288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1522215-104c-4274-a170-d6cda44e6fd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:08:20.738734 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1522215-104c-4274-a170-d6cda44e6fd2 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:08:20.749887 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1195/2361] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:08:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:08:21.075567 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428bffa-5cc8-43c9-a77a-8e8ab61eb031 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:08:21.076089 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428bffa-5cc8-43c9-a77a-8e8ab61eb031 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:08:21.076396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428bffa-5cc8-43c9-a77a-8e8ab61eb031 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:08:21.077839 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1167/2362] 10.222.0.24 () {54 vars in 921 bytes} [Thu May 19 15:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 15:08:21.084733 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafe40d-a823-4b32-8b65-edd0e8658c70 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:08:21.085226 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafe40d-a823-4b32-8b65-edd0e8658c70 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:08:21.085336 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafe40d-a823-4b32-8b65-edd0e8658c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:08:21.107156 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9fafe40d-a823-4b32-8b65-edd0e8658c70 None None] MFA Rules not processed for user `06fb8bb5aeb143ad95f33c3b43dbd346`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:08:21.109069 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9fafe40d-a823-4b32-8b65-edd0e8658c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:08:21.118955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1196/2363] 10.222.0.24 () {58 vars in 1018 bytes} [Thu May 19 15:08:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:08:21.130924 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428bffa-5cc8-43c9-a77a-8e8ab61eb031 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:08:21.149820 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428bffa-5cc8-43c9-a77a-8e8ab61eb031 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:08:21.154127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc66103-bdbe-4829-acae-762a065f995f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:08:21.154768 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc66103-bdbe-4829-acae-762a065f995f service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:08:21.155096 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc66103-bdbe-4829-acae-762a065f995f service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:08:21.155524 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc66103-bdbe-4829-acae-762a065f995f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:08:21.169251 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc66103-bdbe-4829-acae-762a065f995f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:08:21.171463 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc66103-bdbe-4829-acae-762a065f995f service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:08:21.187388 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1168/2364] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:08:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:08:31.100934 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=71 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:08:31.178334 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=70 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:08:35.692458 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafe40d-a823-4b32-8b65-edd0e8658c70 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:08:35.693959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9fafe40d-a823-4b32-8b65-edd0e8658c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:08:35.791333 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafe40d-a823-4b32-8b65-edd0e8658c70 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:08:35.796638 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1e072-3b8a-4b9b-9752-c41a71790163 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adec680c4f5f4e6dbe5989d5d7acf620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:08:35.797431 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1e072-3b8a-4b9b-9752-c41a71790163 service placement] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:08:35.797716 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1e072-3b8a-4b9b-9752-c41a71790163 service placement] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:08:35.797997 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1e072-3b8a-4b9b-9752-c41a71790163 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:08:35.799794 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-91c1e072-3b8a-4b9b-9752-c41a71790163 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:08:35.811437 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1e072-3b8a-4b9b-9752-c41a71790163 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:08:35.813033 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1e072-3b8a-4b9b-9752-c41a71790163 service placement] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:08:35.822780 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1197/2365] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:08:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:08:36.479026 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32561d4e-921e-4ec8-a0dc-745d399b93d0 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:08:36.479498 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32561d4e-921e-4ec8-a0dc-745d399b93d0 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:08:36.479638 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32561d4e-921e-4ec8-a0dc-745d399b93d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:08:36.527697 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-32561d4e-921e-4ec8-a0dc-745d399b93d0 None None] MFA Rules not processed for user `fcd1725924134616b903b3e374d45817`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:08:36.528897 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-32561d4e-921e-4ec8-a0dc-745d399b93d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:08:36.546076 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1169/2366] 10.222.0.24 () {58 vars in 1009 bytes} [Thu May 19 15:08:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:08:36.557843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1e072-3b8a-4b9b-9752-c41a71790163 service placement] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:08:36.577615 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1e072-3b8a-4b9b-9752-c41a71790163 service placement] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:08:36.582983 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b83e8-129b-4971-983f-8193e4208227 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecbeee0c1cf4c58be6c22aa11d7ff5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:08:36.583648 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b83e8-129b-4971-983f-8193e4208227 service swift] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:08:36.583924 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b83e8-129b-4971-983f-8193e4208227 service swift] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:08:36.584197 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b83e8-129b-4971-983f-8193e4208227 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:08:36.592103 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b83e8-129b-4971-983f-8193e4208227 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:08:36.593663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b83e8-129b-4971-983f-8193e4208227 service swift] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:08:36.602137 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1198/2367] 10.222.0.24 () {60 vars in 1384 bytes} [Thu May 19 15:08:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 15:08:46.543298 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=18 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:08:46.599017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=51 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:08:55.149700 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32561d4e-921e-4ec8-a0dc-745d399b93d0 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:08:55.159350 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32561d4e-921e-4ec8-a0dc-745d399b93d0 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:08:55.163570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc8d41-1aee-4163-9548-528dfe017e4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:08:55.164220 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc8d41-1aee-4163-9548-528dfe017e4d service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:08:55.164508 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc8d41-1aee-4163-9548-528dfe017e4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:08:55.164787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc8d41-1aee-4163-9548-528dfe017e4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:08:55.166652 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c2bc8d41-1aee-4163-9548-528dfe017e4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:08:55.228126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc8d41-1aee-4163-9548-528dfe017e4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:08:55.229574 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc8d41-1aee-4163-9548-528dfe017e4d service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:08:55.239045 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1170/2368] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:08:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:09:04.080324 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc40099-f64b-4568-9918-af75e71216f9 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:09:04.080802 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc40099-f64b-4568-9918-af75e71216f9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:09:04.080913 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc40099-f64b-4568-9918-af75e71216f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:09:04.099698 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-6dc40099-f64b-4568-9918-af75e71216f9 None None] MFA Rules not processed for user `f7d796b832c442c0a2af8ef603879f30`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:09:04.100900 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6dc40099-f64b-4568-9918-af75e71216f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:09:04.156047 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1199/2369] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:09:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:09:04.987733 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4fa07-ebcd-4c40-a717-12c40687f5b2 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:09:04.988240 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4fa07-ebcd-4c40-a717-12c40687f5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:09:04.988444 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4fa07-ebcd-4c40-a717-12c40687f5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:09:05.007789 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-56b4fa07-ebcd-4c40-a717-12c40687f5b2 None None] MFA Rules not processed for user `fcd1725924134616b903b3e374d45817`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:09:05.009002 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-56b4fa07-ebcd-4c40-a717-12c40687f5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:09:05.016455 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1171/2370] 10.222.0.24 () {58 vars in 967 bytes} [Thu May 19 15:09:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:09:05.031748 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc40099-f64b-4568-9918-af75e71216f9 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:09:05.043938 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc40099-f64b-4568-9918-af75e71216f9 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:09:05.048986 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398fac9-4607-47d2-991d-a4a8cee8ad51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecbeee0c1cf4c58be6c22aa11d7ff5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:09:05.049635 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398fac9-4607-47d2-991d-a4a8cee8ad51 service swift] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:09:05.049922 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398fac9-4607-47d2-991d-a4a8cee8ad51 service swift] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:09:05.050196 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398fac9-4607-47d2-991d-a4a8cee8ad51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:09:05.060696 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398fac9-4607-47d2-991d-a4a8cee8ad51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:09:05.062338 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398fac9-4607-47d2-991d-a4a8cee8ad51 service swift] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:09:05.071730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1200/2371] 10.222.0.24 () {60 vars in 1384 bytes} [Thu May 19 15:09:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 15:09:15.002187 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=33 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:09:15.068132 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=31 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:09:22.839731 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef49411-fce6-45a1-bb17-fafd0e8865ae None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:09:22.840239 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef49411-fce6-45a1-bb17-fafd0e8865ae None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:09:22.840347 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef49411-fce6-45a1-bb17-fafd0e8865ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:09:22.858522 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1ef49411-fce6-45a1-bb17-fafd0e8865ae None None] MFA Rules not processed for user `af7838e525a042dfa0357ad1fc58cf21`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:09:22.859791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1ef49411-fce6-45a1-bb17-fafd0e8865ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:09:22.922140 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1172/2372] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:09:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:09:32.915162 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=25 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:09:34.668178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788dadb-853b-421f-9323-3b5160ddec5f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:09:34.668639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788dadb-853b-421f-9323-3b5160ddec5f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:09:34.668747 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788dadb-853b-421f-9323-3b5160ddec5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:09:34.686060 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-1788dadb-853b-421f-9323-3b5160ddec5f None None] MFA Rules not processed for user `e5374c90f38b47fcb611e346f3f2ec69`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:09:34.687299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1788dadb-853b-421f-9323-3b5160ddec5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:09:34.743284 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1201/2373] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:09:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:09:44.736222 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=25 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:10:01.704113 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6196a-36f1-4d3a-b2ea-9fa3c21edada None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:01.704616 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6196a-36f1-4d3a-b2ea-9fa3c21edada None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:01.704723 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6196a-36f1-4d3a-b2ea-9fa3c21edada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:01.722541 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-10d6196a-36f1-4d3a-b2ea-9fa3c21edada None None] MFA Rules not processed for user `644abe5583e94049abd23e4ca050a066`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:10:01.723789 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-10d6196a-36f1-4d3a-b2ea-9fa3c21edada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:01.777154 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1173/2374] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:10:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:10:05.657287 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788dadb-853b-421f-9323-3b5160ddec5f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:05.658941 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1788dadb-853b-421f-9323-3b5160ddec5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:05.725331 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788dadb-853b-421f-9323-3b5160ddec5f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:05.729802 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf55244-d772-4ca2-9c7d-e618a6ff3563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:05.730668 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf55244-d772-4ca2-9c7d-e618a6ff3563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:05.730952 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf55244-d772-4ca2-9c7d-e618a6ff3563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:05.731257 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf55244-d772-4ca2-9c7d-e618a6ff3563 admin admin] PATH_INFO: `/v3/users/f7d796b832c442c0a2af8ef603879f30` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:05.732443 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf55244-d772-4ca2-9c7d-e618a6ff3563 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7d796b832c442c0a2af8ef603879f30)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:05.734368 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf55244-d772-4ca2-9c7d-e618a6ff3563 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:05.781268 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-daf55244-d772-4ca2-9c7d-e618a6ff3563 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7d796b832c442c0a2af8ef603879f30'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:10:05.781892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-daf55244-d772-4ca2-9c7d-e618a6ff3563 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7d796b832c442c0a2af8ef603879f30'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:10:05.782545 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-daf55244-d772-4ca2-9c7d-e618a6ff3563 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7d796b832c442c0a2af8ef603879f30'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:10:05.790157 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-daf55244-d772-4ca2-9c7d-e618a6ff3563 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7d796b832c442c0a2af8ef603879f30'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:10:05.806156 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-daf55244-d772-4ca2-9c7d-e618a6ff3563 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7d796b832c442c0a2af8ef603879f30'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:10:05.823443 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1202/2375] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:10:05 2022] DELETE /identity/v3/users/f7d796b832c442c0a2af8ef603879f30 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:10:06.014385 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6196a-36f1-4d3a-b2ea-9fa3c21edada None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:06.027425 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6196a-36f1-4d3a-b2ea-9fa3c21edada None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:06.087316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21cabc-dc34-4b4c-905d-45ed885a7a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:06.088192 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21cabc-dc34-4b4c-905d-45ed885a7a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:06.088482 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21cabc-dc34-4b4c-905d-45ed885a7a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:06.088762 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21cabc-dc34-4b4c-905d-45ed885a7a9d admin admin] PATH_INFO: `/v3/projects/8f7a1fc211304ed3a001282402fa73cc` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:06.089963 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a21cabc-dc34-4b4c-905d-45ed885a7a9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f7a1fc211304ed3a001282402fa73cc)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:06.091973 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a21cabc-dc34-4b4c-905d-45ed885a7a9d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:06.140546 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4a21cabc-dc34-4b4c-905d-45ed885a7a9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f7a1fc211304ed3a001282402fa73cc', 'request_id': 'req-4a21cabc-dc34-4b4c-905d-45ed885a7a9d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:10:06.149161 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4a21cabc-dc34-4b4c-905d-45ed885a7a9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f7a1fc211304ed3a001282402fa73cc', 'request_id': 'req-4a21cabc-dc34-4b4c-905d-45ed885a7a9d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:10:06.155373 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4a21cabc-dc34-4b4c-905d-45ed885a7a9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f7a1fc211304ed3a001282402fa73cc', 'request_id': 'req-4a21cabc-dc34-4b4c-905d-45ed885a7a9d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:10:06.166434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4a21cabc-dc34-4b4c-905d-45ed885a7a9d admin admin] The token cache is being invalidate because project 8f7a1fc211304ed3a001282402fa73cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:10:06.166725 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4a21cabc-dc34-4b4c-905d-45ed885a7a9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:10:06.167417 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4a21cabc-dc34-4b4c-905d-45ed885a7a9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:10:06.169000 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1174/2376] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:10:06 2022] DELETE /identity/v3/projects/8f7a1fc211304ed3a001282402fa73cc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:10:06.174237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740a1f2-b783-48d1-a502-b3cc1484d479 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:06.174534 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740a1f2-b783-48d1-a502-b3cc1484d479 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:06.174821 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740a1f2-b783-48d1-a502-b3cc1484d479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:06.194756 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e740a1f2-b783-48d1-a502-b3cc1484d479 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:10:06.196004 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e740a1f2-b783-48d1-a502-b3cc1484d479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:06.255384 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1203/2377] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:10:06.263749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87704d8-bed4-438a-ae3c-a3c11d28db2a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:06.264135 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87704d8-bed4-438a-ae3c-a3c11d28db2a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:06.264497 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87704d8-bed4-438a-ae3c-a3c11d28db2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:06.284586 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d87704d8-bed4-438a-ae3c-a3c11d28db2a None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:10:06.285909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d87704d8-bed4-438a-ae3c-a3c11d28db2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:06.294604 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1175/2378] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:10:06.299552 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740a1f2-b783-48d1-a502-b3cc1484d479 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:06.309877 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740a1f2-b783-48d1-a502-b3cc1484d479 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:06.314624 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96508710-fe5b-4316-bec1-8acce4a44543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:06.315347 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96508710-fe5b-4316-bec1-8acce4a44543 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:06.315766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96508710-fe5b-4316-bec1-8acce4a44543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:06.316119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96508710-fe5b-4316-bec1-8acce4a44543 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:06.316886 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96508710-fe5b-4316-bec1-8acce4a44543 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:10:06.317199 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96508710-fe5b-4316-bec1-8acce4a44543 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:06.319797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96508710-fe5b-4316-bec1-8acce4a44543 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:06.335055 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1204/2379] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:10:06.339470 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87704d8-bed4-438a-ae3c-a3c11d28db2a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:06.348848 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87704d8-bed4-438a-ae3c-a3c11d28db2a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:06.353538 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3cfb38-bfe0-49ad-a64a-b926fcc43d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:06.354181 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cfb38-bfe0-49ad-a64a-b926fcc43d34 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:06.354490 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cfb38-bfe0-49ad-a64a-b926fcc43d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:06.354768 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cfb38-bfe0-49ad-a64a-b926fcc43d34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:06.355502 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3cfb38-bfe0-49ad-a64a-b926fcc43d34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:06.357413 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3cfb38-bfe0-49ad-a64a-b926fcc43d34 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:06.383980 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1176/2380] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:10:06 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:10:06.387754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96508710-fe5b-4316-bec1-8acce4a44543 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:06.397442 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96508710-fe5b-4316-bec1-8acce4a44543 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:06.400885 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:10:06.455799 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43db9b-1ba5-4c6a-ad47-281d7007641b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:06.456476 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43db9b-1ba5-4c6a-ad47-281d7007641b admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:06.456762 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43db9b-1ba5-4c6a-ad47-281d7007641b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:06.457036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43db9b-1ba5-4c6a-ad47-281d7007641b admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:06.457749 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43db9b-1ba5-4c6a-ad47-281d7007641b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:06.459698 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43db9b-1ba5-4c6a-ad47-281d7007641b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:06.479260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1205/2381] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:10:06 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:10:06.483333 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3cfb38-bfe0-49ad-a64a-b926fcc43d34 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:06.494464 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3cfb38-bfe0-49ad-a64a-b926fcc43d34 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:06.499101 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c1df5-e236-457f-b1e4-0f4dccef4de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:06.499798 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c1df5-e236-457f-b1e4-0f4dccef4de7 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:06.500083 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c1df5-e236-457f-b1e4-0f4dccef4de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:06.500360 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c1df5-e236-457f-b1e4-0f4dccef4de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:06.501089 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c1df5-e236-457f-b1e4-0f4dccef4de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:06.502699 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c1df5-e236-457f-b1e4-0f4dccef4de7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:06.504052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:10:06.518721 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1177/2382] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 15:10:06.520059 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43db9b-1ba5-4c6a-ad47-281d7007641b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:06.530230 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43db9b-1ba5-4c6a-ad47-281d7007641b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:06.534937 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe119d8-f3e1-4ade-8db8-1597884eb908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:06.535635 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe119d8-f3e1-4ade-8db8-1597884eb908 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:06.535917 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe119d8-f3e1-4ade-8db8-1597884eb908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:06.536190 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe119d8-f3e1-4ade-8db8-1597884eb908 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:06.536926 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe119d8-f3e1-4ade-8db8-1597884eb908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:06.538998 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe119d8-f3e1-4ade-8db8-1597884eb908 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:06.549086 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1206/2383] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:10:06.553437 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c1df5-e236-457f-b1e4-0f4dccef4de7 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:06.563222 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c1df5-e236-457f-b1e4-0f4dccef4de7 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:06.567916 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6dc1ac-48aa-4337-a7ac-a753679adb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:06.569434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dc1ac-48aa-4337-a7ac-a753679adb8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:06.569717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dc1ac-48aa-4337-a7ac-a753679adb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:06.569991 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dc1ac-48aa-4337-a7ac-a753679adb8c admin admin] PATH_INFO: `/v3/projects/ee9ba7310e7e4d558dba77f08668b77b/users/48e29cb55f7d4acabfc451e996b07791/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:06.584568 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6dc1ac-48aa-4337-a7ac-a753679adb8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee9ba7310e7e4d558dba77f08668b77b, user_id=48e29cb55f7d4acabfc451e996b07791, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:06.588851 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6dc1ac-48aa-4337-a7ac-a753679adb8c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:06.608402 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1178/2384] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:10:06 2022] PUT /identity/v3/projects/ee9ba7310e7e4d558dba77f08668b77b/users/48e29cb55f7d4acabfc451e996b07791/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:10:06.613655 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f2c86-e46a-4f2e-a037-2b4d00652c51 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:06.613956 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f2c86-e46a-4f2e-a037-2b4d00652c51 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:06.614263 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f2c86-e46a-4f2e-a037-2b4d00652c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:06.634483 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a05f2c86-e46a-4f2e-a037-2b4d00652c51 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:10:06.635747 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a05f2c86-e46a-4f2e-a037-2b4d00652c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:06.697894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1207/2385] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:10:06.708839 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6dc1ac-48aa-4337-a7ac-a753679adb8c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:06.711221 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6f6dc1ac-48aa-4337-a7ac-a753679adb8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:06.773876 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6dc1ac-48aa-4337-a7ac-a753679adb8c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:06.777560 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482962d-0163-45a6-9403-b2653ca9ffed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:06.778215 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482962d-0163-45a6-9403-b2653ca9ffed service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:06.778504 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482962d-0163-45a6-9403-b2653ca9ffed service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:06.778785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482962d-0163-45a6-9403-b2653ca9ffed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:06.788053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7482962d-0163-45a6-9403-b2653ca9ffed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:06.789475 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7482962d-0163-45a6-9403-b2653ca9ffed service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:06.800935 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1179/2386] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:10:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:10:10.742090 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f964efd-92ba-4194-9a51-671f53a88f6c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:10.744689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f964efd-92ba-4194-9a51-671f53a88f6c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:10.745140 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f964efd-92ba-4194-9a51-671f53a88f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:10.778602 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9f964efd-92ba-4194-9a51-671f53a88f6c None None] MFA Rules not processed for user `48e29cb55f7d4acabfc451e996b07791`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:10:10.780729 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9f964efd-92ba-4194-9a51-671f53a88f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:10.866827 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1208/2387] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:10:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:10:10.868222 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482962d-0163-45a6-9403-b2653ca9ffed service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:10.881497 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482962d-0163-45a6-9403-b2653ca9ffed service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:10.889087 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8b662-1244-4918-b88a-170519cc1437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:10.890127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8b662-1244-4918-b88a-170519cc1437 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:10.890512 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8b662-1244-4918-b88a-170519cc1437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:10.891010 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8b662-1244-4918-b88a-170519cc1437 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:10.892053 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea8b662-1244-4918-b88a-170519cc1437 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:10.894141 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea8b662-1244-4918-b88a-170519cc1437 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:10.928518 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1180/2388] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:10:10 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:10:10.929637 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f964efd-92ba-4194-9a51-671f53a88f6c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:10.940603 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f964efd-92ba-4194-9a51-671f53a88f6c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:10.952368 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:10:10.998797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7456319-8e6f-429e-9b11-e706756dd9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:10.999511 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7456319-8e6f-429e-9b11-e706756dd9e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:10.999797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7456319-8e6f-429e-9b11-e706756dd9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:11.000073 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7456319-8e6f-429e-9b11-e706756dd9e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:11.000773 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7456319-8e6f-429e-9b11-e706756dd9e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:11.002737 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7456319-8e6f-429e-9b11-e706756dd9e9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:11.023155 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1209/2389] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:10:10 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:10:11.026985 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8b662-1244-4918-b88a-170519cc1437 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:11.038165 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8b662-1244-4918-b88a-170519cc1437 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:11.042869 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e48323-4518-4d17-a7e1-43e09b8fceb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:11.043561 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e48323-4518-4d17-a7e1-43e09b8fceb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:11.043849 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e48323-4518-4d17-a7e1-43e09b8fceb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:11.044130 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e48323-4518-4d17-a7e1-43e09b8fceb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:11.044862 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e48323-4518-4d17-a7e1-43e09b8fceb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:11.046504 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e48323-4518-4d17-a7e1-43e09b8fceb4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:11.057456 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1181/2390] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:10:11.061773 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7456319-8e6f-429e-9b11-e706756dd9e9 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:11.073181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7456319-8e6f-429e-9b11-e706756dd9e9 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:11.078395 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d3cdb-4a93-4d71-9f95-e709628daa4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:11.079369 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d3cdb-4a93-4d71-9f95-e709628daa4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:11.079652 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d3cdb-4a93-4d71-9f95-e709628daa4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:11.079972 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d3cdb-4a93-4d71-9f95-e709628daa4b admin admin] PATH_INFO: `/v3/projects/c02cc267fc614f1fb0ff3b573b244a9b/users/ff95cbb5fcca4170992793ec3fe89dcb/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:11.096696 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d3cdb-4a93-4d71-9f95-e709628daa4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c02cc267fc614f1fb0ff3b573b244a9b, user_id=ff95cbb5fcca4170992793ec3fe89dcb, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:11.100052 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d3cdb-4a93-4d71-9f95-e709628daa4b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:11.115133 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1210/2391] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:10:11 2022] PUT /identity/v3/projects/c02cc267fc614f1fb0ff3b573b244a9b/users/ff95cbb5fcca4170992793ec3fe89dcb/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:10:11.119390 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e48323-4518-4d17-a7e1-43e09b8fceb4 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:11.129320 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e48323-4518-4d17-a7e1-43e09b8fceb4 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:11.188188 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f6e40-5324-44bb-891c-74a1cd81224e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:11.189346 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f6e40-5324-44bb-891c-74a1cd81224e admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:11.189346 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f6e40-5324-44bb-891c-74a1cd81224e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:11.189556 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f6e40-5324-44bb-891c-74a1cd81224e admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:11.190237 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f6e40-5324-44bb-891c-74a1cd81224e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:11.191950 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f6e40-5324-44bb-891c-74a1cd81224e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:11.203817 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1182/2392] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:10:11.207990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d3cdb-4a93-4d71-9f95-e709628daa4b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:11.219900 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d3cdb-4a93-4d71-9f95-e709628daa4b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:11.225224 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09536185-405b-41c3-817b-60e531f52c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:11.226135 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09536185-405b-41c3-817b-60e531f52c80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:11.226415 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09536185-405b-41c3-817b-60e531f52c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:11.226692 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09536185-405b-41c3-817b-60e531f52c80 admin admin] PATH_INFO: `/v3/projects/c02cc267fc614f1fb0ff3b573b244a9b/users/ff95cbb5fcca4170992793ec3fe89dcb/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:11.228742 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09536185-405b-41c3-817b-60e531f52c80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c02cc267fc614f1fb0ff3b573b244a9b, user_id=ff95cbb5fcca4170992793ec3fe89dcb, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:11.231487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09536185-405b-41c3-817b-60e531f52c80 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:11.248918 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1211/2393] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:10:11 2022] PUT /identity/v3/projects/c02cc267fc614f1fb0ff3b573b244a9b/users/ff95cbb5fcca4170992793ec3fe89dcb/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:10:15.980557 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ecf67-45f2-4de5-8ce2-b0660d0caa1e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:15.986167 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ecf67-45f2-4de5-8ce2-b0660d0caa1e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:15.986791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ecf67-45f2-4de5-8ce2-b0660d0caa1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:16.047361 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-714ecf67-45f2-4de5-8ce2-b0660d0caa1e None None] MFA Rules not processed for user `ff95cbb5fcca4170992793ec3fe89dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:10:16.048789 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-714ecf67-45f2-4de5-8ce2-b0660d0caa1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:16.101874 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:10:16.228954 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1183/2394] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:10:15 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:10:16.244895 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09536185-405b-41c3-817b-60e531f52c80 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:16.246866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-09536185-405b-41c3-817b-60e531f52c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:16.350795 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09536185-405b-41c3-817b-60e531f52c80 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:16.358028 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0cded-cb7a-4428-b93a-329c035e9a77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:16.358805 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0cded-cb7a-4428-b93a-329c035e9a77 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:16.359107 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0cded-cb7a-4428-b93a-329c035e9a77 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:16.359429 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0cded-cb7a-4428-b93a-329c035e9a77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:16.505518 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0cded-cb7a-4428-b93a-329c035e9a77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:16.507234 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0cded-cb7a-4428-b93a-329c035e9a77 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:16.521550 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1212/2395] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:10:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:10:18.025823 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0a0a7-1747-4a76-911f-312b1f6e9c44 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:18.026343 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0a0a7-1747-4a76-911f-312b1f6e9c44 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:18.026617 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0a0a7-1747-4a76-911f-312b1f6e9c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:18.047627 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-17e0a0a7-1747-4a76-911f-312b1f6e9c44 None None] MFA Rules not processed for user `48e29cb55f7d4acabfc451e996b07791`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:10:18.049142 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-17e0a0a7-1747-4a76-911f-312b1f6e9c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:18.059313 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1184/2396] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:10:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:10:26.516636 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=93,keystone:INSERT=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:10:28.042155 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=20 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:10:29.130483 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0cded-cb7a-4428-b93a-329c035e9a77 service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:29.187511 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0cded-cb7a-4428-b93a-329c035e9a77 service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:29.190967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595915f0-584f-45bb-8ded-ba20313d2c25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:29.191640 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595915f0-584f-45bb-8ded-ba20313d2c25 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:29.191925 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595915f0-584f-45bb-8ded-ba20313d2c25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:29.192202 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595915f0-584f-45bb-8ded-ba20313d2c25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:29.194084 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-595915f0-584f-45bb-8ded-ba20313d2c25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:29.207760 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595915f0-584f-45bb-8ded-ba20313d2c25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:29.209270 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595915f0-584f-45bb-8ded-ba20313d2c25 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:29.219873 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1213/2397] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:10:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:10:30.395240 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0a0a7-1747-4a76-911f-312b1f6e9c44 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:30.404908 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0a0a7-1747-4a76-911f-312b1f6e9c44 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:30.408516 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ff0f2-e71f-44fe-b27f-db164d9c405c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:30.409157 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ff0f2-e71f-44fe-b27f-db164d9c405c service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:30.409447 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ff0f2-e71f-44fe-b27f-db164d9c405c service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:30.409732 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ff0f2-e71f-44fe-b27f-db164d9c405c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:30.411712 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-191ff0f2-e71f-44fe-b27f-db164d9c405c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:30.425378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ff0f2-e71f-44fe-b27f-db164d9c405c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:30.426829 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ff0f2-e71f-44fe-b27f-db164d9c405c service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:30.438594 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1185/2398] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:10:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:10:35.410076 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595915f0-584f-45bb-8ded-ba20313d2c25 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:35.411599 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-595915f0-584f-45bb-8ded-ba20313d2c25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:35.485408 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595915f0-584f-45bb-8ded-ba20313d2c25 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:35.490367 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e264eea-1829-428c-821e-399bf5e4da5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adec680c4f5f4e6dbe5989d5d7acf620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:35.491016 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e264eea-1829-428c-821e-399bf5e4da5d service placement] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:35.491327 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e264eea-1829-428c-821e-399bf5e4da5d service placement] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:35.491607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e264eea-1829-428c-821e-399bf5e4da5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:35.493427 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8e264eea-1829-428c-821e-399bf5e4da5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:35.505087 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e264eea-1829-428c-821e-399bf5e4da5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:35.507003 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e264eea-1829-428c-821e-399bf5e4da5d service placement] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:35.516835 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1214/2399] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:10:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:10:39.738566 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ff0f2-e71f-44fe-b27f-db164d9c405c service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:39.740162 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-191ff0f2-e71f-44fe-b27f-db164d9c405c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:39.754643 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ff0f2-e71f-44fe-b27f-db164d9c405c service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:39.760427 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e91441-f16b-4dc2-ae76-bcd67bb2a82b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:39.761031 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e91441-f16b-4dc2-ae76-bcd67bb2a82b service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:39.761357 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e91441-f16b-4dc2-ae76-bcd67bb2a82b service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:39.761674 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e91441-f16b-4dc2-ae76-bcd67bb2a82b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:39.763500 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-22e91441-f16b-4dc2-ae76-bcd67bb2a82b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:39.823953 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e91441-f16b-4dc2-ae76-bcd67bb2a82b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:39.826431 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e91441-f16b-4dc2-ae76-bcd67bb2a82b service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:39.836581 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1186/2400] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:10:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:10:39.893394 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e264eea-1829-428c-821e-399bf5e4da5d service placement] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:39.894930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8e264eea-1829-428c-821e-399bf5e4da5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:39.906471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e264eea-1829-428c-821e-399bf5e4da5d service placement] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:39.910583 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f11ca-d6cb-4390-bd9c-015650827615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:39.911324 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f11ca-d6cb-4390-bd9c-015650827615 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:39.911805 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f11ca-d6cb-4390-bd9c-015650827615 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:39.912652 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f11ca-d6cb-4390-bd9c-015650827615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:39.914603 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ed2f11ca-d6cb-4390-bd9c-015650827615 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:40.016269 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f11ca-d6cb-4390-bd9c-015650827615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:40.018212 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f11ca-d6cb-4390-bd9c-015650827615 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:40.035366 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1215/2401] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:10:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:10:40.476029 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e91441-f16b-4dc2-ae76-bcd67bb2a82b service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:40.487704 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e91441-f16b-4dc2-ae76-bcd67bb2a82b service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:40.495636 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb54d1-1de1-4f03-bd3d-49fd78c5e7c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:40.496315 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb54d1-1de1-4f03-bd3d-49fd78c5e7c7 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:40.496608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb54d1-1de1-4f03-bd3d-49fd78c5e7c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:40.496892 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb54d1-1de1-4f03-bd3d-49fd78c5e7c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:40.499340 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-75fb54d1-1de1-4f03-bd3d-49fd78c5e7c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:40.559733 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb54d1-1de1-4f03-bd3d-49fd78c5e7c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:40.561354 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb54d1-1de1-4f03-bd3d-49fd78c5e7c7 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:40.570978 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1187/2402] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:10:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:10:45.418340 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b3579-a2f4-4c55-b74d-d7bfe1154920 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:45.418906 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b3579-a2f4-4c55-b74d-d7bfe1154920 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:45.419137 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b3579-a2f4-4c55-b74d-d7bfe1154920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:45.436628 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-709b3579-a2f4-4c55-b74d-d7bfe1154920 None None] MFA Rules not processed for user `af7838e525a042dfa0357ad1fc58cf21`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:10:45.437834 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-709b3579-a2f4-4c55-b74d-d7bfe1154920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:45.444819 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1216/2403] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:10:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:10:45.787518 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb54d1-1de1-4f03-bd3d-49fd78c5e7c7 service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:45.789146 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-75fb54d1-1de1-4f03-bd3d-49fd78c5e7c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:45.802870 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb54d1-1de1-4f03-bd3d-49fd78c5e7c7 service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:45.808203 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51a6a3-3e30-400c-8a37-c7df358e7a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:45.809206 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51a6a3-3e30-400c-8a37-c7df358e7a16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:45.809469 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51a6a3-3e30-400c-8a37-c7df358e7a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:45.809819 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51a6a3-3e30-400c-8a37-c7df358e7a16 admin admin] PATH_INFO: `/v3/users/e5374c90f38b47fcb611e346f3f2ec69` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:45.811092 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51a6a3-3e30-400c-8a37-c7df358e7a16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5374c90f38b47fcb611e346f3f2ec69)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:45.813456 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51a6a3-3e30-400c-8a37-c7df358e7a16 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:45.867815 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5c51a6a3-3e30-400c-8a37-c7df358e7a16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5374c90f38b47fcb611e346f3f2ec69'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:10:45.876296 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5c51a6a3-3e30-400c-8a37-c7df358e7a16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5374c90f38b47fcb611e346f3f2ec69'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:10:45.887141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b3579-a2f4-4c55-b74d-d7bfe1154920 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:45.888823 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5c51a6a3-3e30-400c-8a37-c7df358e7a16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5374c90f38b47fcb611e346f3f2ec69'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:10:45.889579 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5c51a6a3-3e30-400c-8a37-c7df358e7a16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5374c90f38b47fcb611e346f3f2ec69'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:10:45.890264 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-5c51a6a3-3e30-400c-8a37-c7df358e7a16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5374c90f38b47fcb611e346f3f2ec69'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:10:45.894020 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:10:45.898060 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b3579-a2f4-4c55-b74d-d7bfe1154920 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:45.903269 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af729a9a-bbb4-452c-a6f9-931160843182 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:45.903912 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af729a9a-bbb4-452c-a6f9-931160843182 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:45.904190 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af729a9a-bbb4-452c-a6f9-931160843182 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:45.904651 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af729a9a-bbb4-452c-a6f9-931160843182 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:45.906494 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-af729a9a-bbb4-452c-a6f9-931160843182 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:45.908297 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1188/2404] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:10:45 2022] DELETE /identity/v3/users/e5374c90f38b47fcb611e346f3f2ec69 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:10:45.916573 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af729a9a-bbb4-452c-a6f9-931160843182 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:45.917998 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af729a9a-bbb4-452c-a6f9-931160843182 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:45.926216 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1217/2405] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:10:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 15:10:46.138165 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51a6a3-3e30-400c-8a37-c7df358e7a16 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:46.139992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5c51a6a3-3e30-400c-8a37-c7df358e7a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:46.217775 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51a6a3-3e30-400c-8a37-c7df358e7a16 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:46.224900 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd5eed-ab96-4fb3-8aff-c90bc4be5007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:46.226099 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd5eed-ab96-4fb3-8aff-c90bc4be5007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:46.226482 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd5eed-ab96-4fb3-8aff-c90bc4be5007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:46.226715 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd5eed-ab96-4fb3-8aff-c90bc4be5007 admin admin] PATH_INFO: `/v3/projects/199f08479d9541bc936bb4ea80bae96a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:46.228103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd5eed-ab96-4fb3-8aff-c90bc4be5007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=199f08479d9541bc936bb4ea80bae96a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:46.230879 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd5eed-ab96-4fb3-8aff-c90bc4be5007 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:46.332510 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f9bd5eed-ab96-4fb3-8aff-c90bc4be5007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '199f08479d9541bc936bb4ea80bae96a', 'request_id': 'req-f9bd5eed-ab96-4fb3-8aff-c90bc4be5007'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:10:46.341996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f9bd5eed-ab96-4fb3-8aff-c90bc4be5007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '199f08479d9541bc936bb4ea80bae96a', 'request_id': 'req-f9bd5eed-ab96-4fb3-8aff-c90bc4be5007'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:10:46.352172 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f9bd5eed-ab96-4fb3-8aff-c90bc4be5007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '199f08479d9541bc936bb4ea80bae96a', 'request_id': 'req-f9bd5eed-ab96-4fb3-8aff-c90bc4be5007'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:10:46.371480 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f9bd5eed-ab96-4fb3-8aff-c90bc4be5007 admin admin] The token cache is being invalidate because project 199f08479d9541bc936bb4ea80bae96a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:10:46.372163 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f9bd5eed-ab96-4fb3-8aff-c90bc4be5007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:10:46.373246 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-f9bd5eed-ab96-4fb3-8aff-c90bc4be5007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:10:46.375236 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1189/2406] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:10:46 2022] DELETE /identity/v3/projects/199f08479d9541bc936bb4ea80bae96a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:10:46.382637 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dd844-0f1c-4b64-ad7d-aee73301aab2 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:46.383027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dd844-0f1c-4b64-ad7d-aee73301aab2 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:46.383452 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dd844-0f1c-4b64-ad7d-aee73301aab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:46.398907 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:10:46.405069 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-752dd844-0f1c-4b64-ad7d-aee73301aab2 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:10:46.406262 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-752dd844-0f1c-4b64-ad7d-aee73301aab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:46.476524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1218/2407] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:10:46.484120 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77fc47-d742-4f23-9581-8060d7143450 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:46.484411 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77fc47-d742-4f23-9581-8060d7143450 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:46.484690 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77fc47-d742-4f23-9581-8060d7143450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:46.503650 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0b77fc47-d742-4f23-9581-8060d7143450 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:10:46.504846 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0b77fc47-d742-4f23-9581-8060d7143450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:46.512716 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1190/2408] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:10:46.516892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752dd844-0f1c-4b64-ad7d-aee73301aab2 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:46.526546 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752dd844-0f1c-4b64-ad7d-aee73301aab2 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:46.531635 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd373f-6f82-46ac-b8f8-4f6084993d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:46.532328 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd373f-6f82-46ac-b8f8-4f6084993d48 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:46.532652 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd373f-6f82-46ac-b8f8-4f6084993d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:46.533273 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd373f-6f82-46ac-b8f8-4f6084993d48 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:46.533977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd373f-6f82-46ac-b8f8-4f6084993d48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:10:46.534117 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd373f-6f82-46ac-b8f8-4f6084993d48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:46.536011 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd373f-6f82-46ac-b8f8-4f6084993d48 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:46.553510 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1219/2409] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:10:46.554741 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77fc47-d742-4f23-9581-8060d7143450 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:46.564449 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77fc47-d742-4f23-9581-8060d7143450 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:46.569322 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa0e92-154e-4e31-9224-5981a2f4bd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:46.570052 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa0e92-154e-4e31-9224-5981a2f4bd36 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:46.570412 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa0e92-154e-4e31-9224-5981a2f4bd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:46.570763 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa0e92-154e-4e31-9224-5981a2f4bd36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:46.571657 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa0e92-154e-4e31-9224-5981a2f4bd36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:46.573676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa0e92-154e-4e31-9224-5981a2f4bd36 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:46.601814 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1191/2410] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:10:46 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:10:46.605991 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd373f-6f82-46ac-b8f8-4f6084993d48 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:46.616903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd373f-6f82-46ac-b8f8-4f6084993d48 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:46.676194 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048dd2a-bf71-46b6-9da7-0f68ae6a624e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:46.677056 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048dd2a-bf71-46b6-9da7-0f68ae6a624e admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:46.677342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048dd2a-bf71-46b6-9da7-0f68ae6a624e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:46.678172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048dd2a-bf71-46b6-9da7-0f68ae6a624e admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:46.678903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048dd2a-bf71-46b6-9da7-0f68ae6a624e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:46.680876 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048dd2a-bf71-46b6-9da7-0f68ae6a624e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:46.701330 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1220/2411] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:10:46 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:10:46.705415 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa0e92-154e-4e31-9224-5981a2f4bd36 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:46.716535 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa0e92-154e-4e31-9224-5981a2f4bd36 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:46.721323 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0517529-2f5b-452f-85d8-607be8ad240a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:46.722084 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0517529-2f5b-452f-85d8-607be8ad240a admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:46.722446 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0517529-2f5b-452f-85d8-607be8ad240a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:46.722802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0517529-2f5b-452f-85d8-607be8ad240a admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:46.723650 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0517529-2f5b-452f-85d8-607be8ad240a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:46.725888 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0517529-2f5b-452f-85d8-607be8ad240a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:46.738653 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1192/2412] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:10:46.743959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048dd2a-bf71-46b6-9da7-0f68ae6a624e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:46.758681 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048dd2a-bf71-46b6-9da7-0f68ae6a624e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:46.763693 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fb8d8-c3e9-459c-9fb2-b2eb941ced67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:46.764349 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fb8d8-c3e9-459c-9fb2-b2eb941ced67 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:46.764636 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fb8d8-c3e9-459c-9fb2-b2eb941ced67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:46.764910 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fb8d8-c3e9-459c-9fb2-b2eb941ced67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:46.765628 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fb8d8-c3e9-459c-9fb2-b2eb941ced67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:46.767232 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521fb8d8-c3e9-459c-9fb2-b2eb941ced67 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:46.778097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1221/2413] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:10:46.782896 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0517529-2f5b-452f-85d8-607be8ad240a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:46.793696 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0517529-2f5b-452f-85d8-607be8ad240a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:46.798342 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c74c2-0b2d-4fa7-86db-deb569688261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:46.799246 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c74c2-0b2d-4fa7-86db-deb569688261 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:46.799541 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c74c2-0b2d-4fa7-86db-deb569688261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:46.799820 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c74c2-0b2d-4fa7-86db-deb569688261 admin admin] PATH_INFO: `/v3/projects/5b1521fd041a446e851d82487479930b/users/0022fc1107834a5cbe30f0146361213b/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:46.815971 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c74c2-0b2d-4fa7-86db-deb569688261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b1521fd041a446e851d82487479930b, user_id=0022fc1107834a5cbe30f0146361213b, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:46.819226 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c74c2-0b2d-4fa7-86db-deb569688261 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:46.833723 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1193/2414] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:10:46 2022] PUT /identity/v3/projects/5b1521fd041a446e851d82487479930b/users/0022fc1107834a5cbe30f0146361213b/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:10:46.839016 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072dc10b-5d41-4f02-b8ed-e323c750217c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:46.839442 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072dc10b-5d41-4f02-b8ed-e323c750217c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:46.839763 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072dc10b-5d41-4f02-b8ed-e323c750217c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:46.857964 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-072dc10b-5d41-4f02-b8ed-e323c750217c None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:10:46.859172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-072dc10b-5d41-4f02-b8ed-e323c750217c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:46.920235 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1222/2415] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:10:46.930205 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c74c2-0b2d-4fa7-86db-deb569688261 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:46.932125 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e58c74c2-0b2d-4fa7-86db-deb569688261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:46.957675 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:10:46.989383 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c74c2-0b2d-4fa7-86db-deb569688261 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:46.993861 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ebf61-1972-4698-aadb-031b0d411b2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:46.994535 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ebf61-1972-4698-aadb-031b0d411b2e service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:46.994823 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ebf61-1972-4698-aadb-031b0d411b2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:46.995105 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ebf61-1972-4698-aadb-031b0d411b2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:47.004090 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ebf61-1972-4698-aadb-031b0d411b2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:47.005545 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ebf61-1972-4698-aadb-031b0d411b2e service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:47.015388 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1194/2416] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:10:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:10:48.482680 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072dc10b-5d41-4f02-b8ed-e323c750217c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:48.495110 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072dc10b-5d41-4f02-b8ed-e323c750217c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:48.499685 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbeb2c-b328-4270-b51b-3f07da58f3fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:48.500543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbeb2c-b328-4270-b51b-3f07da58f3fa service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:48.501009 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbeb2c-b328-4270-b51b-3f07da58f3fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:48.501432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbeb2c-b328-4270-b51b-3f07da58f3fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:48.503455 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0afbeb2c-b328-4270-b51b-3f07da58f3fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:48.522351 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afbeb2c-b328-4270-b51b-3f07da58f3fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:48.524676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afbeb2c-b328-4270-b51b-3f07da58f3fa service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:48.531065 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:10:48.549930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1223/2417] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:10:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:10:50.147456 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ebf61-1972-4698-aadb-031b0d411b2e service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:50.149754 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8c3ebf61-1972-4698-aadb-031b0d411b2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:50.274287 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ebf61-1972-4698-aadb-031b0d411b2e service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:50.280677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c72c3-955b-42a2-880e-314dcc6b27ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:50.281035 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c72c3-955b-42a2-880e-314dcc6b27ea service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:50.281329 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c72c3-955b-42a2-880e-314dcc6b27ea service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:50.281610 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c72c3-955b-42a2-880e-314dcc6b27ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:50.283464 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8c7c72c3-955b-42a2-880e-314dcc6b27ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:50.297983 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c72c3-955b-42a2-880e-314dcc6b27ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:50.302985 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c72c3-955b-42a2-880e-314dcc6b27ea service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:50.323880 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1195/2418] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:10:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:10:53.045811 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17516b95-dafc-45af-84cd-336b6779dc48 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:53.046645 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17516b95-dafc-45af-84cd-336b6779dc48 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:53.046932 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17516b95-dafc-45af-84cd-336b6779dc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:53.082579 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-17516b95-dafc-45af-84cd-336b6779dc48 None None] MFA Rules not processed for user `0022fc1107834a5cbe30f0146361213b`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:10:53.084600 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-17516b95-dafc-45af-84cd-336b6779dc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:53.168618 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1224/2419] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:10:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:10:53.182657 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c72c3-955b-42a2-880e-314dcc6b27ea service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:53.184111 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8c7c72c3-955b-42a2-880e-314dcc6b27ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:53.198392 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c72c3-955b-42a2-880e-314dcc6b27ea service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:53.203986 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02c378-f92f-4187-b624-7de59a851f5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:53.204634 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02c378-f92f-4187-b624-7de59a851f5a service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:53.204922 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02c378-f92f-4187-b624-7de59a851f5a service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:53.205198 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02c378-f92f-4187-b624-7de59a851f5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:53.214005 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02c378-f92f-4187-b624-7de59a851f5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:53.215637 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02c378-f92f-4187-b624-7de59a851f5a service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:53.224876 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1196/2420] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:10:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:10:54.196124 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17516b95-dafc-45af-84cd-336b6779dc48 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:54.197627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-17516b95-dafc-45af-84cd-336b6779dc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:54.210306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17516b95-dafc-45af-84cd-336b6779dc48 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:54.214451 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46782a7d-042e-4d0b-a5f3-b6a3468ed926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:54.215113 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46782a7d-042e-4d0b-a5f3-b6a3468ed926 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:54.215444 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46782a7d-042e-4d0b-a5f3-b6a3468ed926 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:54.215927 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46782a7d-042e-4d0b-a5f3-b6a3468ed926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:54.218043 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-46782a7d-042e-4d0b-a5f3-b6a3468ed926 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:54.287161 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46782a7d-042e-4d0b-a5f3-b6a3468ed926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:54.288747 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46782a7d-042e-4d0b-a5f3-b6a3468ed926 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:54.300769 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1225/2421] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:10:54 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:10:54.814236 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88683ab-37d4-4c1b-a52e-b7545caa9e11 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:54.814786 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88683ab-37d4-4c1b-a52e-b7545caa9e11 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:54.815128 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88683ab-37d4-4c1b-a52e-b7545caa9e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:54.845151 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a88683ab-37d4-4c1b-a52e-b7545caa9e11 None None] MFA Rules not processed for user `0022fc1107834a5cbe30f0146361213b`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:10:54.846524 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a88683ab-37d4-4c1b-a52e-b7545caa9e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:54.857172 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1197/2422] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:10:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:10:58.458728 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46782a7d-042e-4d0b-a5f3-b6a3468ed926 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:10:58.471035 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46782a7d-042e-4d0b-a5f3-b6a3468ed926 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:10:58.478432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973824b3-4049-4125-9493-a36e1326a7ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:10:58.479084 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973824b3-4049-4125-9493-a36e1326a7ff service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:10:58.479436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973824b3-4049-4125-9493-a36e1326a7ff service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:10:58.479705 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973824b3-4049-4125-9493-a36e1326a7ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:10:58.481448 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-973824b3-4049-4125-9493-a36e1326a7ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:10:58.565413 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973824b3-4049-4125-9493-a36e1326a7ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:10:58.567383 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973824b3-4049-4125-9493-a36e1326a7ff service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:10:58.576661 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1226/2423] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:10:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:11:04.838215 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=59 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:11:05.351578 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88683ab-37d4-4c1b-a52e-b7545caa9e11 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:11:05.365985 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88683ab-37d4-4c1b-a52e-b7545caa9e11 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:11:05.371919 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f438e-d851-47d9-8035-663dd3ac6583 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:11:05.372651 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f438e-d851-47d9-8035-663dd3ac6583 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:11:05.373007 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f438e-d851-47d9-8035-663dd3ac6583 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:11:05.373380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f438e-d851-47d9-8035-663dd3ac6583 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:11:05.375246 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4e6f438e-d851-47d9-8035-663dd3ac6583 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:11:05.388027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f438e-d851-47d9-8035-663dd3ac6583 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:11:05.389636 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f438e-d851-47d9-8035-663dd3ac6583 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:11:05.401207 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1198/2424] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:11:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:11:08.572512 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=90 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:11:09.397712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973824b3-4049-4125-9493-a36e1326a7ff service nova] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:11:09.409958 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973824b3-4049-4125-9493-a36e1326a7ff service nova] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:11:09.416321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9894e8e-4f09-48d9-b360-d6e6fbb92dbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:11:09.416983 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9894e8e-4f09-48d9-b360-d6e6fbb92dbf service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:11:09.417268 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9894e8e-4f09-48d9-b360-d6e6fbb92dbf service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:11:09.417634 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9894e8e-4f09-48d9-b360-d6e6fbb92dbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:11:09.420359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d9894e8e-4f09-48d9-b360-d6e6fbb92dbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:11:09.434344 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9894e8e-4f09-48d9-b360-d6e6fbb92dbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:11:09.436480 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9894e8e-4f09-48d9-b360-d6e6fbb92dbf service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:11:09.450301 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1227/2425] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:11:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:11:14.057936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946a223-07c7-4e55-917b-5fb28b8f59dc None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:11:14.058401 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946a223-07c7-4e55-917b-5fb28b8f59dc None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:11:14.058552 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946a223-07c7-4e55-917b-5fb28b8f59dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:11:14.076895 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2946a223-07c7-4e55-917b-5fb28b8f59dc None None] MFA Rules not processed for user `9877b9bbc14141bba21625fc8f1046d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:11:14.078077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2946a223-07c7-4e55-917b-5fb28b8f59dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:11:14.133966 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1199/2426] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:11:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:11:19.153331 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fe07e-2146-4e61-816a-8ea3b21f6d20 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:11:19.153873 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fe07e-2146-4e61-816a-8ea3b21f6d20 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:11:19.153873 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fe07e-2146-4e61-816a-8ea3b21f6d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:11:19.172019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a35fe07e-2146-4e61-816a-8ea3b21f6d20 None None] MFA Rules not processed for user `fcd1725924134616b903b3e374d45817`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:11:19.173198 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a35fe07e-2146-4e61-816a-8ea3b21f6d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:11:19.227528 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1228/2427] 10.222.0.24 () {58 vars in 1009 bytes} [Thu May 19 15:11:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:11:19.275137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946a223-07c7-4e55-917b-5fb28b8f59dc None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:11:19.277262 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2946a223-07c7-4e55-917b-5fb28b8f59dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:11:19.363971 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946a223-07c7-4e55-917b-5fb28b8f59dc None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:11:19.369390 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270cda5-fc53-4a8a-a289-34913e817456 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecbeee0c1cf4c58be6c22aa11d7ff5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:11:19.370045 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270cda5-fc53-4a8a-a289-34913e817456 service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:11:19.370331 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270cda5-fc53-4a8a-a289-34913e817456 service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:11:19.370609 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270cda5-fc53-4a8a-a289-34913e817456 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:11:19.379324 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270cda5-fc53-4a8a-a289-34913e817456 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:11:19.383073 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270cda5-fc53-4a8a-a289-34913e817456 service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:11:19.391714 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1200/2428] 10.222.0.24 () {60 vars in 1384 bytes} [Thu May 19 15:11:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 15:11:29.220420 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=31 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:11:29.388158 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=68 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:11:34.004703 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62becc5a-13d3-4410-a3ea-d62730fac334 None None] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:11:34.005211 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62becc5a-13d3-4410-a3ea-d62730fac334 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:11:34.005211 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62becc5a-13d3-4410-a3ea-d62730fac334 None None] PATH_INFO: `/` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:11:34.006586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1229/2429] 10.222.0.24 () {54 vars in 921 bytes} [Thu May 19 15:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 15:11:34.012419 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfe06e-a10d-4d88-939a-64d272812b24 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:11:34.012866 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfe06e-a10d-4d88-939a-64d272812b24 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:11:34.013273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfe06e-a10d-4d88-939a-64d272812b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:11:34.031716 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-61cfe06e-a10d-4d88-939a-64d272812b24 None None] MFA Rules not processed for user `06fb8bb5aeb143ad95f33c3b43dbd346`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:11:34.032928 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-61cfe06e-a10d-4d88-939a-64d272812b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:11:34.043025 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1201/2430] 10.222.0.24 () {58 vars in 1018 bytes} [Thu May 19 15:11:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:11:34.056007 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62becc5a-13d3-4410-a3ea-d62730fac334 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:11:34.057757 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-62becc5a-13d3-4410-a3ea-d62730fac334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:11:34.116783 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62becc5a-13d3-4410-a3ea-d62730fac334 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:11:34.120594 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630a2c7-03c0-44cd-9e4d-1523c40a3b62 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1dc1d74631b4d69a3094e4e1e2a0ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:11:34.121237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630a2c7-03c0-44cd-9e4d-1523c40a3b62 service glance] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:11:34.121517 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630a2c7-03c0-44cd-9e4d-1523c40a3b62 service glance] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:11:34.121794 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630a2c7-03c0-44cd-9e4d-1523c40a3b62 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:11:34.132544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630a2c7-03c0-44cd-9e4d-1523c40a3b62 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:11:34.133986 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630a2c7-03c0-44cd-9e4d-1523c40a3b62 service glance] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:11:34.144771 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1230/2431] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:11:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:11:34.213094 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399eda2-fc4d-430e-b016-5b0bab1e1fdc None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:11:34.213415 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399eda2-fc4d-430e-b016-5b0bab1e1fdc None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:11:34.213703 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399eda2-fc4d-430e-b016-5b0bab1e1fdc None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:11:34.215086 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1202/2432] 10.222.0.24 () {54 vars in 921 bytes} [Thu May 19 15:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 15:11:34.219968 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9e41b-4411-4dec-905a-4f0d784c4256 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:11:34.220285 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9e41b-4411-4dec-905a-4f0d784c4256 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:11:34.220584 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9e41b-4411-4dec-905a-4f0d784c4256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:11:34.239064 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b7d9e41b-4411-4dec-905a-4f0d784c4256 None None] MFA Rules not processed for user `2d089b5ee94e441ebbd084c2581a42df`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:11:34.240275 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b7d9e41b-4411-4dec-905a-4f0d784c4256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:11:34.246951 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1231/2433] 10.222.0.24 () {58 vars in 1018 bytes} [Thu May 19 15:11:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:11:34.258238 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399eda2-fc4d-430e-b016-5b0bab1e1fdc None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:11:34.269097 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399eda2-fc4d-430e-b016-5b0bab1e1fdc None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:11:34.273184 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed4de0-99c4-424a-9820-e8a44398518b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:11:34.273814 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed4de0-99c4-424a-9820-e8a44398518b service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:11:34.274109 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed4de0-99c4-424a-9820-e8a44398518b service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:11:34.274394 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed4de0-99c4-424a-9820-e8a44398518b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:11:34.281428 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed4de0-99c4-424a-9820-e8a44398518b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:11:34.282855 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed4de0-99c4-424a-9820-e8a44398518b service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:11:34.292317 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1203/2434] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:11:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:11:35.995970 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfadedf-e70a-415d-8bd9-f41890e34706 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:11:35.996413 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfadedf-e70a-415d-8bd9-f41890e34706 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:11:35.996522 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfadedf-e70a-415d-8bd9-f41890e34706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:11:36.016127 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9cfadedf-e70a-415d-8bd9-f41890e34706 None None] MFA Rules not processed for user `fcd1725924134616b903b3e374d45817`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:11:36.017347 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9cfadedf-e70a-415d-8bd9-f41890e34706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:11:36.026046 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1232/2435] 10.222.0.24 () {58 vars in 1009 bytes} [Thu May 19 15:11:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:11:36.038075 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed4de0-99c4-424a-9820-e8a44398518b service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:11:36.050075 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed4de0-99c4-424a-9820-e8a44398518b service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:11:36.055049 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdbc6c-ac8f-458e-a11c-e8cc4573956c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecbeee0c1cf4c58be6c22aa11d7ff5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:11:36.055715 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdbc6c-ac8f-458e-a11c-e8cc4573956c service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:11:36.056007 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdbc6c-ac8f-458e-a11c-e8cc4573956c service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:11:36.056289 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdbc6c-ac8f-458e-a11c-e8cc4573956c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:11:36.064313 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bdbc6c-ac8f-458e-a11c-e8cc4573956c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:11:36.065894 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bdbc6c-ac8f-458e-a11c-e8cc4573956c service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:11:36.074367 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1204/2436] 10.222.0.24 () {60 vars in 1384 bytes} [Thu May 19 15:11:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 15:11:46.009444 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=32 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:11:46.071073 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=15 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:11:51.628422 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a5ac4-9d28-4d5a-9d66-5688fbf7144d None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:11:51.628877 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a5ac4-9d28-4d5a-9d66-5688fbf7144d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:11:51.628978 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a5ac4-9d28-4d5a-9d66-5688fbf7144d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:11:51.647744 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a53a5ac4-9d28-4d5a-9d66-5688fbf7144d None None] MFA Rules not processed for user `fcd1725924134616b903b3e374d45817`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:11:51.648937 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a53a5ac4-9d28-4d5a-9d66-5688fbf7144d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:11:51.656015 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1233/2437] 10.222.0.24 () {58 vars in 967 bytes} [Thu May 19 15:11:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:11:51.668512 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdbc6c-ac8f-458e-a11c-e8cc4573956c service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:11:51.678990 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdbc6c-ac8f-458e-a11c-e8cc4573956c service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:11:51.684264 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6e81f-c64a-43ef-b257-c906df30628e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecbeee0c1cf4c58be6c22aa11d7ff5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:11:51.684898 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6e81f-c64a-43ef-b257-c906df30628e service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:11:51.685187 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6e81f-c64a-43ef-b257-c906df30628e service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:11:51.685468 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6e81f-c64a-43ef-b257-c906df30628e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:11:51.694171 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6e81f-c64a-43ef-b257-c906df30628e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:11:51.695791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6e81f-c64a-43ef-b257-c906df30628e service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:11:51.703715 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1205/2438] 10.222.0.24 () {60 vars in 1384 bytes} [Thu May 19 15:11:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 15:12:01.641976 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:01.700584 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=6 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:02.698488 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a5ac4-9d28-4d5a-9d66-5688fbf7144d None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:02.708325 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a5ac4-9d28-4d5a-9d66-5688fbf7144d None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:02.711857 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcc078-b7ac-404c-8249-0b8d87b36890 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:02.712483 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcc078-b7ac-404c-8249-0b8d87b36890 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:02.712761 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcc078-b7ac-404c-8249-0b8d87b36890 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:02.713031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcc078-b7ac-404c-8249-0b8d87b36890 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:02.714758 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d8bcc078-b7ac-404c-8249-0b8d87b36890 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:02.726684 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcc078-b7ac-404c-8249-0b8d87b36890 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:02.728162 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcc078-b7ac-404c-8249-0b8d87b36890 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:02.737508 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1234/2439] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:12:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:12:06.199352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6e81f-c64a-43ef-b257-c906df30628e service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:06.200813 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-57b6e81f-c64a-43ef-b257-c906df30628e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:06.215354 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6e81f-c64a-43ef-b257-c906df30628e service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:06.219962 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934af410-6308-4deb-8fd5-5debe6a2b158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:06.220847 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934af410-6308-4deb-8fd5-5debe6a2b158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:06.221131 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934af410-6308-4deb-8fd5-5debe6a2b158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:06.221408 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934af410-6308-4deb-8fd5-5debe6a2b158 admin admin] PATH_INFO: `/v3/users/af7838e525a042dfa0357ad1fc58cf21` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:06.222647 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934af410-6308-4deb-8fd5-5debe6a2b158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af7838e525a042dfa0357ad1fc58cf21)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:06.224659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934af410-6308-4deb-8fd5-5debe6a2b158 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:06.270013 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-934af410-6308-4deb-8fd5-5debe6a2b158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af7838e525a042dfa0357ad1fc58cf21'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:06.276927 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-934af410-6308-4deb-8fd5-5debe6a2b158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af7838e525a042dfa0357ad1fc58cf21'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:06.288504 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-934af410-6308-4deb-8fd5-5debe6a2b158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af7838e525a042dfa0357ad1fc58cf21'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:06.289092 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-934af410-6308-4deb-8fd5-5debe6a2b158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af7838e525a042dfa0357ad1fc58cf21'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:06.289695 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-934af410-6308-4deb-8fd5-5debe6a2b158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af7838e525a042dfa0357ad1fc58cf21'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:06.302678 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1206/2440] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:12:06 2022] DELETE /identity/v3/users/af7838e525a042dfa0357ad1fc58cf21 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:12:06.480338 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcc078-b7ac-404c-8249-0b8d87b36890 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:06.490639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcc078-b7ac-404c-8249-0b8d87b36890 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:06.548881 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55248c-9c13-4aa7-a716-410219de3650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:06.549669 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55248c-9c13-4aa7-a716-410219de3650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:06.549949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55248c-9c13-4aa7-a716-410219de3650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:06.550222 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55248c-9c13-4aa7-a716-410219de3650 admin admin] PATH_INFO: `/v3/projects/34c1099557144b8bb2fff88f5b526834` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:06.551447 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55248c-9c13-4aa7-a716-410219de3650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34c1099557144b8bb2fff88f5b526834)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:06.553359 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55248c-9c13-4aa7-a716-410219de3650 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:06.597585 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5e55248c-9c13-4aa7-a716-410219de3650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34c1099557144b8bb2fff88f5b526834', 'request_id': 'req-5e55248c-9c13-4aa7-a716-410219de3650'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:06.603141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5e55248c-9c13-4aa7-a716-410219de3650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34c1099557144b8bb2fff88f5b526834', 'request_id': 'req-5e55248c-9c13-4aa7-a716-410219de3650'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:06.609270 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5e55248c-9c13-4aa7-a716-410219de3650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34c1099557144b8bb2fff88f5b526834', 'request_id': 'req-5e55248c-9c13-4aa7-a716-410219de3650'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:06.621553 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5e55248c-9c13-4aa7-a716-410219de3650 admin admin] The token cache is being invalidate because project 34c1099557144b8bb2fff88f5b526834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:12:06.621839 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5e55248c-9c13-4aa7-a716-410219de3650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:06.622462 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5e55248c-9c13-4aa7-a716-410219de3650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:06.624030 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1235/2441] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:12:06 2022] DELETE /identity/v3/projects/34c1099557144b8bb2fff88f5b526834 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:12:06.628967 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e19e4f-6317-4fca-b759-aae6ff01b3c3 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:06.629887 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e19e4f-6317-4fca-b759-aae6ff01b3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:06.630186 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e19e4f-6317-4fca-b759-aae6ff01b3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:06.648629 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-79e19e4f-6317-4fca-b759-aae6ff01b3c3 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:12:06.649814 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-79e19e4f-6317-4fca-b759-aae6ff01b3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:06.706262 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1207/2442] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:12:06.715064 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e4657-7250-4c7c-8385-3997be34e490 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:06.715385 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e4657-7250-4c7c-8385-3997be34e490 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:06.715672 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e4657-7250-4c7c-8385-3997be34e490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:06.733419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-384e4657-7250-4c7c-8385-3997be34e490 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:12:06.734622 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-384e4657-7250-4c7c-8385-3997be34e490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:06.742667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1236/2443] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:12:06.746887 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e19e4f-6317-4fca-b759-aae6ff01b3c3 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:06.758488 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e19e4f-6317-4fca-b759-aae6ff01b3c3 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:06.764503 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79405d-e4d5-4fcb-8435-5e8c4ea8f6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:06.765334 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79405d-e4d5-4fcb-8435-5e8c4ea8f6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:06.765801 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79405d-e4d5-4fcb-8435-5e8c4ea8f6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:06.766236 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79405d-e4d5-4fcb-8435-5e8c4ea8f6e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:06.767445 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79405d-e4d5-4fcb-8435-5e8c4ea8f6e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:12:06.767923 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79405d-e4d5-4fcb-8435-5e8c4ea8f6e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:06.770667 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a79405d-e4d5-4fcb-8435-5e8c4ea8f6e7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:06.783518 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1208/2444] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:12:06.788183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e4657-7250-4c7c-8385-3997be34e490 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:06.797373 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e4657-7250-4c7c-8385-3997be34e490 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:06.802123 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42772489-d4f5-4f54-9a10-d263f756c720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:06.802701 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42772489-d4f5-4f54-9a10-d263f756c720 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:06.802983 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42772489-d4f5-4f54-9a10-d263f756c720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:06.803298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42772489-d4f5-4f54-9a10-d263f756c720 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:06.803999 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42772489-d4f5-4f54-9a10-d263f756c720 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:06.805892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42772489-d4f5-4f54-9a10-d263f756c720 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:06.840801 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1237/2445] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:12:06 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:12:06.844836 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79405d-e4d5-4fcb-8435-5e8c4ea8f6e7 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:06.854652 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79405d-e4d5-4fcb-8435-5e8c4ea8f6e7 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:06.910054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee1040-6b6b-4ebc-80c5-d9d6e6454715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:06.910805 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee1040-6b6b-4ebc-80c5-d9d6e6454715 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:06.911108 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee1040-6b6b-4ebc-80c5-d9d6e6454715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:06.911402 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee1040-6b6b-4ebc-80c5-d9d6e6454715 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:06.912098 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee1040-6b6b-4ebc-80c5-d9d6e6454715 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:06.914022 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee1040-6b6b-4ebc-80c5-d9d6e6454715 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:06.920591 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:06.937047 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1209/2446] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:12:06 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:12:06.939542 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42772489-d4f5-4f54-9a10-d263f756c720 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:06.950172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42772489-d4f5-4f54-9a10-d263f756c720 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:06.954755 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a240bd-b7d0-41d8-8e03-9f2fe8280421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:06.955450 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a240bd-b7d0-41d8-8e03-9f2fe8280421 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:06.955736 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a240bd-b7d0-41d8-8e03-9f2fe8280421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:06.956014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a240bd-b7d0-41d8-8e03-9f2fe8280421 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:06.956736 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a240bd-b7d0-41d8-8e03-9f2fe8280421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:06.958328 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a240bd-b7d0-41d8-8e03-9f2fe8280421 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:06.970867 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1238/2447] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:12:06.971985 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee1040-6b6b-4ebc-80c5-d9d6e6454715 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:06.981694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee1040-6b6b-4ebc-80c5-d9d6e6454715 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:06.986335 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e2dff-e484-4456-8f90-c9a22d274863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:06.986983 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e2dff-e484-4456-8f90-c9a22d274863 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:06.987302 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e2dff-e484-4456-8f90-c9a22d274863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:06.987592 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e2dff-e484-4456-8f90-c9a22d274863 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:06.988318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e2dff-e484-4456-8f90-c9a22d274863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:06.990415 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e2dff-e484-4456-8f90-c9a22d274863 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:07.002497 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1210/2448] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:12:07.007445 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a240bd-b7d0-41d8-8e03-9f2fe8280421 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:07.017619 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a240bd-b7d0-41d8-8e03-9f2fe8280421 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:07.022522 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5d41f-1e04-42df-bf3b-6844ac6d1705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:07.023437 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5d41f-1e04-42df-bf3b-6844ac6d1705 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:07.023727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5d41f-1e04-42df-bf3b-6844ac6d1705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:07.024006 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5d41f-1e04-42df-bf3b-6844ac6d1705 admin admin] PATH_INFO: `/v3/projects/028db92951594c1d9adb2c95a022d894/users/071e993129a745bfb630e93dbfa0e230/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:07.039339 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5d41f-1e04-42df-bf3b-6844ac6d1705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=028db92951594c1d9adb2c95a022d894, user_id=071e993129a745bfb630e93dbfa0e230, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:07.042068 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5d41f-1e04-42df-bf3b-6844ac6d1705 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:07.059696 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1239/2449] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:12:07 2022] PUT /identity/v3/projects/028db92951594c1d9adb2c95a022d894/users/071e993129a745bfb630e93dbfa0e230/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:12:07.070508 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5cffd-e2ed-42b5-958f-695b742ac688 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:07.071418 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5cffd-e2ed-42b5-958f-695b742ac688 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:07.071418 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5cffd-e2ed-42b5-958f-695b742ac688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:07.098880 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-eea5cffd-e2ed-42b5-958f-695b742ac688 None None] MFA Rules not processed for user `071e993129a745bfb630e93dbfa0e230`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:12:07.100145 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-eea5cffd-e2ed-42b5-958f-695b742ac688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:07.168777 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1211/2450] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:12:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:12:07.173188 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5d41f-1e04-42df-bf3b-6844ac6d1705 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:07.180387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:07.237187 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5d41f-1e04-42df-bf3b-6844ac6d1705 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:07.242316 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de98a8-a581-425a-b199-9a3a47e0eeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:07.243299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de98a8-a581-425a-b199-9a3a47e0eeec admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:07.243588 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de98a8-a581-425a-b199-9a3a47e0eeec admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:07.243866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de98a8-a581-425a-b199-9a3a47e0eeec admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:07.244554 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de98a8-a581-425a-b199-9a3a47e0eeec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:07.246474 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de98a8-a581-425a-b199-9a3a47e0eeec admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:07.274047 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1240/2451] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:12:07 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:12:07.278047 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5cffd-e2ed-42b5-958f-695b742ac688 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:07.289475 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea5cffd-e2ed-42b5-958f-695b742ac688 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:07.358418 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824eee9-c0e4-47dd-bc48-14464bbcc560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:07.359114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824eee9-c0e4-47dd-bc48-14464bbcc560 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:07.359432 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824eee9-c0e4-47dd-bc48-14464bbcc560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:07.359713 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824eee9-c0e4-47dd-bc48-14464bbcc560 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:07.360411 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824eee9-c0e4-47dd-bc48-14464bbcc560 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:07.362363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824eee9-c0e4-47dd-bc48-14464bbcc560 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:07.390782 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1212/2452] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:12:07 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:12:07.390988 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de98a8-a581-425a-b199-9a3a47e0eeec admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:07.402387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de98a8-a581-425a-b199-9a3a47e0eeec admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:07.406973 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b999e8d-a4fc-4478-be29-ba0b1405ed46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:07.407673 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b999e8d-a4fc-4478-be29-ba0b1405ed46 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:07.407959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b999e8d-a4fc-4478-be29-ba0b1405ed46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:07.408242 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b999e8d-a4fc-4478-be29-ba0b1405ed46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:07.408967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b999e8d-a4fc-4478-be29-ba0b1405ed46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:07.411108 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b999e8d-a4fc-4478-be29-ba0b1405ed46 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:07.421699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1241/2453] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:12:07.425838 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824eee9-c0e4-47dd-bc48-14464bbcc560 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:07.436470 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824eee9-c0e4-47dd-bc48-14464bbcc560 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:07.441148 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5163aa1-0f4a-4a54-b022-3dde5dd0ac72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:07.442054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5163aa1-0f4a-4a54-b022-3dde5dd0ac72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:07.442339 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5163aa1-0f4a-4a54-b022-3dde5dd0ac72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:07.442618 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5163aa1-0f4a-4a54-b022-3dde5dd0ac72 admin admin] PATH_INFO: `/v3/projects/8ae9bf44abb54bc78625fe383f4c049a/users/029ac3c92586477fa5a970cd03b1f7aa/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:07.456995 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5163aa1-0f4a-4a54-b022-3dde5dd0ac72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ae9bf44abb54bc78625fe383f4c049a, user_id=029ac3c92586477fa5a970cd03b1f7aa, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:07.459779 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5163aa1-0f4a-4a54-b022-3dde5dd0ac72 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:07.482267 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1213/2454] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:12:07 2022] PUT /identity/v3/projects/8ae9bf44abb54bc78625fe383f4c049a/users/029ac3c92586477fa5a970cd03b1f7aa/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:12:07.486204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b999e8d-a4fc-4478-be29-ba0b1405ed46 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:07.497035 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b999e8d-a4fc-4478-be29-ba0b1405ed46 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:07.552722 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3492dc6-3c2c-4e9b-a389-e5024e6bd76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:07.553375 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3492dc6-3c2c-4e9b-a389-e5024e6bd76d admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:07.553658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3492dc6-3c2c-4e9b-a389-e5024e6bd76d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:07.553930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3492dc6-3c2c-4e9b-a389-e5024e6bd76d admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:07.554643 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3492dc6-3c2c-4e9b-a389-e5024e6bd76d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:07.556274 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3492dc6-3c2c-4e9b-a389-e5024e6bd76d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:07.565608 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1242/2455] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:12:07.569779 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5163aa1-0f4a-4a54-b022-3dde5dd0ac72 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:07.579785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5163aa1-0f4a-4a54-b022-3dde5dd0ac72 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:07.584456 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627b9fa-38f9-4e04-b82e-da828c2d81c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:07.585324 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627b9fa-38f9-4e04-b82e-da828c2d81c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:07.585602 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627b9fa-38f9-4e04-b82e-da828c2d81c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:07.585874 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627b9fa-38f9-4e04-b82e-da828c2d81c4 admin admin] PATH_INFO: `/v3/projects/8ae9bf44abb54bc78625fe383f4c049a/users/029ac3c92586477fa5a970cd03b1f7aa/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:07.587830 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627b9fa-38f9-4e04-b82e-da828c2d81c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ae9bf44abb54bc78625fe383f4c049a, user_id=029ac3c92586477fa5a970cd03b1f7aa, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:07.590434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627b9fa-38f9-4e04-b82e-da828c2d81c4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:07.601328 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1214/2456] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:12:07 2022] PUT /identity/v3/projects/8ae9bf44abb54bc78625fe383f4c049a/users/029ac3c92586477fa5a970cd03b1f7aa/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:12:07.612292 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86565c2c-a8e9-4b95-a404-c319d3a05fcc None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:07.612580 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86565c2c-a8e9-4b95-a404-c319d3a05fcc None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:07.612855 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86565c2c-a8e9-4b95-a404-c319d3a05fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:07.639706 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-86565c2c-a8e9-4b95-a404-c319d3a05fcc None None] MFA Rules not processed for user `029ac3c92586477fa5a970cd03b1f7aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:12:07.640921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-86565c2c-a8e9-4b95-a404-c319d3a05fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:07.714584 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:07.718704 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1243/2457] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:12:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:12:07.730265 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627b9fa-38f9-4e04-b82e-da828c2d81c4 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:07.732139 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c627b9fa-38f9-4e04-b82e-da828c2d81c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:07.755378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:07.809991 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627b9fa-38f9-4e04-b82e-da828c2d81c4 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:07.813681 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de24b4-3fb5-402b-9c7c-81b90f3cbaa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:07.814318 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de24b4-3fb5-402b-9c7c-81b90f3cbaa4 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:07.814605 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de24b4-3fb5-402b-9c7c-81b90f3cbaa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:07.814884 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de24b4-3fb5-402b-9c7c-81b90f3cbaa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:07.823821 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de24b4-3fb5-402b-9c7c-81b90f3cbaa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:07.825200 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de24b4-3fb5-402b-9c7c-81b90f3cbaa4 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:07.834891 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1215/2458] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:12:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:12:07.905614 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86565c2c-a8e9-4b95-a404-c319d3a05fcc None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:07.916080 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86565c2c-a8e9-4b95-a404-c319d3a05fcc None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:07.920098 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598453a9-f8b3-4591-ac13-e6b8a741927e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:07.920790 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598453a9-f8b3-4591-ac13-e6b8a741927e service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:07.921109 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598453a9-f8b3-4591-ac13-e6b8a741927e service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:07.921408 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598453a9-f8b3-4591-ac13-e6b8a741927e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:07.978259 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598453a9-f8b3-4591-ac13-e6b8a741927e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:07.979788 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598453a9-f8b3-4591-ac13-e6b8a741927e service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:07.988689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1244/2459] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:12:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:12:17.830299 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=26 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:17.984636 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=28 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:36.523009 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de24b4-3fb5-402b-9c7c-81b90f3cbaa4 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:36.524451 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-10de24b4-3fb5-402b-9c7c-81b90f3cbaa4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:36.581314 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de24b4-3fb5-402b-9c7c-81b90f3cbaa4 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:36.585171 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75e39d-40a6-430d-898a-b638b950efe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:36.585816 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75e39d-40a6-430d-898a-b638b950efe1 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:36.586146 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75e39d-40a6-430d-898a-b638b950efe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:36.586439 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75e39d-40a6-430d-898a-b638b950efe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:36.588477 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5a75e39d-40a6-430d-898a-b638b950efe1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:36.654164 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75e39d-40a6-430d-898a-b638b950efe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:36.655674 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75e39d-40a6-430d-898a-b638b950efe1 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:36.667146 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1216/2460] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:12:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:12:39.638613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598453a9-f8b3-4591-ac13-e6b8a741927e service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:39.640244 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-598453a9-f8b3-4591-ac13-e6b8a741927e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:39.671859 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598453a9-f8b3-4591-ac13-e6b8a741927e service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:39.676689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad56511-45c7-4d3a-9605-a26d0ee60952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:39.677575 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad56511-45c7-4d3a-9605-a26d0ee60952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:39.677863 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad56511-45c7-4d3a-9605-a26d0ee60952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:39.678146 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad56511-45c7-4d3a-9605-a26d0ee60952 admin admin] PATH_INFO: `/v3/users/644abe5583e94049abd23e4ca050a066` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:39.679497 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad56511-45c7-4d3a-9605-a26d0ee60952 admin admin] RBAC: Authorizing `identity:delete_user(user_id=644abe5583e94049abd23e4ca050a066)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:39.681437 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad56511-45c7-4d3a-9605-a26d0ee60952 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:39.734185 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-7ad56511-45c7-4d3a-9605-a26d0ee60952 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '644abe5583e94049abd23e4ca050a066'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:39.734842 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-7ad56511-45c7-4d3a-9605-a26d0ee60952 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '644abe5583e94049abd23e4ca050a066'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:39.735495 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-7ad56511-45c7-4d3a-9605-a26d0ee60952 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '644abe5583e94049abd23e4ca050a066'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:39.742736 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-7ad56511-45c7-4d3a-9605-a26d0ee60952 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '644abe5583e94049abd23e4ca050a066'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:39.754372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-7ad56511-45c7-4d3a-9605-a26d0ee60952 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '644abe5583e94049abd23e4ca050a066'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:39.767045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1245/2461] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:12:39 2022] DELETE /identity/v3/users/644abe5583e94049abd23e4ca050a066 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:12:39.940291 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75e39d-40a6-430d-898a-b638b950efe1 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:39.951041 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75e39d-40a6-430d-898a-b638b950efe1 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:40.013038 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd74b99-8a92-4c0f-a058-d16019becba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:40.013931 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd74b99-8a92-4c0f-a058-d16019becba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:40.014221 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd74b99-8a92-4c0f-a058-d16019becba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:40.014501 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd74b99-8a92-4c0f-a058-d16019becba1 admin admin] PATH_INFO: `/v3/projects/edea803526e44a55b74472ecefdb0fbc` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:40.015704 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd74b99-8a92-4c0f-a058-d16019becba1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edea803526e44a55b74472ecefdb0fbc)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:40.017698 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd74b99-8a92-4c0f-a058-d16019becba1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:40.061618 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9fd74b99-8a92-4c0f-a058-d16019becba1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edea803526e44a55b74472ecefdb0fbc', 'request_id': 'req-9fd74b99-8a92-4c0f-a058-d16019becba1'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:40.064131 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:40.069568 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9fd74b99-8a92-4c0f-a058-d16019becba1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edea803526e44a55b74472ecefdb0fbc', 'request_id': 'req-9fd74b99-8a92-4c0f-a058-d16019becba1'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:40.076732 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9fd74b99-8a92-4c0f-a058-d16019becba1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edea803526e44a55b74472ecefdb0fbc', 'request_id': 'req-9fd74b99-8a92-4c0f-a058-d16019becba1'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:40.086939 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9fd74b99-8a92-4c0f-a058-d16019becba1 admin admin] The token cache is being invalidate because project edea803526e44a55b74472ecefdb0fbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:12:40.087257 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9fd74b99-8a92-4c0f-a058-d16019becba1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:40.087920 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9fd74b99-8a92-4c0f-a058-d16019becba1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:40.089486 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1217/2462] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:12:39 2022] DELETE /identity/v3/projects/edea803526e44a55b74472ecefdb0fbc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:12:40.094407 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7738e44-9db2-4bdc-a790-e6f373d0b3d9 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:40.094701 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7738e44-9db2-4bdc-a790-e6f373d0b3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:40.094982 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7738e44-9db2-4bdc-a790-e6f373d0b3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:40.112641 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f7738e44-9db2-4bdc-a790-e6f373d0b3d9 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:12:40.113972 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f7738e44-9db2-4bdc-a790-e6f373d0b3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:40.172362 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1246/2463] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:12:40.180716 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ed9db-2d8b-446b-afbc-ff766d8bf0a8 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:40.181013 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ed9db-2d8b-446b-afbc-ff766d8bf0a8 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:40.181297 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ed9db-2d8b-446b-afbc-ff766d8bf0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:40.199965 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a58ed9db-2d8b-446b-afbc-ff766d8bf0a8 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:12:40.201169 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a58ed9db-2d8b-446b-afbc-ff766d8bf0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:40.209042 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1218/2464] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:12:40.213342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7738e44-9db2-4bdc-a790-e6f373d0b3d9 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:40.222928 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7738e44-9db2-4bdc-a790-e6f373d0b3d9 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:40.227886 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67084c-dea6-4abb-a0ef-4a45da634b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:40.228528 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67084c-dea6-4abb-a0ef-4a45da634b24 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:40.228807 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67084c-dea6-4abb-a0ef-4a45da634b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:40.229080 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67084c-dea6-4abb-a0ef-4a45da634b24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:40.229790 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67084c-dea6-4abb-a0ef-4a45da634b24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:12:40.230089 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67084c-dea6-4abb-a0ef-4a45da634b24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:40.231696 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67084c-dea6-4abb-a0ef-4a45da634b24 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:40.243721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1247/2465] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:12:40.247969 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ed9db-2d8b-446b-afbc-ff766d8bf0a8 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:40.257059 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ed9db-2d8b-446b-afbc-ff766d8bf0a8 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:40.261721 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693380a-aeb3-4f54-8e37-aa430d80db55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:40.262443 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693380a-aeb3-4f54-8e37-aa430d80db55 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:40.262733 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693380a-aeb3-4f54-8e37-aa430d80db55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:40.263013 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693380a-aeb3-4f54-8e37-aa430d80db55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:40.263733 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693380a-aeb3-4f54-8e37-aa430d80db55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:40.265713 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693380a-aeb3-4f54-8e37-aa430d80db55 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:40.295702 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1219/2466] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:12:40 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:12:40.296991 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67084c-dea6-4abb-a0ef-4a45da634b24 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:40.307939 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67084c-dea6-4abb-a0ef-4a45da634b24 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:40.366519 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce08b8f-9e03-4a98-b065-6e109e7fe08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:40.367215 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce08b8f-9e03-4a98-b065-6e109e7fe08a admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:40.367764 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce08b8f-9e03-4a98-b065-6e109e7fe08a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:40.368037 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce08b8f-9e03-4a98-b065-6e109e7fe08a admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:40.368735 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce08b8f-9e03-4a98-b065-6e109e7fe08a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:40.370681 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce08b8f-9e03-4a98-b065-6e109e7fe08a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:40.377817 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:40.395034 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1248/2467] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:12:40 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:12:40.396637 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693380a-aeb3-4f54-8e37-aa430d80db55 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:40.407043 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693380a-aeb3-4f54-8e37-aa430d80db55 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:40.412514 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d86480-9264-4263-bb03-b7fadffec32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:40.413290 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d86480-9264-4263-bb03-b7fadffec32f admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:40.413613 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d86480-9264-4263-bb03-b7fadffec32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:40.413887 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d86480-9264-4263-bb03-b7fadffec32f admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:40.414615 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d86480-9264-4263-bb03-b7fadffec32f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:40.416251 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d86480-9264-4263-bb03-b7fadffec32f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:40.428497 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1220/2468] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:12:40.432725 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce08b8f-9e03-4a98-b065-6e109e7fe08a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:40.443399 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce08b8f-9e03-4a98-b065-6e109e7fe08a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:40.448705 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b639a67-f262-4e60-b9ab-d5a699952dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:40.449424 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b639a67-f262-4e60-b9ab-d5a699952dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:40.449714 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b639a67-f262-4e60-b9ab-d5a699952dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:40.450014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b639a67-f262-4e60-b9ab-d5a699952dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:40.450911 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b639a67-f262-4e60-b9ab-d5a699952dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:40.452712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b639a67-f262-4e60-b9ab-d5a699952dd9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:40.463429 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1249/2469] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:12:40.467822 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d86480-9264-4263-bb03-b7fadffec32f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:40.478246 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d86480-9264-4263-bb03-b7fadffec32f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:40.484170 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80ead5-1b45-4d07-a5b0-682f69bcb86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:40.485131 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80ead5-1b45-4d07-a5b0-682f69bcb86f admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:40.485412 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80ead5-1b45-4d07-a5b0-682f69bcb86f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:40.485688 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80ead5-1b45-4d07-a5b0-682f69bcb86f admin admin] PATH_INFO: `/v3/projects/c4ea3bd35e124716b72a808b65d21c42/users/c0da8c6c17f64da58b0fcbfa99459d91/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:40.502943 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce80ead5-1b45-4d07-a5b0-682f69bcb86f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4ea3bd35e124716b72a808b65d21c42, user_id=c0da8c6c17f64da58b0fcbfa99459d91, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:40.505976 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce80ead5-1b45-4d07-a5b0-682f69bcb86f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:40.519781 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1221/2470] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:12:40 2022] PUT /identity/v3/projects/c4ea3bd35e124716b72a808b65d21c42/users/c0da8c6c17f64da58b0fcbfa99459d91/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:12:40.530394 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840f75d-341e-4405-8fdf-cd73321c0f7e None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:40.530690 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840f75d-341e-4405-8fdf-cd73321c0f7e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:40.530973 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840f75d-341e-4405-8fdf-cd73321c0f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:40.557798 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9840f75d-341e-4405-8fdf-cd73321c0f7e None None] MFA Rules not processed for user `c0da8c6c17f64da58b0fcbfa99459d91`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:12:40.559022 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9840f75d-341e-4405-8fdf-cd73321c0f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:40.622270 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1250/2471] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:12:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:12:40.633584 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80ead5-1b45-4d07-a5b0-682f69bcb86f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:40.635377 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ce80ead5-1b45-4d07-a5b0-682f69bcb86f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:40.690812 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80ead5-1b45-4d07-a5b0-682f69bcb86f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:40.694441 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd3f3b-e167-4d10-86ab-fb9660aaefb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:40.695077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd3f3b-e167-4d10-86ab-fb9660aaefb0 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:40.695395 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd3f3b-e167-4d10-86ab-fb9660aaefb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:40.695670 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd3f3b-e167-4d10-86ab-fb9660aaefb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:40.703731 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd3f3b-e167-4d10-86ab-fb9660aaefb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:40.705153 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd3f3b-e167-4d10-86ab-fb9660aaefb0 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:40.714135 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1222/2472] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:12:40 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:12:46.607428 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840f75d-341e-4405-8fdf-cd73321c0f7e None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:46.608838 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9840f75d-341e-4405-8fdf-cd73321c0f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:46.671923 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840f75d-341e-4405-8fdf-cd73321c0f7e None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:46.676459 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be87e5-e493-43ce-88fd-fd96bd9b1271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:46.677811 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be87e5-e493-43ce-88fd-fd96bd9b1271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:46.678096 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be87e5-e493-43ce-88fd-fd96bd9b1271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:46.678372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be87e5-e493-43ce-88fd-fd96bd9b1271 admin admin] PATH_INFO: `/v3/users/071e993129a745bfb630e93dbfa0e230` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:46.679594 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be87e5-e493-43ce-88fd-fd96bd9b1271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=071e993129a745bfb630e93dbfa0e230)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:46.681785 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be87e5-e493-43ce-88fd-fd96bd9b1271 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:46.727367 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-57be87e5-e493-43ce-88fd-fd96bd9b1271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '071e993129a745bfb630e93dbfa0e230'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:46.728023 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-57be87e5-e493-43ce-88fd-fd96bd9b1271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '071e993129a745bfb630e93dbfa0e230'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:46.728625 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-57be87e5-e493-43ce-88fd-fd96bd9b1271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '071e993129a745bfb630e93dbfa0e230'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:46.735315 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-57be87e5-e493-43ce-88fd-fd96bd9b1271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '071e993129a745bfb630e93dbfa0e230'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:46.746962 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:46.748199 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-57be87e5-e493-43ce-88fd-fd96bd9b1271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '071e993129a745bfb630e93dbfa0e230'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:46.762417 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1251/2473] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:12:46 2022] DELETE /identity/v3/users/071e993129a745bfb630e93dbfa0e230 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:12:46.766863 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081535f2-d2c3-4c8d-93c1-bef1f535d2a0 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:46.767375 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081535f2-d2c3-4c8d-93c1-bef1f535d2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:46.767520 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081535f2-d2c3-4c8d-93c1-bef1f535d2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:46.784772 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-081535f2-d2c3-4c8d-93c1-bef1f535d2a0 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:12:46.785963 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-081535f2-d2c3-4c8d-93c1-bef1f535d2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:46.842440 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1223/2474] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:12:46.851973 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be87e5-e493-43ce-88fd-fd96bd9b1271 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:46.853346 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-57be87e5-e493-43ce-88fd-fd96bd9b1271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:46.913418 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be87e5-e493-43ce-88fd-fd96bd9b1271 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:46.917085 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c90f8c-38b9-4a07-a098-18f6c4948f96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:46.917730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c90f8c-38b9-4a07-a098-18f6c4948f96 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:46.918011 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c90f8c-38b9-4a07-a098-18f6c4948f96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:46.918283 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c90f8c-38b9-4a07-a098-18f6c4948f96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:46.928202 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c90f8c-38b9-4a07-a098-18f6c4948f96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:46.929704 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c90f8c-38b9-4a07-a098-18f6c4948f96 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:46.939319 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1252/2475] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:12:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:12:47.225234 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081535f2-d2c3-4c8d-93c1-bef1f535d2a0 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:47.227285 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-081535f2-d2c3-4c8d-93c1-bef1f535d2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:47.244892 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081535f2-d2c3-4c8d-93c1-bef1f535d2a0 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:47.262890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f543f06-4210-4f55-9155-51e173699ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:47.263911 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f543f06-4210-4f55-9155-51e173699ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:47.264306 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f543f06-4210-4f55-9155-51e173699ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:47.264763 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f543f06-4210-4f55-9155-51e173699ffb admin admin] PATH_INFO: `/v3/projects/028db92951594c1d9adb2c95a022d894` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:47.266108 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f543f06-4210-4f55-9155-51e173699ffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=028db92951594c1d9adb2c95a022d894)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:47.268259 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f543f06-4210-4f55-9155-51e173699ffb admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:47.286959 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:47.321027 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2f543f06-4210-4f55-9155-51e173699ffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '028db92951594c1d9adb2c95a022d894', 'request_id': 'req-2f543f06-4210-4f55-9155-51e173699ffb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:47.330886 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2f543f06-4210-4f55-9155-51e173699ffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '028db92951594c1d9adb2c95a022d894', 'request_id': 'req-2f543f06-4210-4f55-9155-51e173699ffb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:47.339329 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2f543f06-4210-4f55-9155-51e173699ffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '028db92951594c1d9adb2c95a022d894', 'request_id': 'req-2f543f06-4210-4f55-9155-51e173699ffb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:47.351431 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2f543f06-4210-4f55-9155-51e173699ffb admin admin] The token cache is being invalidate because project 028db92951594c1d9adb2c95a022d894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:12:47.351723 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2f543f06-4210-4f55-9155-51e173699ffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:47.352453 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-2f543f06-4210-4f55-9155-51e173699ffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:47.354005 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1224/2476] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:12:47 2022] DELETE /identity/v3/projects/028db92951594c1d9adb2c95a022d894 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:12:47.357833 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c90f8c-38b9-4a07-a098-18f6c4948f96 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:47.368771 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c90f8c-38b9-4a07-a098-18f6c4948f96 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:47.439380 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbdcd1d-bd45-44c2-b5a6-49b14a80c2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:47.439380 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdcd1d-bd45-44c2-b5a6-49b14a80c2a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:47.439380 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdcd1d-bd45-44c2-b5a6-49b14a80c2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:47.439380 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbdcd1d-bd45-44c2-b5a6-49b14a80c2a2 admin admin] PATH_INFO: `/v3/users/029ac3c92586477fa5a970cd03b1f7aa` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:47.439795 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbdcd1d-bd45-44c2-b5a6-49b14a80c2a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=029ac3c92586477fa5a970cd03b1f7aa)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:47.439795 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbdcd1d-bd45-44c2-b5a6-49b14a80c2a2 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:47.493746 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5cbdcd1d-bd45-44c2-b5a6-49b14a80c2a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '029ac3c92586477fa5a970cd03b1f7aa'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:47.494409 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5cbdcd1d-bd45-44c2-b5a6-49b14a80c2a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '029ac3c92586477fa5a970cd03b1f7aa'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:47.495016 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5cbdcd1d-bd45-44c2-b5a6-49b14a80c2a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '029ac3c92586477fa5a970cd03b1f7aa'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:47.501796 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5cbdcd1d-bd45-44c2-b5a6-49b14a80c2a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '029ac3c92586477fa5a970cd03b1f7aa'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:47.513905 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5cbdcd1d-bd45-44c2-b5a6-49b14a80c2a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '029ac3c92586477fa5a970cd03b1f7aa'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:47.527148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1253/2477] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:12:47 2022] DELETE /identity/v3/users/029ac3c92586477fa5a970cd03b1f7aa => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:12:47.811996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f543f06-4210-4f55-9155-51e173699ffb admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:47.813354 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2f543f06-4210-4f55-9155-51e173699ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:47.827911 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f543f06-4210-4f55-9155-51e173699ffb admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:47.892275 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667dc75f-0d30-4e51-b5bf-1aeb167018aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:47.893148 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dc75f-0d30-4e51-b5bf-1aeb167018aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:47.893438 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dc75f-0d30-4e51-b5bf-1aeb167018aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:47.893718 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667dc75f-0d30-4e51-b5bf-1aeb167018aa admin admin] PATH_INFO: `/v3/projects/8ae9bf44abb54bc78625fe383f4c049a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:47.894925 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667dc75f-0d30-4e51-b5bf-1aeb167018aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ae9bf44abb54bc78625fe383f4c049a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:47.897832 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667dc75f-0d30-4e51-b5bf-1aeb167018aa admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:47.947787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-667dc75f-0d30-4e51-b5bf-1aeb167018aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ae9bf44abb54bc78625fe383f4c049a', 'request_id': 'req-667dc75f-0d30-4e51-b5bf-1aeb167018aa'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:47.955042 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-667dc75f-0d30-4e51-b5bf-1aeb167018aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ae9bf44abb54bc78625fe383f4c049a', 'request_id': 'req-667dc75f-0d30-4e51-b5bf-1aeb167018aa'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:47.961535 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-667dc75f-0d30-4e51-b5bf-1aeb167018aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ae9bf44abb54bc78625fe383f4c049a', 'request_id': 'req-667dc75f-0d30-4e51-b5bf-1aeb167018aa'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:47.972239 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-667dc75f-0d30-4e51-b5bf-1aeb167018aa admin admin] The token cache is being invalidate because project 8ae9bf44abb54bc78625fe383f4c049a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:12:47.972521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-667dc75f-0d30-4e51-b5bf-1aeb167018aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:47.973302 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-667dc75f-0d30-4e51-b5bf-1aeb167018aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:47.975413 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1225/2478] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:12:47 2022] DELETE /identity/v3/projects/8ae9bf44abb54bc78625fe383f4c049a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:12:47.980486 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576d21f-f3d4-4f56-91dc-537e45bc8623 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:47.980968 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576d21f-f3d4-4f56-91dc-537e45bc8623 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:47.981270 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576d21f-f3d4-4f56-91dc-537e45bc8623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:48.001016 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-9576d21f-f3d4-4f56-91dc-537e45bc8623 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:12:48.002380 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9576d21f-f3d4-4f56-91dc-537e45bc8623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:48.009717 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:48.080678 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1254/2479] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:12:48.088927 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960c6df-d9eb-4966-b3d3-25c6f65d8d67 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:48.089230 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960c6df-d9eb-4966-b3d3-25c6f65d8d67 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:48.089569 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960c6df-d9eb-4966-b3d3-25c6f65d8d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:48.108507 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-9960c6df-d9eb-4966-b3d3-25c6f65d8d67 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:12:48.109714 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9960c6df-d9eb-4966-b3d3-25c6f65d8d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:48.119916 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1226/2480] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:12:48.124093 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576d21f-f3d4-4f56-91dc-537e45bc8623 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:48.133809 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576d21f-f3d4-4f56-91dc-537e45bc8623 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:48.138387 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf678f-95b6-401a-bc62-9e540bfa2fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:48.139035 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf678f-95b6-401a-bc62-9e540bfa2fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:48.139412 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf678f-95b6-401a-bc62-9e540bfa2fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:48.139689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf678f-95b6-401a-bc62-9e540bfa2fc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:48.140413 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf678f-95b6-401a-bc62-9e540bfa2fc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:12:48.140715 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf678f-95b6-401a-bc62-9e540bfa2fc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:48.142299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf678f-95b6-401a-bc62-9e540bfa2fc9 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:48.154086 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1255/2481] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:12:48.158192 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960c6df-d9eb-4966-b3d3-25c6f65d8d67 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:48.168123 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960c6df-d9eb-4966-b3d3-25c6f65d8d67 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:48.172764 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c7cdf-59c1-4f81-a7c0-72474beb92a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:48.173410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c7cdf-59c1-4f81-a7c0-72474beb92a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:48.173699 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c7cdf-59c1-4f81-a7c0-72474beb92a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:48.173980 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c7cdf-59c1-4f81-a7c0-72474beb92a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:48.174675 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c7cdf-59c1-4f81-a7c0-72474beb92a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:48.176630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c7cdf-59c1-4f81-a7c0-72474beb92a2 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:48.201451 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1227/2482] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:12:48 2022] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:12:48.205280 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf678f-95b6-401a-bc62-9e540bfa2fc9 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:48.215497 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf678f-95b6-401a-bc62-9e540bfa2fc9 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:48.271338 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8fddb-37e9-450e-9cc4-168647751508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:48.272003 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8fddb-37e9-450e-9cc4-168647751508 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:48.272339 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8fddb-37e9-450e-9cc4-168647751508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:48.272619 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8fddb-37e9-450e-9cc4-168647751508 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:48.273307 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8fddb-37e9-450e-9cc4-168647751508 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:48.275246 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8fddb-37e9-450e-9cc4-168647751508 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:48.295099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1256/2483] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:12:48 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:12:48.299225 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c7cdf-59c1-4f81-a7c0-72474beb92a2 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:48.305897 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:48.310151 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c7cdf-59c1-4f81-a7c0-72474beb92a2 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:48.314935 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007cb3a7-24e2-46a2-96d0-7451b9267a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:48.315872 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cb3a7-24e2-46a2-96d0-7451b9267a05 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:48.316368 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cb3a7-24e2-46a2-96d0-7451b9267a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:48.317130 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cb3a7-24e2-46a2-96d0-7451b9267a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:48.318171 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007cb3a7-24e2-46a2-96d0-7451b9267a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:48.320255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007cb3a7-24e2-46a2-96d0-7451b9267a05 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:48.332187 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1228/2484] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:12:48.336667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8fddb-37e9-450e-9cc4-168647751508 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:48.346478 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8fddb-37e9-450e-9cc4-168647751508 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:48.351941 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c0881-39fe-4a34-b7e3-1df9b362a658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:48.352594 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c0881-39fe-4a34-b7e3-1df9b362a658 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:48.352875 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c0881-39fe-4a34-b7e3-1df9b362a658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:48.353149 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c0881-39fe-4a34-b7e3-1df9b362a658 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:48.353866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c0881-39fe-4a34-b7e3-1df9b362a658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:48.355482 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c0881-39fe-4a34-b7e3-1df9b362a658 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:48.365341 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1257/2485] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:12:48.369913 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007cb3a7-24e2-46a2-96d0-7451b9267a05 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:48.380335 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007cb3a7-24e2-46a2-96d0-7451b9267a05 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:48.385316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fbd59-8eb5-4d52-856d-24ac4c5a59d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:48.386206 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fbd59-8eb5-4d52-856d-24ac4c5a59d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:48.386492 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fbd59-8eb5-4d52-856d-24ac4c5a59d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:48.386770 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fbd59-8eb5-4d52-856d-24ac4c5a59d9 admin admin] PATH_INFO: `/v3/projects/a550d70cbc0545bab117fbc28eae4a35/users/8461c07519ff45d593ee2c182fb8fdcb/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:48.402077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9fbd59-8eb5-4d52-856d-24ac4c5a59d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a550d70cbc0545bab117fbc28eae4a35, user_id=8461c07519ff45d593ee2c182fb8fdcb, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:48.404766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9fbd59-8eb5-4d52-856d-24ac4c5a59d9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:48.417899 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1229/2486] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:12:48 2022] PUT /identity/v3/projects/a550d70cbc0545bab117fbc28eae4a35/users/8461c07519ff45d593ee2c182fb8fdcb/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:12:48.429023 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f45a51-ac14-4d22-8147-77bb2b22acbe None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:48.429429 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f45a51-ac14-4d22-8147-77bb2b22acbe None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:48.429740 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f45a51-ac14-4d22-8147-77bb2b22acbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:48.456208 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-31f45a51-ac14-4d22-8147-77bb2b22acbe None None] MFA Rules not processed for user `8461c07519ff45d593ee2c182fb8fdcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:12:48.457403 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-31f45a51-ac14-4d22-8147-77bb2b22acbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:48.521703 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1258/2487] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:12:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:12:48.526427 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fbd59-8eb5-4d52-856d-24ac4c5a59d9 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:48.587326 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fbd59-8eb5-4d52-856d-24ac4c5a59d9 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:48.592268 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b12e0e-1578-4b24-b879-e98ebe6d3295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:48.592964 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b12e0e-1578-4b24-b879-e98ebe6d3295 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:48.593280 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b12e0e-1578-4b24-b879-e98ebe6d3295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:48.593563 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b12e0e-1578-4b24-b879-e98ebe6d3295 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:48.594264 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b12e0e-1578-4b24-b879-e98ebe6d3295 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:48.596288 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b12e0e-1578-4b24-b879-e98ebe6d3295 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:48.621099 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1230/2488] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:12:48 2022] POST /identity/v3/projects => generated 367 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:12:48.625197 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f45a51-ac14-4d22-8147-77bb2b22acbe None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:48.633041 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:48.638065 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f45a51-ac14-4d22-8147-77bb2b22acbe None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:48.697566 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6847a00-620a-4fb7-ac4e-9be580321c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:48.698236 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6847a00-620a-4fb7-ac4e-9be580321c48 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:48.698521 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6847a00-620a-4fb7-ac4e-9be580321c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:48.698798 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6847a00-620a-4fb7-ac4e-9be580321c48 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:48.699544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6847a00-620a-4fb7-ac4e-9be580321c48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:48.701490 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6847a00-620a-4fb7-ac4e-9be580321c48 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:48.721374 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1259/2489] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:12:48 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:12:48.725396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b12e0e-1578-4b24-b879-e98ebe6d3295 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:48.735424 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b12e0e-1578-4b24-b879-e98ebe6d3295 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:48.739941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f440f19-2536-4b76-896f-ece55344ca64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:48.740585 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f440f19-2536-4b76-896f-ece55344ca64 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:48.740874 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f440f19-2536-4b76-896f-ece55344ca64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:48.741150 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f440f19-2536-4b76-896f-ece55344ca64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:48.741869 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f440f19-2536-4b76-896f-ece55344ca64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:48.743762 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f440f19-2536-4b76-896f-ece55344ca64 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:48.753965 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1231/2490] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:12:48.758381 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6847a00-620a-4fb7-ac4e-9be580321c48 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:48.767956 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6847a00-620a-4fb7-ac4e-9be580321c48 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:48.773386 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309cb25-a94c-4960-9e46-ee130e74a40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:48.774251 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309cb25-a94c-4960-9e46-ee130e74a40a admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:48.774543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309cb25-a94c-4960-9e46-ee130e74a40a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:48.774817 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309cb25-a94c-4960-9e46-ee130e74a40a admin admin] PATH_INFO: `/v3/projects/97da13cad53f49f496ec1739e2c2772a/users/c1fd88dbf1e94fc5b33ddd71275e1f2b/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:48.789342 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309cb25-a94c-4960-9e46-ee130e74a40a admin admin] RBAC: Authorizing `identity:create_grant(project_id=97da13cad53f49f496ec1739e2c2772a, user_id=c1fd88dbf1e94fc5b33ddd71275e1f2b, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:48.792045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309cb25-a94c-4960-9e46-ee130e74a40a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:48.804155 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1260/2491] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:12:48 2022] PUT /identity/v3/projects/97da13cad53f49f496ec1739e2c2772a/users/c1fd88dbf1e94fc5b33ddd71275e1f2b/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:12:48.808135 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f440f19-2536-4b76-896f-ece55344ca64 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:48.818468 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f440f19-2536-4b76-896f-ece55344ca64 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:48.875872 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710d494-f570-403d-b3c7-38a4d010893b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:48.877599 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710d494-f570-403d-b3c7-38a4d010893b admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:48.877886 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710d494-f570-403d-b3c7-38a4d010893b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:48.878187 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710d494-f570-403d-b3c7-38a4d010893b admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:48.878890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710d494-f570-403d-b3c7-38a4d010893b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:48.881082 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710d494-f570-403d-b3c7-38a4d010893b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:48.891949 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1232/2492] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:12:48.896038 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309cb25-a94c-4960-9e46-ee130e74a40a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:48.910287 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309cb25-a94c-4960-9e46-ee130e74a40a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:48.915727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9181b85-0f31-4060-9fb6-c8b684eeec8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:48.916625 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9181b85-0f31-4060-9fb6-c8b684eeec8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:48.916907 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9181b85-0f31-4060-9fb6-c8b684eeec8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:48.917184 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9181b85-0f31-4060-9fb6-c8b684eeec8f admin admin] PATH_INFO: `/v3/projects/97da13cad53f49f496ec1739e2c2772a/users/c1fd88dbf1e94fc5b33ddd71275e1f2b/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:48.919329 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9181b85-0f31-4060-9fb6-c8b684eeec8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=97da13cad53f49f496ec1739e2c2772a, user_id=c1fd88dbf1e94fc5b33ddd71275e1f2b, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:48.922079 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9181b85-0f31-4060-9fb6-c8b684eeec8f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:48.934335 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1261/2493] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:12:48 2022] PUT /identity/v3/projects/97da13cad53f49f496ec1739e2c2772a/users/c1fd88dbf1e94fc5b33ddd71275e1f2b/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:12:48.945529 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e500e97-3d28-4f2c-9cfd-7fa10b437b61 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:48.945830 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e500e97-3d28-4f2c-9cfd-7fa10b437b61 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:48.946110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e500e97-3d28-4f2c-9cfd-7fa10b437b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:48.974392 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2e500e97-3d28-4f2c-9cfd-7fa10b437b61 None None] MFA Rules not processed for user `c1fd88dbf1e94fc5b33ddd71275e1f2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:12:48.975704 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2e500e97-3d28-4f2c-9cfd-7fa10b437b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:49.007110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:49.047513 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1233/2494] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:12:48 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:12:49.059363 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9181b85-0f31-4060-9fb6-c8b684eeec8f admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:49.061055 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c9181b85-0f31-4060-9fb6-c8b684eeec8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:49.121721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9181b85-0f31-4060-9fb6-c8b684eeec8f admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:49.125472 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fef12-f42f-4776-8117-02571a54695c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:49.126185 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fef12-f42f-4776-8117-02571a54695c service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:49.126529 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fef12-f42f-4776-8117-02571a54695c service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:49.126848 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fef12-f42f-4776-8117-02571a54695c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:49.137155 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637fef12-f42f-4776-8117-02571a54695c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:49.138630 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637fef12-f42f-4776-8117-02571a54695c service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:49.148594 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1262/2495] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:12:49 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:12:49.195174 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e500e97-3d28-4f2c-9cfd-7fa10b437b61 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:49.196600 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2e500e97-3d28-4f2c-9cfd-7fa10b437b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:49.208199 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e500e97-3d28-4f2c-9cfd-7fa10b437b61 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:49.211798 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3950cd-5985-467f-8ada-841a789a40b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:49.212428 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3950cd-5985-467f-8ada-841a789a40b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:49.212709 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3950cd-5985-467f-8ada-841a789a40b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:49.212986 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3950cd-5985-467f-8ada-841a789a40b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:49.269728 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3950cd-5985-467f-8ada-841a789a40b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:49.271229 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3950cd-5985-467f-8ada-841a789a40b7 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:49.280073 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1234/2496] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:12:49 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:12:51.150132 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fef12-f42f-4776-8117-02571a54695c service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:51.151559 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-637fef12-f42f-4776-8117-02571a54695c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:51.215530 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fef12-f42f-4776-8117-02571a54695c service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:51.220087 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b6c55-5644-49bc-a21e-02ce6dc85e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:51.220953 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b6c55-5644-49bc-a21e-02ce6dc85e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:51.221240 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b6c55-5644-49bc-a21e-02ce6dc85e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:51.221516 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b6c55-5644-49bc-a21e-02ce6dc85e43 admin admin] PATH_INFO: `/v3/users/c0da8c6c17f64da58b0fcbfa99459d91` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:51.222724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b6c55-5644-49bc-a21e-02ce6dc85e43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0da8c6c17f64da58b0fcbfa99459d91)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:51.225295 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b6c55-5644-49bc-a21e-02ce6dc85e43 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:51.226734 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:51.272454 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5d1b6c55-5644-49bc-a21e-02ce6dc85e43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0da8c6c17f64da58b0fcbfa99459d91'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:51.273112 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5d1b6c55-5644-49bc-a21e-02ce6dc85e43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0da8c6c17f64da58b0fcbfa99459d91'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:51.273746 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5d1b6c55-5644-49bc-a21e-02ce6dc85e43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0da8c6c17f64da58b0fcbfa99459d91'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:51.280560 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5d1b6c55-5644-49bc-a21e-02ce6dc85e43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0da8c6c17f64da58b0fcbfa99459d91'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:51.292978 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5d1b6c55-5644-49bc-a21e-02ce6dc85e43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0da8c6c17f64da58b0fcbfa99459d91'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:51.305008 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1263/2497] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:12:51 2022] DELETE /identity/v3/users/c0da8c6c17f64da58b0fcbfa99459d91 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:12:51.309518 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe08b8-114a-4327-9bd4-fb41ed66e26a None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:51.309956 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe08b8-114a-4327-9bd4-fb41ed66e26a None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:51.310160 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe08b8-114a-4327-9bd4-fb41ed66e26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:51.327406 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-45fe08b8-114a-4327-9bd4-fb41ed66e26a None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:12:51.328638 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-45fe08b8-114a-4327-9bd4-fb41ed66e26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:51.387491 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1235/2498] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:12:51.397709 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b6c55-5644-49bc-a21e-02ce6dc85e43 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:51.399113 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5d1b6c55-5644-49bc-a21e-02ce6dc85e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:51.459846 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b6c55-5644-49bc-a21e-02ce6dc85e43 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:51.463516 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630215f-1608-4878-a434-c11620574630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:51.464155 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630215f-1608-4878-a434-c11620574630 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:51.464438 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630215f-1608-4878-a434-c11620574630 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:51.464717 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630215f-1608-4878-a434-c11620574630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:51.473608 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6630215f-1608-4878-a434-c11620574630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:51.475034 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6630215f-1608-4878-a434-c11620574630 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:51.484362 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1264/2499] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:12:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:12:51.743618 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe08b8-114a-4327-9bd4-fb41ed66e26a None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:51.745084 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-45fe08b8-114a-4327-9bd4-fb41ed66e26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:51.758992 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe08b8-114a-4327-9bd4-fb41ed66e26a None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:51.763692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a690b-9df8-4f4a-85c7-43454a0735dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:51.764565 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a690b-9df8-4f4a-85c7-43454a0735dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:51.764857 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a690b-9df8-4f4a-85c7-43454a0735dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:51.765140 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a690b-9df8-4f4a-85c7-43454a0735dd admin admin] PATH_INFO: `/v3/projects/c4ea3bd35e124716b72a808b65d21c42` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:51.766465 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a690b-9df8-4f4a-85c7-43454a0735dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4ea3bd35e124716b72a808b65d21c42)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:51.768334 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a690b-9df8-4f4a-85c7-43454a0735dd admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:51.814868 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7c8a690b-9df8-4f4a-85c7-43454a0735dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4ea3bd35e124716b72a808b65d21c42', 'request_id': 'req-7c8a690b-9df8-4f4a-85c7-43454a0735dd'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:51.822416 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7c8a690b-9df8-4f4a-85c7-43454a0735dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4ea3bd35e124716b72a808b65d21c42', 'request_id': 'req-7c8a690b-9df8-4f4a-85c7-43454a0735dd'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:51.824465 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:51.830120 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7c8a690b-9df8-4f4a-85c7-43454a0735dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4ea3bd35e124716b72a808b65d21c42', 'request_id': 'req-7c8a690b-9df8-4f4a-85c7-43454a0735dd'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:51.841784 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7c8a690b-9df8-4f4a-85c7-43454a0735dd admin admin] The token cache is being invalidate because project c4ea3bd35e124716b72a808b65d21c42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:12:51.842076 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7c8a690b-9df8-4f4a-85c7-43454a0735dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:51.842728 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-7c8a690b-9df8-4f4a-85c7-43454a0735dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:51.844555 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1236/2500] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:12:51 2022] DELETE /identity/v3/projects/c4ea3bd35e124716b72a808b65d21c42 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:12:51.849186 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750aa25c-ab45-41f7-83e0-1ec20fc11800 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:51.849474 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750aa25c-ab45-41f7-83e0-1ec20fc11800 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:51.849753 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750aa25c-ab45-41f7-83e0-1ec20fc11800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:51.867592 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-750aa25c-ab45-41f7-83e0-1ec20fc11800 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:12:51.868785 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-750aa25c-ab45-41f7-83e0-1ec20fc11800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:51.932218 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1265/2501] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:12:51.939424 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cef55-f845-4344-a408-3a628703fd14 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:51.939750 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cef55-f845-4344-a408-3a628703fd14 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:51.940042 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cef55-f845-4344-a408-3a628703fd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:51.958337 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b08cef55-f845-4344-a408-3a628703fd14 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:12:51.959570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b08cef55-f845-4344-a408-3a628703fd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:51.967940 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1237/2502] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:12:51.971358 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750aa25c-ab45-41f7-83e0-1ec20fc11800 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:51.980720 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750aa25c-ab45-41f7-83e0-1ec20fc11800 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:51.985166 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a040a-17f2-48fb-bf2e-5668e9c6edf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:51.985829 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a040a-17f2-48fb-bf2e-5668e9c6edf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:51.986107 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a040a-17f2-48fb-bf2e-5668e9c6edf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:51.986378 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a040a-17f2-48fb-bf2e-5668e9c6edf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:51.987092 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a040a-17f2-48fb-bf2e-5668e9c6edf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:12:51.987425 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a040a-17f2-48fb-bf2e-5668e9c6edf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:51.989029 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a040a-17f2-48fb-bf2e-5668e9c6edf7 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:52.002013 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1266/2503] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 15:12:52.006887 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cef55-f845-4344-a408-3a628703fd14 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:52.016605 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cef55-f845-4344-a408-3a628703fd14 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:52.021438 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8cdcf0-2f21-4f41-b90a-0d44b4e524f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:52.022090 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cdcf0-2f21-4f41-b90a-0d44b4e524f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:52.022375 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cdcf0-2f21-4f41-b90a-0d44b4e524f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:52.022657 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cdcf0-2f21-4f41-b90a-0d44b4e524f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:52.023388 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8cdcf0-2f21-4f41-b90a-0d44b4e524f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:52.025295 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8cdcf0-2f21-4f41-b90a-0d44b4e524f0 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:52.056777 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1238/2504] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:12:52 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:12:52.058141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a040a-17f2-48fb-bf2e-5668e9c6edf7 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:52.069000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a040a-17f2-48fb-bf2e-5668e9c6edf7 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:52.074241 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:52.136559 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ef55d-8118-48b6-8c99-b9277143718a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:52.137250 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ef55d-8118-48b6-8c99-b9277143718a admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:52.137517 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ef55d-8118-48b6-8c99-b9277143718a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:52.137791 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ef55d-8118-48b6-8c99-b9277143718a admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:52.138502 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ef55d-8118-48b6-8c99-b9277143718a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:52.140443 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ef55d-8118-48b6-8c99-b9277143718a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:52.162351 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1267/2505] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:12:52 2022] POST /identity/v3/users => generated 303 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:12:52.166546 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8cdcf0-2f21-4f41-b90a-0d44b4e524f0 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:52.176501 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8cdcf0-2f21-4f41-b90a-0d44b4e524f0 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:52.181857 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf45115-5461-40ad-b399-db8ef7be6a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:52.182594 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf45115-5461-40ad-b399-db8ef7be6a54 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:52.182819 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf45115-5461-40ad-b399-db8ef7be6a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:52.183107 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf45115-5461-40ad-b399-db8ef7be6a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:52.183911 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf45115-5461-40ad-b399-db8ef7be6a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:52.185763 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf45115-5461-40ad-b399-db8ef7be6a54 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:52.198340 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1239/2506] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:12:52.202490 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ef55d-8118-48b6-8c99-b9277143718a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:52.212368 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ef55d-8118-48b6-8c99-b9277143718a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:52.217176 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c781f5-ce77-4675-b4d1-b12077ea2687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:52.217820 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c781f5-ce77-4675-b4d1-b12077ea2687 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:52.218098 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c781f5-ce77-4675-b4d1-b12077ea2687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:52.218369 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c781f5-ce77-4675-b4d1-b12077ea2687 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:52.219111 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c781f5-ce77-4675-b4d1-b12077ea2687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:52.220728 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c781f5-ce77-4675-b4d1-b12077ea2687 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:52.231074 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1268/2507] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:12:52.235352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf45115-5461-40ad-b399-db8ef7be6a54 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:52.249475 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf45115-5461-40ad-b399-db8ef7be6a54 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:52.253724 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e10e12-f196-4fe6-9c1d-1e35190d4bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:52.254609 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e10e12-f196-4fe6-9c1d-1e35190d4bb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:52.254951 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e10e12-f196-4fe6-9c1d-1e35190d4bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:52.255283 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e10e12-f196-4fe6-9c1d-1e35190d4bb9 admin admin] PATH_INFO: `/v3/projects/775eb8a6344d4a49a9475ca92fee1f5d/users/594096aae0ac43288ece6261385dae84/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:52.271855 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e10e12-f196-4fe6-9c1d-1e35190d4bb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=775eb8a6344d4a49a9475ca92fee1f5d, user_id=594096aae0ac43288ece6261385dae84, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:52.277618 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e10e12-f196-4fe6-9c1d-1e35190d4bb9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:52.291713 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1240/2508] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:12:52 2022] PUT /identity/v3/projects/775eb8a6344d4a49a9475ca92fee1f5d/users/594096aae0ac43288ece6261385dae84/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:12:52.296967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac007843-1a2b-42d9-aa2c-e431fdab919a None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:52.297256 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac007843-1a2b-42d9-aa2c-e431fdab919a None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:52.297533 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac007843-1a2b-42d9-aa2c-e431fdab919a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:52.320004 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ac007843-1a2b-42d9-aa2c-e431fdab919a None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:12:52.321223 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ac007843-1a2b-42d9-aa2c-e431fdab919a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:52.386191 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1269/2509] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:12:52.396222 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e10e12-f196-4fe6-9c1d-1e35190d4bb9 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:52.398013 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-96e10e12-f196-4fe6-9c1d-1e35190d4bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:52.459531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e10e12-f196-4fe6-9c1d-1e35190d4bb9 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:52.463861 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2815429f-23a3-4a74-af77-6616569b8fd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:52.464534 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815429f-23a3-4a74-af77-6616569b8fd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:52.464884 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815429f-23a3-4a74-af77-6616569b8fd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:52.465163 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2815429f-23a3-4a74-af77-6616569b8fd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:52.475122 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2815429f-23a3-4a74-af77-6616569b8fd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:52.476674 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2815429f-23a3-4a74-af77-6616569b8fd7 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:52.486573 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1241/2510] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:12:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:12:52.556260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac007843-1a2b-42d9-aa2c-e431fdab919a None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:52.557807 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ac007843-1a2b-42d9-aa2c-e431fdab919a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:52.569909 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac007843-1a2b-42d9-aa2c-e431fdab919a None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:52.574846 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238459c-ecde-42e1-b987-4b652703d9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:52.575741 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238459c-ecde-42e1-b987-4b652703d9f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:52.576020 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238459c-ecde-42e1-b987-4b652703d9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:52.576317 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238459c-ecde-42e1-b987-4b652703d9f1 admin admin] PATH_INFO: `/v3/users/8461c07519ff45d593ee2c182fb8fdcb` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:52.577558 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2238459c-ecde-42e1-b987-4b652703d9f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8461c07519ff45d593ee2c182fb8fdcb)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:52.579627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2238459c-ecde-42e1-b987-4b652703d9f1 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:52.628021 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-2238459c-ecde-42e1-b987-4b652703d9f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8461c07519ff45d593ee2c182fb8fdcb'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:52.628727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-2238459c-ecde-42e1-b987-4b652703d9f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8461c07519ff45d593ee2c182fb8fdcb'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:52.629349 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-2238459c-ecde-42e1-b987-4b652703d9f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8461c07519ff45d593ee2c182fb8fdcb'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:52.637100 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-2238459c-ecde-42e1-b987-4b652703d9f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8461c07519ff45d593ee2c182fb8fdcb'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:52.655923 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-2238459c-ecde-42e1-b987-4b652703d9f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8461c07519ff45d593ee2c182fb8fdcb'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:52.664999 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:52.669451 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1270/2511] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:12:52 2022] DELETE /identity/v3/users/8461c07519ff45d593ee2c182fb8fdcb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:12:52.674226 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697998b2-4455-4b3c-929a-4d066c9aa3f0 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:52.674523 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697998b2-4455-4b3c-929a-4d066c9aa3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:52.674805 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697998b2-4455-4b3c-929a-4d066c9aa3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:52.693559 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-697998b2-4455-4b3c-929a-4d066c9aa3f0 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:12:52.694703 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-697998b2-4455-4b3c-929a-4d066c9aa3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:52.757252 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1242/2512] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:12:52.767259 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238459c-ecde-42e1-b987-4b652703d9f1 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:52.769214 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2238459c-ecde-42e1-b987-4b652703d9f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:52.836304 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238459c-ecde-42e1-b987-4b652703d9f1 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:52.840093 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9364059-faf2-4cd2-a1f8-c5cf5e5621a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:52.840747 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9364059-faf2-4cd2-a1f8-c5cf5e5621a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:52.841029 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9364059-faf2-4cd2-a1f8-c5cf5e5621a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:52.841303 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9364059-faf2-4cd2-a1f8-c5cf5e5621a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:52.851309 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9364059-faf2-4cd2-a1f8-c5cf5e5621a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:52.853082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9364059-faf2-4cd2-a1f8-c5cf5e5621a6 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:52.863962 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1271/2513] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:12:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:12:53.291162 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003ddca-7deb-42c0-8321-353ec8d58fd6 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:53.291162 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003ddca-7deb-42c0-8321-353ec8d58fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:53.291561 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003ddca-7deb-42c0-8321-353ec8d58fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:53.334881 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9364059-faf2-4cd2-a1f8-c5cf5e5621a6 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:53.336393 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a9364059-faf2-4cd2-a1f8-c5cf5e5621a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:53.336982 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-3003ddca-7deb-42c0-8321-353ec8d58fd6 None None] MFA Rules not processed for user `594096aae0ac43288ece6261385dae84`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:12:53.338347 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3003ddca-7deb-42c0-8321-353ec8d58fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:53.354996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:53.358453 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9364059-faf2-4cd2-a1f8-c5cf5e5621a6 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:53.363663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc509ae-7087-43e1-94f2-b570353757a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:53.364551 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc509ae-7087-43e1-94f2-b570353757a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:53.364830 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc509ae-7087-43e1-94f2-b570353757a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:53.365103 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc509ae-7087-43e1-94f2-b570353757a4 admin admin] PATH_INFO: `/v3/projects/a550d70cbc0545bab117fbc28eae4a35` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:53.366403 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc509ae-7087-43e1-94f2-b570353757a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a550d70cbc0545bab117fbc28eae4a35)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:53.368896 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc509ae-7087-43e1-94f2-b570353757a4 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:53.423289 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6dc509ae-7087-43e1-94f2-b570353757a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a550d70cbc0545bab117fbc28eae4a35', 'request_id': 'req-6dc509ae-7087-43e1-94f2-b570353757a4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:53.429839 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6dc509ae-7087-43e1-94f2-b570353757a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a550d70cbc0545bab117fbc28eae4a35', 'request_id': 'req-6dc509ae-7087-43e1-94f2-b570353757a4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:53.436813 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6dc509ae-7087-43e1-94f2-b570353757a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a550d70cbc0545bab117fbc28eae4a35', 'request_id': 'req-6dc509ae-7087-43e1-94f2-b570353757a4'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:53.451782 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1243/2514] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:12:53 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:12:53.455144 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6dc509ae-7087-43e1-94f2-b570353757a4 admin admin] The token cache is being invalidate because project a550d70cbc0545bab117fbc28eae4a35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:12:53.455464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6dc509ae-7087-43e1-94f2-b570353757a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:53.456245 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6dc509ae-7087-43e1-94f2-b570353757a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:53.456782 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003ddca-7deb-42c0-8321-353ec8d58fd6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:53.458496 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1272/2515] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:12:53 2022] DELETE /identity/v3/projects/a550d70cbc0545bab117fbc28eae4a35 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:12:53.458954 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3003ddca-7deb-42c0-8321-353ec8d58fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:53.461985 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc509ae-7087-43e1-94f2-b570353757a4 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:53.464610 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6dc509ae-7087-43e1-94f2-b570353757a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:53.477662 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003ddca-7deb-42c0-8321-353ec8d58fd6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:53.529541 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc509ae-7087-43e1-94f2-b570353757a4 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:53.534201 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be4b23-43c9-47aa-9423-40a070e03deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:53.535108 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be4b23-43c9-47aa-9423-40a070e03deb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:53.535450 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be4b23-43c9-47aa-9423-40a070e03deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:53.535723 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be4b23-43c9-47aa-9423-40a070e03deb admin admin] PATH_INFO: `/v3/users/c1fd88dbf1e94fc5b33ddd71275e1f2b` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:53.537518 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be4b23-43c9-47aa-9423-40a070e03deb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1fd88dbf1e94fc5b33ddd71275e1f2b)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:53.538153 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe10cc-44f2-4d37-9bdf-26cfce55ea89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:53.538811 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe10cc-44f2-4d37-9bdf-26cfce55ea89 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:53.539093 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe10cc-44f2-4d37-9bdf-26cfce55ea89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:53.539399 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe10cc-44f2-4d37-9bdf-26cfce55ea89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:53.539505 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be4b23-43c9-47aa-9423-40a070e03deb admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:53.540089 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe10cc-44f2-4d37-9bdf-26cfce55ea89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:53.542000 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe10cc-44f2-4d37-9bdf-26cfce55ea89 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:53.568174 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1244/2516] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:12:53 2022] POST /identity/v3/projects => generated 403 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:12:53.572248 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe10cc-44f2-4d37-9bdf-26cfce55ea89 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:53.572951 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:53.574510 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c6fe10cc-44f2-4d37-9bdf-26cfce55ea89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:53.594775 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-24be4b23-43c9-47aa-9423-40a070e03deb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1fd88dbf1e94fc5b33ddd71275e1f2b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:53.595536 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-24be4b23-43c9-47aa-9423-40a070e03deb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1fd88dbf1e94fc5b33ddd71275e1f2b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:53.596159 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-24be4b23-43c9-47aa-9423-40a070e03deb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1fd88dbf1e94fc5b33ddd71275e1f2b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:53.603580 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-24be4b23-43c9-47aa-9423-40a070e03deb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1fd88dbf1e94fc5b33ddd71275e1f2b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:53.616049 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-24be4b23-43c9-47aa-9423-40a070e03deb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1fd88dbf1e94fc5b33ddd71275e1f2b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:53.628626 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1273/2517] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:12:53 2022] DELETE /identity/v3/users/c1fd88dbf1e94fc5b33ddd71275e1f2b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:12:53.642941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe10cc-44f2-4d37-9bdf-26cfce55ea89 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:53.695561 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:53.710970 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa9063-39fe-478e-93da-9c9045bf4f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:53.711678 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa9063-39fe-478e-93da-9c9045bf4f2b admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:53.711958 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa9063-39fe-478e-93da-9c9045bf4f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:53.712229 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa9063-39fe-478e-93da-9c9045bf4f2b admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:53.712924 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa9063-39fe-478e-93da-9c9045bf4f2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:53.714851 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa9063-39fe-478e-93da-9c9045bf4f2b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:53.733642 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1245/2518] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:12:53 2022] POST /identity/v3/users => generated 308 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:12:53.738284 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be4b23-43c9-47aa-9423-40a070e03deb admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:53.739924 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-24be4b23-43c9-47aa-9423-40a070e03deb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:53.753156 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be4b23-43c9-47aa-9423-40a070e03deb admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:53.758985 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1d2b0-b824-47ea-a81d-bd2e62e36af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:53.759713 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1d2b0-b824-47ea-a81d-bd2e62e36af2 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:53.760014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1d2b0-b824-47ea-a81d-bd2e62e36af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:53.760273 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1d2b0-b824-47ea-a81d-bd2e62e36af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:53.761548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1d2b0-b824-47ea-a81d-bd2e62e36af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:53.763151 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1d2b0-b824-47ea-a81d-bd2e62e36af2 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:53.777300 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1274/2519] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:12:53.778615 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa9063-39fe-478e-93da-9c9045bf4f2b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:53.788751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa9063-39fe-478e-93da-9c9045bf4f2b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:53.793930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6b188-abbd-4650-a4ed-1aeff15ec542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:53.794974 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6b188-abbd-4650-a4ed-1aeff15ec542 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:53.795409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6b188-abbd-4650-a4ed-1aeff15ec542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:53.795814 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6b188-abbd-4650-a4ed-1aeff15ec542 admin admin] PATH_INFO: `/v3/projects/890eb142071f41eca07fec390f2b5a89/users/47339a8a163143c68f0fecd2d4d71d71/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:53.811954 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f6b188-abbd-4650-a4ed-1aeff15ec542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=890eb142071f41eca07fec390f2b5a89, user_id=47339a8a163143c68f0fecd2d4d71d71, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:53.814627 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f6b188-abbd-4650-a4ed-1aeff15ec542 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:53.829920 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1246/2520] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:12:53 2022] PUT /identity/v3/projects/890eb142071f41eca07fec390f2b5a89/users/47339a8a163143c68f0fecd2d4d71d71/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:12:53.834456 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1d2b0-b824-47ea-a81d-bd2e62e36af2 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:53.844437 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1d2b0-b824-47ea-a81d-bd2e62e36af2 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:53.901733 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00312ac1-0a8a-45ca-9479-c84fbec7cfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:53.902460 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00312ac1-0a8a-45ca-9479-c84fbec7cfd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:53.902740 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00312ac1-0a8a-45ca-9479-c84fbec7cfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:53.904334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00312ac1-0a8a-45ca-9479-c84fbec7cfd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:53.905071 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00312ac1-0a8a-45ca-9479-c84fbec7cfd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:53.906936 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00312ac1-0a8a-45ca-9479-c84fbec7cfd3 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:53.917490 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6b188-abbd-4650-a4ed-1aeff15ec542 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:53.918106 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1275/2521] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 15:12:53.922899 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a5f6b188-abbd-4650-a4ed-1aeff15ec542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:53.924204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00312ac1-0a8a-45ca-9479-c84fbec7cfd3 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:53.935174 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00312ac1-0a8a-45ca-9479-c84fbec7cfd3 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:53.939955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f48de-3283-4ea9-ab40-9f2eea2be699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:53.940845 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f48de-3283-4ea9-ab40-9f2eea2be699 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:53.941125 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f48de-3283-4ea9-ab40-9f2eea2be699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:53.941407 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f48de-3283-4ea9-ab40-9f2eea2be699 admin admin] PATH_INFO: `/v3/projects/890eb142071f41eca07fec390f2b5a89/users/47339a8a163143c68f0fecd2d4d71d71/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:53.943458 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f48de-3283-4ea9-ab40-9f2eea2be699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=890eb142071f41eca07fec390f2b5a89, user_id=47339a8a163143c68f0fecd2d4d71d71, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:53.946141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f48de-3283-4ea9-ab40-9f2eea2be699 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:53.951383 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6b188-abbd-4650-a4ed-1aeff15ec542 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:53.958449 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1276/2522] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:12:53 2022] PUT /identity/v3/projects/890eb142071f41eca07fec390f2b5a89/users/47339a8a163143c68f0fecd2d4d71d71/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:12:54.015503 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b74ca-18ff-4069-9024-bcb3406ca3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:54.016542 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b74ca-18ff-4069-9024-bcb3406ca3af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:54.016983 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b74ca-18ff-4069-9024-bcb3406ca3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:54.017312 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b74ca-18ff-4069-9024-bcb3406ca3af admin admin] PATH_INFO: `/v3/projects/97da13cad53f49f496ec1739e2c2772a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:54.018617 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b74ca-18ff-4069-9024-bcb3406ca3af admin admin] RBAC: Authorizing `identity:delete_project(project_id=97da13cad53f49f496ec1739e2c2772a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:54.021306 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b74ca-18ff-4069-9024-bcb3406ca3af admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:54.072603 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-532b74ca-18ff-4069-9024-bcb3406ca3af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97da13cad53f49f496ec1739e2c2772a', 'request_id': 'req-532b74ca-18ff-4069-9024-bcb3406ca3af'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:54.080988 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-532b74ca-18ff-4069-9024-bcb3406ca3af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97da13cad53f49f496ec1739e2c2772a', 'request_id': 'req-532b74ca-18ff-4069-9024-bcb3406ca3af'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:54.087930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-532b74ca-18ff-4069-9024-bcb3406ca3af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97da13cad53f49f496ec1739e2c2772a', 'request_id': 'req-532b74ca-18ff-4069-9024-bcb3406ca3af'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:54.099666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-532b74ca-18ff-4069-9024-bcb3406ca3af admin admin] The token cache is being invalidate because project 97da13cad53f49f496ec1739e2c2772a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:12:54.099963 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-532b74ca-18ff-4069-9024-bcb3406ca3af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:54.100684 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-532b74ca-18ff-4069-9024-bcb3406ca3af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:54.102406 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1247/2523] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:12:53 2022] DELETE /identity/v3/projects/97da13cad53f49f496ec1739e2c2772a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:12:54.107493 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebd2dc-e129-420a-b707-7ab1f497c811 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:54.107793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebd2dc-e129-420a-b707-7ab1f497c811 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:54.108155 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebd2dc-e129-420a-b707-7ab1f497c811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:54.128611 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-c1ebd2dc-e129-420a-b707-7ab1f497c811 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:12:54.129860 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c1ebd2dc-e129-420a-b707-7ab1f497c811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:54.190554 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1277/2524] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:12:54.199399 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac12287-4a19-4183-a7a3-93992b982047 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:54.199838 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac12287-4a19-4183-a7a3-93992b982047 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:54.200181 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac12287-4a19-4183-a7a3-93992b982047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:54.220340 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-6ac12287-4a19-4183-a7a3-93992b982047 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:12:54.221849 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-6ac12287-4a19-4183-a7a3-93992b982047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:54.229930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1248/2525] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:12:54.234440 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebd2dc-e129-420a-b707-7ab1f497c811 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:54.245479 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebd2dc-e129-420a-b707-7ab1f497c811 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:54.250166 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a74ce-d5c7-4131-8503-1bf5fa4587ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:54.250827 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a74ce-d5c7-4131-8503-1bf5fa4587ba admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:54.251177 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a74ce-d5c7-4131-8503-1bf5fa4587ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:54.251553 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a74ce-d5c7-4131-8503-1bf5fa4587ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:54.252346 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a74ce-d5c7-4131-8503-1bf5fa4587ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:12:54.252742 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a74ce-d5c7-4131-8503-1bf5fa4587ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:54.254406 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a74ce-d5c7-4131-8503-1bf5fa4587ba admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:54.269066 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1278/2526] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:12:54.273486 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac12287-4a19-4183-a7a3-93992b982047 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:54.285147 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac12287-4a19-4183-a7a3-93992b982047 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:54.291516 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322223e3-b18a-4169-bcef-501aafe7144b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:54.292325 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322223e3-b18a-4169-bcef-501aafe7144b admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:54.292690 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322223e3-b18a-4169-bcef-501aafe7144b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:54.293036 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322223e3-b18a-4169-bcef-501aafe7144b admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:54.293833 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322223e3-b18a-4169-bcef-501aafe7144b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:54.295923 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322223e3-b18a-4169-bcef-501aafe7144b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:54.335671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1249/2527] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:12:54 2022] POST /identity/v3/projects => generated 393 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:12:54.339792 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a74ce-d5c7-4131-8503-1bf5fa4587ba admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:54.346926 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:54.351478 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a74ce-d5c7-4131-8503-1bf5fa4587ba admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:54.417913 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913120e-3d2e-4865-b954-2283379a7000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:54.418596 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913120e-3d2e-4865-b954-2283379a7000 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:54.418885 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913120e-3d2e-4865-b954-2283379a7000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:54.419156 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913120e-3d2e-4865-b954-2283379a7000 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:54.419904 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913120e-3d2e-4865-b954-2283379a7000 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:54.421869 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913120e-3d2e-4865-b954-2283379a7000 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:54.445007 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1279/2528] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:12:54 2022] POST /identity/v3/users => generated 297 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:12:54.449394 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322223e3-b18a-4169-bcef-501aafe7144b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:54.460956 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322223e3-b18a-4169-bcef-501aafe7144b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:54.465879 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf21789-5925-412f-a2bf-536d07bdf53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:54.466568 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf21789-5925-412f-a2bf-536d07bdf53f admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:54.466855 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf21789-5925-412f-a2bf-536d07bdf53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:54.467137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf21789-5925-412f-a2bf-536d07bdf53f admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:54.467930 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf21789-5925-412f-a2bf-536d07bdf53f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:54.469554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf21789-5925-412f-a2bf-536d07bdf53f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:54.481012 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1250/2529] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:12:54.485226 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913120e-3d2e-4865-b954-2283379a7000 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:54.496523 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913120e-3d2e-4865-b954-2283379a7000 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:54.501305 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a66d3-1fb2-439d-82d1-a31f04964064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:54.501913 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a66d3-1fb2-439d-82d1-a31f04964064 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:54.502194 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a66d3-1fb2-439d-82d1-a31f04964064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:54.502473 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a66d3-1fb2-439d-82d1-a31f04964064 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:54.503227 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a66d3-1fb2-439d-82d1-a31f04964064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:54.505344 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a66d3-1fb2-439d-82d1-a31f04964064 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:54.516098 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1280/2530] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:12:54.520463 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf21789-5925-412f-a2bf-536d07bdf53f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:54.527845 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:54.532114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf21789-5925-412f-a2bf-536d07bdf53f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:54.538484 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a02d9-7a5b-4e67-8511-9c5361fcfab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:54.539509 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a02d9-7a5b-4e67-8511-9c5361fcfab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:54.540029 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a02d9-7a5b-4e67-8511-9c5361fcfab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:54.540359 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a02d9-7a5b-4e67-8511-9c5361fcfab9 admin admin] PATH_INFO: `/v3/projects/8a30d531b5994d8995ce6b163133b9cb/users/2939848c61844ef590936a2813cf05b2/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:54.556463 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a02d9-7a5b-4e67-8511-9c5361fcfab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a30d531b5994d8995ce6b163133b9cb, user_id=2939848c61844ef590936a2813cf05b2, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:54.559169 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a02d9-7a5b-4e67-8511-9c5361fcfab9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:54.573868 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1251/2531] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:12:54 2022] PUT /identity/v3/projects/8a30d531b5994d8995ce6b163133b9cb/users/2939848c61844ef590936a2813cf05b2/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:12:54.586409 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42986f10-5912-41a0-be68-cc3d96598355 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:54.586724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42986f10-5912-41a0-be68-cc3d96598355 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:54.587030 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42986f10-5912-41a0-be68-cc3d96598355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:54.614470 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-42986f10-5912-41a0-be68-cc3d96598355 None None] MFA Rules not processed for user `2939848c61844ef590936a2813cf05b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:12:54.615882 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-42986f10-5912-41a0-be68-cc3d96598355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:54.684930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1281/2532] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:12:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:12:54.689625 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a02d9-7a5b-4e67-8511-9c5361fcfab9 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:54.754748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a02d9-7a5b-4e67-8511-9c5361fcfab9 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:54.760173 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30000f87-daf0-4a29-a5a0-a60b8b7822fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:54.761036 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30000f87-daf0-4a29-a5a0-a60b8b7822fd admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:54.761332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30000f87-daf0-4a29-a5a0-a60b8b7822fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:54.761613 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30000f87-daf0-4a29-a5a0-a60b8b7822fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:54.762315 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30000f87-daf0-4a29-a5a0-a60b8b7822fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:54.764303 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30000f87-daf0-4a29-a5a0-a60b8b7822fd admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:54.795313 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1252/2533] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:12:54 2022] POST /identity/v3/projects => generated 393 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:12:54.796793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42986f10-5912-41a0-be68-cc3d96598355 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:54.809224 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42986f10-5912-41a0-be68-cc3d96598355 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:54.843081 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a39f14-9c21-4a26-8424-bf28f6497699 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:54.843467 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a39f14-9c21-4a26-8424-bf28f6497699 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:54.843732 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a39f14-9c21-4a26-8424-bf28f6497699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:54.874907 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d927ab4-ad5b-4e27-8d00-8a0a8a462b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:54.875616 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d927ab4-ad5b-4e27-8d00-8a0a8a462b05 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:54.875898 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d927ab4-ad5b-4e27-8d00-8a0a8a462b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:54.876172 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d927ab4-ad5b-4e27-8d00-8a0a8a462b05 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:54.876896 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d927ab4-ad5b-4e27-8d00-8a0a8a462b05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:54.877004 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-82a39f14-9c21-4a26-8424-bf28f6497699 None None] MFA Rules not processed for user `47339a8a163143c68f0fecd2d4d71d71`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:12:54.878724 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-82a39f14-9c21-4a26-8424-bf28f6497699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:54.878850 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d927ab4-ad5b-4e27-8d00-8a0a8a462b05 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:54.901747 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1282/2534] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:12:54 2022] POST /identity/v3/users => generated 303 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:12:54.905736 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d927ab4-ad5b-4e27-8d00-8a0a8a462b05 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:54.910903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:54.917090 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d927ab4-ad5b-4e27-8d00-8a0a8a462b05 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:54.923468 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0fee2-38f0-4961-913d-e6d7efe548a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:54.924144 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0fee2-38f0-4961-913d-e6d7efe548a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:54.925373 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0fee2-38f0-4961-913d-e6d7efe548a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:54.925656 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0fee2-38f0-4961-913d-e6d7efe548a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:54.926487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0fee2-38f0-4961-913d-e6d7efe548a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:54.928174 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0fee2-38f0-4961-913d-e6d7efe548a2 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:54.939428 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1283/2535] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 15:12:54.943522 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0fee2-38f0-4961-913d-e6d7efe548a2 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:54.953750 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0fee2-38f0-4961-913d-e6d7efe548a2 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:54.972204 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1253/2536] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:12:54 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:12:54.973558 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5fa215-313d-4be0-b1a5-16f87d2648be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:54.974809 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fa215-313d-4be0-b1a5-16f87d2648be admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:54.975102 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fa215-313d-4be0-b1a5-16f87d2648be admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:54.976042 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fa215-313d-4be0-b1a5-16f87d2648be admin admin] PATH_INFO: `/v3/projects/05168dade0d449e8b61ce3dc09e2f0fa/users/94e00d23ad074f85b023784f18142f99/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:54.996446 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5fa215-313d-4be0-b1a5-16f87d2648be admin admin] RBAC: Authorizing `identity:create_grant(project_id=05168dade0d449e8b61ce3dc09e2f0fa, user_id=94e00d23ad074f85b023784f18142f99, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:54.999479 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5fa215-313d-4be0-b1a5-16f87d2648be admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:55.014667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1284/2537] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:12:54 2022] PUT /identity/v3/projects/05168dade0d449e8b61ce3dc09e2f0fa/users/94e00d23ad074f85b023784f18142f99/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:12:55.018625 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a39f14-9c21-4a26-8424-bf28f6497699 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:55.029836 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a39f14-9c21-4a26-8424-bf28f6497699 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:55.079961 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:55.092059 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27bc76-6b94-43ba-8dea-5d8d5033dff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:55.092738 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27bc76-6b94-43ba-8dea-5d8d5033dff9 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:55.093026 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27bc76-6b94-43ba-8dea-5d8d5033dff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:55.093305 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27bc76-6b94-43ba-8dea-5d8d5033dff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:55.094037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b27bc76-6b94-43ba-8dea-5d8d5033dff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:55.095742 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b27bc76-6b94-43ba-8dea-5d8d5033dff9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:55.106952 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1254/2538] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 15:12:55.111118 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5fa215-313d-4be0-b1a5-16f87d2648be admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:55.122588 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5fa215-313d-4be0-b1a5-16f87d2648be admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:55.127426 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0dac61-edc3-4f27-a82a-a8c1b7b7064a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:55.128315 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dac61-edc3-4f27-a82a-a8c1b7b7064a admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:55.128594 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dac61-edc3-4f27-a82a-a8c1b7b7064a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:55.128867 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dac61-edc3-4f27-a82a-a8c1b7b7064a admin admin] PATH_INFO: `/v3/projects/05168dade0d449e8b61ce3dc09e2f0fa/users/94e00d23ad074f85b023784f18142f99/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:55.130909 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0dac61-edc3-4f27-a82a-a8c1b7b7064a admin admin] RBAC: Authorizing `identity:create_grant(project_id=05168dade0d449e8b61ce3dc09e2f0fa, user_id=94e00d23ad074f85b023784f18142f99, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:55.133607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0dac61-edc3-4f27-a82a-a8c1b7b7064a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:55.143990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1285/2539] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:12:55 2022] PUT /identity/v3/projects/05168dade0d449e8b61ce3dc09e2f0fa/users/94e00d23ad074f85b023784f18142f99/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:12:55.154716 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eaeff2-e821-4265-9e26-8ee93a6355d1 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:55.155007 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eaeff2-e821-4265-9e26-8ee93a6355d1 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:55.155347 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eaeff2-e821-4265-9e26-8ee93a6355d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:55.181846 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-81eaeff2-e821-4265-9e26-8ee93a6355d1 None None] MFA Rules not processed for user `94e00d23ad074f85b023784f18142f99`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:12:55.183300 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-81eaeff2-e821-4265-9e26-8ee93a6355d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:55.271504 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1255/2540] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:12:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:12:55.282106 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0dac61-edc3-4f27-a82a-a8c1b7b7064a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:55.283868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1a0dac61-edc3-4f27-a82a-a8c1b7b7064a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:55.354844 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0dac61-edc3-4f27-a82a-a8c1b7b7064a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:55.358557 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662b156-45ce-45b6-9ba1-4c9c7f71845d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:55.359230 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662b156-45ce-45b6-9ba1-4c9c7f71845d service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:55.359508 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662b156-45ce-45b6-9ba1-4c9c7f71845d service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:55.359782 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662b156-45ce-45b6-9ba1-4c9c7f71845d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:55.369222 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662b156-45ce-45b6-9ba1-4c9c7f71845d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:55.370657 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662b156-45ce-45b6-9ba1-4c9c7f71845d service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:55.380591 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1286/2541] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:12:55 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:12:55.429613 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eaeff2-e821-4265-9e26-8ee93a6355d1 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:55.430996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-81eaeff2-e821-4265-9e26-8ee93a6355d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:55.443125 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eaeff2-e821-4265-9e26-8ee93a6355d1 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:55.446831 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086baf8-e6cb-47bf-ada2-548f637cef9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:55.447513 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086baf8-e6cb-47bf-ada2-548f637cef9c service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:55.447796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086baf8-e6cb-47bf-ada2-548f637cef9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:55.448085 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086baf8-e6cb-47bf-ada2-548f637cef9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:55.517325 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086baf8-e6cb-47bf-ada2-548f637cef9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:55.518860 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086baf8-e6cb-47bf-ada2-548f637cef9c service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:55.529441 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1256/2542] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:12:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:12:56.229015 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662b156-45ce-45b6-9ba1-4c9c7f71845d service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:56.230490 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5662b156-45ce-45b6-9ba1-4c9c7f71845d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:56.294385 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662b156-45ce-45b6-9ba1-4c9c7f71845d service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:56.299015 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd3509-c548-424f-9dfb-921185ae6f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:56.299957 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd3509-c548-424f-9dfb-921185ae6f4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:56.300241 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd3509-c548-424f-9dfb-921185ae6f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:56.300546 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd3509-c548-424f-9dfb-921185ae6f4a admin admin] PATH_INFO: `/v3/users/594096aae0ac43288ece6261385dae84` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:56.302300 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd3509-c548-424f-9dfb-921185ae6f4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=594096aae0ac43288ece6261385dae84)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:56.304333 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd3509-c548-424f-9dfb-921185ae6f4a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:56.351687 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4dcd3509-c548-424f-9dfb-921185ae6f4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '594096aae0ac43288ece6261385dae84'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:56.352427 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4dcd3509-c548-424f-9dfb-921185ae6f4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '594096aae0ac43288ece6261385dae84'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:56.352987 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4dcd3509-c548-424f-9dfb-921185ae6f4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '594096aae0ac43288ece6261385dae84'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:56.359965 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4dcd3509-c548-424f-9dfb-921185ae6f4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '594096aae0ac43288ece6261385dae84'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:56.365019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:56.374248 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-4dcd3509-c548-424f-9dfb-921185ae6f4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '594096aae0ac43288ece6261385dae84'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:56.386932 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1287/2543] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:12:56 2022] DELETE /identity/v3/users/594096aae0ac43288ece6261385dae84 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:12:56.559479 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086baf8-e6cb-47bf-ada2-548f637cef9c service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:56.572247 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086baf8-e6cb-47bf-ada2-548f637cef9c service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:56.629467 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c4962-ade3-4e2c-ae0c-cc212fef96b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:56.630449 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c4962-ade3-4e2c-ae0c-cc212fef96b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:56.630732 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c4962-ade3-4e2c-ae0c-cc212fef96b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:56.631008 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c4962-ade3-4e2c-ae0c-cc212fef96b8 admin admin] PATH_INFO: `/v3/projects/775eb8a6344d4a49a9475ca92fee1f5d` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:56.632193 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c4962-ade3-4e2c-ae0c-cc212fef96b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=775eb8a6344d4a49a9475ca92fee1f5d)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:56.634103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c4962-ade3-4e2c-ae0c-cc212fef96b8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:56.644880 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:56.683122 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d25c4962-ade3-4e2c-ae0c-cc212fef96b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '775eb8a6344d4a49a9475ca92fee1f5d', 'request_id': 'req-d25c4962-ade3-4e2c-ae0c-cc212fef96b8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:56.693119 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d25c4962-ade3-4e2c-ae0c-cc212fef96b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '775eb8a6344d4a49a9475ca92fee1f5d', 'request_id': 'req-d25c4962-ade3-4e2c-ae0c-cc212fef96b8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:56.700707 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d25c4962-ade3-4e2c-ae0c-cc212fef96b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '775eb8a6344d4a49a9475ca92fee1f5d', 'request_id': 'req-d25c4962-ade3-4e2c-ae0c-cc212fef96b8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:56.712850 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d25c4962-ade3-4e2c-ae0c-cc212fef96b8 admin admin] The token cache is being invalidate because project 775eb8a6344d4a49a9475ca92fee1f5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:12:56.713358 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d25c4962-ade3-4e2c-ae0c-cc212fef96b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:56.714430 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d25c4962-ade3-4e2c-ae0c-cc212fef96b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:56.716366 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1257/2544] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:12:56 2022] DELETE /identity/v3/projects/775eb8a6344d4a49a9475ca92fee1f5d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:12:56.720467 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd3509-c548-424f-9dfb-921185ae6f4a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:56.722267 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4dcd3509-c548-424f-9dfb-921185ae6f4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:56.736239 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd3509-c548-424f-9dfb-921185ae6f4a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:56.792785 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6e16f-2312-44b8-88a2-52044d8ebd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:56.793662 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6e16f-2312-44b8-88a2-52044d8ebd3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:56.793946 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6e16f-2312-44b8-88a2-52044d8ebd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:56.794228 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6e16f-2312-44b8-88a2-52044d8ebd3d admin admin] PATH_INFO: `/v3/users/47339a8a163143c68f0fecd2d4d71d71` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:56.795449 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6e16f-2312-44b8-88a2-52044d8ebd3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=47339a8a163143c68f0fecd2d4d71d71)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:56.797378 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6e16f-2312-44b8-88a2-52044d8ebd3d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:56.843874 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1af6e16f-2312-44b8-88a2-52044d8ebd3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47339a8a163143c68f0fecd2d4d71d71'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:56.844288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1af6e16f-2312-44b8-88a2-52044d8ebd3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47339a8a163143c68f0fecd2d4d71d71'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:56.844927 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1af6e16f-2312-44b8-88a2-52044d8ebd3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47339a8a163143c68f0fecd2d4d71d71'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:56.853016 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1af6e16f-2312-44b8-88a2-52044d8ebd3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47339a8a163143c68f0fecd2d4d71d71'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:56.865352 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1af6e16f-2312-44b8-88a2-52044d8ebd3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47339a8a163143c68f0fecd2d4d71d71'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:56.877869 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1288/2545] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:12:56 2022] DELETE /identity/v3/users/47339a8a163143c68f0fecd2d4d71d71 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:12:57.074858 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c4962-ade3-4e2c-ae0c-cc212fef96b8 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:57.076200 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d25c4962-ade3-4e2c-ae0c-cc212fef96b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:57.105263 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c4962-ade3-4e2c-ae0c-cc212fef96b8 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:57.181859 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be64bc9-3b21-4a0e-8af6-550bf1733fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:57.182812 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be64bc9-3b21-4a0e-8af6-550bf1733fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:57.183108 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be64bc9-3b21-4a0e-8af6-550bf1733fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:57.183422 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be64bc9-3b21-4a0e-8af6-550bf1733fd8 admin admin] PATH_INFO: `/v3/projects/890eb142071f41eca07fec390f2b5a89` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:57.184754 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be64bc9-3b21-4a0e-8af6-550bf1733fd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=890eb142071f41eca07fec390f2b5a89)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:57.186668 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be64bc9-3b21-4a0e-8af6-550bf1733fd8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:57.248114 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6be64bc9-3b21-4a0e-8af6-550bf1733fd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '890eb142071f41eca07fec390f2b5a89', 'request_id': 'req-6be64bc9-3b21-4a0e-8af6-550bf1733fd8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:57.257097 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6be64bc9-3b21-4a0e-8af6-550bf1733fd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '890eb142071f41eca07fec390f2b5a89', 'request_id': 'req-6be64bc9-3b21-4a0e-8af6-550bf1733fd8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:57.263729 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6be64bc9-3b21-4a0e-8af6-550bf1733fd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '890eb142071f41eca07fec390f2b5a89', 'request_id': 'req-6be64bc9-3b21-4a0e-8af6-550bf1733fd8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:57.279906 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6be64bc9-3b21-4a0e-8af6-550bf1733fd8 admin admin] The token cache is being invalidate because project 890eb142071f41eca07fec390f2b5a89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:12:57.280429 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6be64bc9-3b21-4a0e-8af6-550bf1733fd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:57.281442 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-6be64bc9-3b21-4a0e-8af6-550bf1733fd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:57.283867 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1258/2546] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:12:57 2022] DELETE /identity/v3/projects/890eb142071f41eca07fec390f2b5a89 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:12:57.289925 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4213e0e-67a6-4eca-88c1-06355c8a37f5 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:57.290184 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4213e0e-67a6-4eca-88c1-06355c8a37f5 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:57.290719 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4213e0e-67a6-4eca-88c1-06355c8a37f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:57.336084 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b4213e0e-67a6-4eca-88c1-06355c8a37f5 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:12:57.337306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b4213e0e-67a6-4eca-88c1-06355c8a37f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:57.388708 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:57.403345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1289/2547] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:12:57.419487 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2807a1-410c-4f4f-a9d8-6d27889bd838 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:57.419791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2807a1-410c-4f4f-a9d8-6d27889bd838 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:57.420085 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2807a1-410c-4f4f-a9d8-6d27889bd838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:57.448816 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4c2807a1-410c-4f4f-a9d8-6d27889bd838 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:12:57.450164 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4c2807a1-410c-4f4f-a9d8-6d27889bd838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:57.458505 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1259/2548] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:12:57.463179 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4213e0e-67a6-4eca-88c1-06355c8a37f5 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:57.473520 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4213e0e-67a6-4eca-88c1-06355c8a37f5 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:57.478120 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d617349-45a2-443a-89f8-d4c1387779c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:57.478954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d617349-45a2-443a-89f8-d4c1387779c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:57.479447 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d617349-45a2-443a-89f8-d4c1387779c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:57.479729 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d617349-45a2-443a-89f8-d4c1387779c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:57.480459 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d617349-45a2-443a-89f8-d4c1387779c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:12:57.480766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d617349-45a2-443a-89f8-d4c1387779c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:57.482388 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d617349-45a2-443a-89f8-d4c1387779c0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:57.495235 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1290/2549] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:12:57.498879 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2807a1-410c-4f4f-a9d8-6d27889bd838 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:57.509227 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2807a1-410c-4f4f-a9d8-6d27889bd838 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:57.514166 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2086d-a9a4-4333-aafc-0db0700ad6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:57.514821 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2086d-a9a4-4333-aafc-0db0700ad6ae admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:57.515113 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2086d-a9a4-4333-aafc-0db0700ad6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:57.515443 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2086d-a9a4-4333-aafc-0db0700ad6ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:57.516147 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b2086d-a9a4-4333-aafc-0db0700ad6ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:57.518097 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b2086d-a9a4-4333-aafc-0db0700ad6ae admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:57.544683 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1260/2550] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:12:57 2022] POST /identity/v3/projects => generated 355 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:12:57.548729 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d617349-45a2-443a-89f8-d4c1387779c0 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:57.559057 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d617349-45a2-443a-89f8-d4c1387779c0 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:57.619751 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de172f-0f13-4635-887c-817982eac02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:57.620432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de172f-0f13-4635-887c-817982eac02e admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:57.620740 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de172f-0f13-4635-887c-817982eac02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:57.621022 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de172f-0f13-4635-887c-817982eac02e admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:57.621711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de172f-0f13-4635-887c-817982eac02e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:57.625856 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de172f-0f13-4635-887c-817982eac02e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:57.646507 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1291/2551] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:12:57 2022] POST /identity/v3/users => generated 278 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:12:57.650054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2086d-a9a4-4333-aafc-0db0700ad6ae admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:57.655796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:57.662126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2086d-a9a4-4333-aafc-0db0700ad6ae admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:57.668291 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9e181-420b-4ebb-9599-7f87c43172f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:57.668959 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9e181-420b-4ebb-9599-7f87c43172f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:57.669249 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9e181-420b-4ebb-9599-7f87c43172f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:57.669552 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9e181-420b-4ebb-9599-7f87c43172f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:57.670304 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9e181-420b-4ebb-9599-7f87c43172f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:57.672045 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9e181-420b-4ebb-9599-7f87c43172f6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:57.686064 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1261/2552] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 15:12:57.687278 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de172f-0f13-4635-887c-817982eac02e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:57.698217 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de172f-0f13-4635-887c-817982eac02e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:57.703568 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a434f92-e69e-48f2-9918-70d86992d488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:57.704545 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a434f92-e69e-48f2-9918-70d86992d488 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:57.704837 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a434f92-e69e-48f2-9918-70d86992d488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:57.705114 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a434f92-e69e-48f2-9918-70d86992d488 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:57.705860 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a434f92-e69e-48f2-9918-70d86992d488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:57.708380 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a434f92-e69e-48f2-9918-70d86992d488 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:57.718721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1292/2553] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:12:57.722895 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9e181-420b-4ebb-9599-7f87c43172f6 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:57.733316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9e181-420b-4ebb-9599-7f87c43172f6 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:57.737957 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a5485-9ac5-4715-91d3-8359ab73bb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:57.738832 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a5485-9ac5-4715-91d3-8359ab73bb72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:57.739180 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a5485-9ac5-4715-91d3-8359ab73bb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:57.739634 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a5485-9ac5-4715-91d3-8359ab73bb72 admin admin] PATH_INFO: `/v3/projects/0da0d88701ff459eb0117623a0a7b253/users/8c5a57af83e34c0480616bb7ba8028d6/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:57.754425 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a5485-9ac5-4715-91d3-8359ab73bb72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0da0d88701ff459eb0117623a0a7b253, user_id=8c5a57af83e34c0480616bb7ba8028d6, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:57.757659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a5485-9ac5-4715-91d3-8359ab73bb72 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:57.772070 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1262/2554] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:12:57 2022] PUT /identity/v3/projects/0da0d88701ff459eb0117623a0a7b253/users/8c5a57af83e34c0480616bb7ba8028d6/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:12:57.783272 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd3161-83b6-40ee-8a8f-f1e08ff2b415 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:57.783565 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd3161-83b6-40ee-8a8f-f1e08ff2b415 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:57.783842 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd3161-83b6-40ee-8a8f-f1e08ff2b415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:57.810081 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-33fd3161-83b6-40ee-8a8f-f1e08ff2b415 None None] MFA Rules not processed for user `8c5a57af83e34c0480616bb7ba8028d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:12:57.811369 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-33fd3161-83b6-40ee-8a8f-f1e08ff2b415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:57.879213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1293/2555] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:12:57 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:12:57.884886 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a5485-9ac5-4715-91d3-8359ab73bb72 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:57.947906 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a5485-9ac5-4715-91d3-8359ab73bb72 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:57.952624 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16265a4-a8b3-4b4c-a837-821709b5ff9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:57.953292 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16265a4-a8b3-4b4c-a837-821709b5ff9e admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:57.953580 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16265a4-a8b3-4b4c-a837-821709b5ff9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:57.953859 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16265a4-a8b3-4b4c-a837-821709b5ff9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:57.954559 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16265a4-a8b3-4b4c-a837-821709b5ff9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:57.956524 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16265a4-a8b3-4b4c-a837-821709b5ff9e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:57.987717 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1263/2556] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:12:57 2022] POST /identity/v3/projects => generated 357 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:12:57.989641 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd3161-83b6-40ee-8a8f-f1e08ff2b415 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:58.001111 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd3161-83b6-40ee-8a8f-f1e08ff2b415 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:58.047917 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:58.059631 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9d99a-7931-4009-9d41-85190af52485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:58.060345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9d99a-7931-4009-9d41-85190af52485 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:58.060644 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9d99a-7931-4009-9d41-85190af52485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:58.061343 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9d99a-7931-4009-9d41-85190af52485 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:58.062052 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9d99a-7931-4009-9d41-85190af52485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:58.063986 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9d99a-7931-4009-9d41-85190af52485 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:58.088621 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1294/2557] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:12:57 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:12:58.090003 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16265a4-a8b3-4b4c-a837-821709b5ff9e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:58.100292 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16265a4-a8b3-4b4c-a837-821709b5ff9e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:58.105035 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae132278-7dab-4977-b6e3-bd7935b86034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:58.105682 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae132278-7dab-4977-b6e3-bd7935b86034 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:58.105969 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae132278-7dab-4977-b6e3-bd7935b86034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:58.106251 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae132278-7dab-4977-b6e3-bd7935b86034 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:58.106972 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae132278-7dab-4977-b6e3-bd7935b86034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:58.108608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae132278-7dab-4977-b6e3-bd7935b86034 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:58.120518 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1264/2558] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:12:58.124950 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9d99a-7931-4009-9d41-85190af52485 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:58.136002 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9d99a-7931-4009-9d41-85190af52485 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:58.140667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3d571-cd7f-4e6b-917d-ea09debd14f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:58.141550 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3d571-cd7f-4e6b-917d-ea09debd14f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:58.141832 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3d571-cd7f-4e6b-917d-ea09debd14f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:58.142111 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3d571-cd7f-4e6b-917d-ea09debd14f3 admin admin] PATH_INFO: `/v3/projects/29709c4685fb4963aac836b0705a2358/users/238eda96da274be9a2167dbcfaca7cc1/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:58.158362 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3d571-cd7f-4e6b-917d-ea09debd14f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29709c4685fb4963aac836b0705a2358, user_id=238eda96da274be9a2167dbcfaca7cc1, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:58.161030 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3d571-cd7f-4e6b-917d-ea09debd14f3 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:58.175914 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1295/2559] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:12:58 2022] PUT /identity/v3/projects/29709c4685fb4963aac836b0705a2358/users/238eda96da274be9a2167dbcfaca7cc1/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:12:58.180490 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae132278-7dab-4977-b6e3-bd7935b86034 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:58.191876 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae132278-7dab-4977-b6e3-bd7935b86034 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:58.250923 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f5aad-8697-4bee-9f56-4c5872bf0df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:58.251644 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f5aad-8697-4bee-9f56-4c5872bf0df4 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:58.251940 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f5aad-8697-4bee-9f56-4c5872bf0df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:58.252232 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f5aad-8697-4bee-9f56-4c5872bf0df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:58.252935 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f5aad-8697-4bee-9f56-4c5872bf0df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:58.254575 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f5aad-8697-4bee-9f56-4c5872bf0df4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:58.264184 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1265/2560] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:12:58.268354 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3d571-cd7f-4e6b-917d-ea09debd14f3 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:58.278538 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3d571-cd7f-4e6b-917d-ea09debd14f3 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:58.283191 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832be98-da92-4b10-8a1f-ece6084b6963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:58.284080 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832be98-da92-4b10-8a1f-ece6084b6963 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:58.284370 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832be98-da92-4b10-8a1f-ece6084b6963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:58.284648 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832be98-da92-4b10-8a1f-ece6084b6963 admin admin] PATH_INFO: `/v3/projects/29709c4685fb4963aac836b0705a2358/users/238eda96da274be9a2167dbcfaca7cc1/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:58.287118 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832be98-da92-4b10-8a1f-ece6084b6963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29709c4685fb4963aac836b0705a2358, user_id=238eda96da274be9a2167dbcfaca7cc1, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:58.289789 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832be98-da92-4b10-8a1f-ece6084b6963 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:58.300082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1296/2561] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:12:58 2022] PUT /identity/v3/projects/29709c4685fb4963aac836b0705a2358/users/238eda96da274be9a2167dbcfaca7cc1/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:12:58.310527 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed3483-4adc-4859-91a5-a54c01627680 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:58.310820 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed3483-4adc-4859-91a5-a54c01627680 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:58.311099 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed3483-4adc-4859-91a5-a54c01627680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:58.336945 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-f6ed3483-4adc-4859-91a5-a54c01627680 None None] MFA Rules not processed for user `238eda96da274be9a2167dbcfaca7cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:12:58.338138 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-f6ed3483-4adc-4859-91a5-a54c01627680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:58.365401 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:58.408638 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1266/2562] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:12:58 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:12:58.420426 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832be98-da92-4b10-8a1f-ece6084b6963 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:58.423079 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e832be98-da92-4b10-8a1f-ece6084b6963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:58.479734 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832be98-da92-4b10-8a1f-ece6084b6963 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:58.483504 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04dff3-1e19-49da-82cb-2db61b6ce562 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:58.484160 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04dff3-1e19-49da-82cb-2db61b6ce562 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:58.484444 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04dff3-1e19-49da-82cb-2db61b6ce562 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:58.484727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04dff3-1e19-49da-82cb-2db61b6ce562 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:58.494949 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f04dff3-1e19-49da-82cb-2db61b6ce562 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:58.496421 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f04dff3-1e19-49da-82cb-2db61b6ce562 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:58.507758 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1297/2563] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:12:58 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:12:58.580289 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed3483-4adc-4859-91a5-a54c01627680 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:58.591338 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed3483-4adc-4859-91a5-a54c01627680 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:58.595039 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad3c8a-8cce-49ed-a880-8f071038a95a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:58.595724 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad3c8a-8cce-49ed-a880-8f071038a95a service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:58.596010 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad3c8a-8cce-49ed-a880-8f071038a95a service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:58.596285 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad3c8a-8cce-49ed-a880-8f071038a95a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:58.655966 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad3c8a-8cce-49ed-a880-8f071038a95a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:58.657541 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad3c8a-8cce-49ed-a880-8f071038a95a service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:58.667602 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1267/2564] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:12:58 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:12:58.962742 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04dff3-1e19-49da-82cb-2db61b6ce562 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:58.964204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2f04dff3-1e19-49da-82cb-2db61b6ce562 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:59.028896 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04dff3-1e19-49da-82cb-2db61b6ce562 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:59.033355 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0370b22-2d44-4470-aba7-b13d7f36c751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:59.034218 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0370b22-2d44-4470-aba7-b13d7f36c751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:59.034502 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0370b22-2d44-4470-aba7-b13d7f36c751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:59.034777 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0370b22-2d44-4470-aba7-b13d7f36c751 admin admin] PATH_INFO: `/v3/users/2939848c61844ef590936a2813cf05b2` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:59.035994 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0370b22-2d44-4470-aba7-b13d7f36c751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2939848c61844ef590936a2813cf05b2)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:59.037904 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0370b22-2d44-4470-aba7-b13d7f36c751 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:59.084320 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a0370b22-2d44-4470-aba7-b13d7f36c751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2939848c61844ef590936a2813cf05b2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:59.084967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a0370b22-2d44-4470-aba7-b13d7f36c751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2939848c61844ef590936a2813cf05b2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:59.085581 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a0370b22-2d44-4470-aba7-b13d7f36c751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2939848c61844ef590936a2813cf05b2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:59.087182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:59.093249 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a0370b22-2d44-4470-aba7-b13d7f36c751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2939848c61844ef590936a2813cf05b2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:59.105422 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a0370b22-2d44-4470-aba7-b13d7f36c751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2939848c61844ef590936a2813cf05b2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:59.117883 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1298/2565] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:12:58 2022] DELETE /identity/v3/users/2939848c61844ef590936a2813cf05b2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:12:59.122993 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2fbb0-baf7-4d51-9ada-d9341b295b8f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:59.123414 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2fbb0-baf7-4d51-9ada-d9341b295b8f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:59.123718 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2fbb0-baf7-4d51-9ada-d9341b295b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:59.142234 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b0f2fbb0-baf7-4d51-9ada-d9341b295b8f None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:12:59.143460 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b0f2fbb0-baf7-4d51-9ada-d9341b295b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:59.202150 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1268/2566] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:12:59.212470 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0370b22-2d44-4470-aba7-b13d7f36c751 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:59.213935 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a0370b22-2d44-4470-aba7-b13d7f36c751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:59.272319 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0370b22-2d44-4470-aba7-b13d7f36c751 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:59.275991 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8ee50-d2b6-49be-b44f-d35601cd98be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:59.276637 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8ee50-d2b6-49be-b44f-d35601cd98be service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:59.276923 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8ee50-d2b6-49be-b44f-d35601cd98be service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:59.277201 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8ee50-d2b6-49be-b44f-d35601cd98be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:59.286288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8ee50-d2b6-49be-b44f-d35601cd98be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:59.287754 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8ee50-d2b6-49be-b44f-d35601cd98be service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:59.298885 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1299/2567] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:12:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 15:12:59.589024 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2fbb0-baf7-4d51-9ada-d9341b295b8f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:59.590986 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b0f2fbb0-baf7-4d51-9ada-d9341b295b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:12:59.609755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2fbb0-baf7-4d51-9ada-d9341b295b8f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:59.616156 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3271385-b9b9-4cc0-8acc-50ca38e1a6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:59.617036 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3271385-b9b9-4cc0-8acc-50ca38e1a6fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:59.617581 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3271385-b9b9-4cc0-8acc-50ca38e1a6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:59.617882 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3271385-b9b9-4cc0-8acc-50ca38e1a6fa admin admin] PATH_INFO: `/v3/projects/8a30d531b5994d8995ce6b163133b9cb` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:59.619051 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3271385-b9b9-4cc0-8acc-50ca38e1a6fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a30d531b5994d8995ce6b163133b9cb)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:59.621025 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3271385-b9b9-4cc0-8acc-50ca38e1a6fa admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:59.669036 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d3271385-b9b9-4cc0-8acc-50ca38e1a6fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a30d531b5994d8995ce6b163133b9cb', 'request_id': 'req-d3271385-b9b9-4cc0-8acc-50ca38e1a6fa'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:59.676389 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d3271385-b9b9-4cc0-8acc-50ca38e1a6fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a30d531b5994d8995ce6b163133b9cb', 'request_id': 'req-d3271385-b9b9-4cc0-8acc-50ca38e1a6fa'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:59.677606 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:59.684432 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d3271385-b9b9-4cc0-8acc-50ca38e1a6fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a30d531b5994d8995ce6b163133b9cb', 'request_id': 'req-d3271385-b9b9-4cc0-8acc-50ca38e1a6fa'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:59.696805 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d3271385-b9b9-4cc0-8acc-50ca38e1a6fa admin admin] The token cache is being invalidate because project 8a30d531b5994d8995ce6b163133b9cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:12:59.697099 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d3271385-b9b9-4cc0-8acc-50ca38e1a6fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:59.697754 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d3271385-b9b9-4cc0-8acc-50ca38e1a6fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:59.699568 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1269/2568] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:12:59 2022] DELETE /identity/v3/projects/8a30d531b5994d8995ce6b163133b9cb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:12:59.703884 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8ee50-d2b6-49be-b44f-d35601cd98be service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:12:59.713812 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8ee50-d2b6-49be-b44f-d35601cd98be service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:12:59.767753 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7243611-8e9b-4722-8c20-ba9c62d9d1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:12:59.768609 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7243611-8e9b-4722-8c20-ba9c62d9d1f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:12:59.768891 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7243611-8e9b-4722-8c20-ba9c62d9d1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:12:59.769165 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7243611-8e9b-4722-8c20-ba9c62d9d1f4 admin admin] PATH_INFO: `/v3/users/94e00d23ad074f85b023784f18142f99` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:12:59.770971 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7243611-8e9b-4722-8c20-ba9c62d9d1f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94e00d23ad074f85b023784f18142f99)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:12:59.772901 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7243611-8e9b-4722-8c20-ba9c62d9d1f4 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:12:59.820464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c7243611-8e9b-4722-8c20-ba9c62d9d1f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94e00d23ad074f85b023784f18142f99'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:59.821131 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c7243611-8e9b-4722-8c20-ba9c62d9d1f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94e00d23ad074f85b023784f18142f99'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:59.821929 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c7243611-8e9b-4722-8c20-ba9c62d9d1f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94e00d23ad074f85b023784f18142f99'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:59.832244 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c7243611-8e9b-4722-8c20-ba9c62d9d1f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94e00d23ad074f85b023784f18142f99'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:59.844608 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:59.845856 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c7243611-8e9b-4722-8c20-ba9c62d9d1f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94e00d23ad074f85b023784f18142f99'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:12:59.864212 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1300/2569] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:12:59 2022] DELETE /identity/v3/users/94e00d23ad074f85b023784f18142f99 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:00.159316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3271385-b9b9-4cc0-8acc-50ca38e1a6fa admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:00.160819 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d3271385-b9b9-4cc0-8acc-50ca38e1a6fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:00.178534 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3271385-b9b9-4cc0-8acc-50ca38e1a6fa admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:00.246948 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379963ab-89ca-4886-988a-76df7acb8809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:00.247784 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379963ab-89ca-4886-988a-76df7acb8809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:00.248072 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379963ab-89ca-4886-988a-76df7acb8809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:00.248351 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379963ab-89ca-4886-988a-76df7acb8809 admin admin] PATH_INFO: `/v3/projects/05168dade0d449e8b61ce3dc09e2f0fa` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:00.249518 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379963ab-89ca-4886-988a-76df7acb8809 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05168dade0d449e8b61ce3dc09e2f0fa)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:00.251477 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379963ab-89ca-4886-988a-76df7acb8809 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:00.295927 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-379963ab-89ca-4886-988a-76df7acb8809 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05168dade0d449e8b61ce3dc09e2f0fa', 'request_id': 'req-379963ab-89ca-4886-988a-76df7acb8809'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:00.303363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-379963ab-89ca-4886-988a-76df7acb8809 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05168dade0d449e8b61ce3dc09e2f0fa', 'request_id': 'req-379963ab-89ca-4886-988a-76df7acb8809'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:00.309493 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-379963ab-89ca-4886-988a-76df7acb8809 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05168dade0d449e8b61ce3dc09e2f0fa', 'request_id': 'req-379963ab-89ca-4886-988a-76df7acb8809'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:00.320850 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-379963ab-89ca-4886-988a-76df7acb8809 admin admin] The token cache is being invalidate because project 05168dade0d449e8b61ce3dc09e2f0fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:13:00.321141 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-379963ab-89ca-4886-988a-76df7acb8809 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:00.321794 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-379963ab-89ca-4886-988a-76df7acb8809 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:00.323360 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1270/2570] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:13:00 2022] DELETE /identity/v3/projects/05168dade0d449e8b61ce3dc09e2f0fa => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:00.328280 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0a554-977d-454d-a192-eaf0d589bc55 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:00.328531 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0a554-977d-454d-a192-eaf0d589bc55 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:00.328826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0a554-977d-454d-a192-eaf0d589bc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:00.346585 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-bac0a554-977d-454d-a192-eaf0d589bc55 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:00.347812 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-bac0a554-977d-454d-a192-eaf0d589bc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:00.406519 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1301/2571] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:13:00.414475 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e08a9-ae08-4b04-bf46-1c17ef1802d3 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:00.414777 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e08a9-ae08-4b04-bf46-1c17ef1802d3 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:00.415060 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e08a9-ae08-4b04-bf46-1c17ef1802d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:00.433583 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-998e08a9-ae08-4b04-bf46-1c17ef1802d3 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:00.434794 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-998e08a9-ae08-4b04-bf46-1c17ef1802d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:00.443253 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1271/2572] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:13:00.447328 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0a554-977d-454d-a192-eaf0d589bc55 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:00.456741 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0a554-977d-454d-a192-eaf0d589bc55 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:00.461397 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ac397-93c8-4fd5-915b-2154b7578776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:00.462049 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ac397-93c8-4fd5-915b-2154b7578776 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:00.462334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ac397-93c8-4fd5-915b-2154b7578776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:00.462607 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ac397-93c8-4fd5-915b-2154b7578776 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:00.463399 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ac397-93c8-4fd5-915b-2154b7578776 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:13:00.463734 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ac397-93c8-4fd5-915b-2154b7578776 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:00.465360 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ac397-93c8-4fd5-915b-2154b7578776 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:00.477395 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1302/2573] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:13:00.481376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e08a9-ae08-4b04-bf46-1c17ef1802d3 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:00.491659 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e08a9-ae08-4b04-bf46-1c17ef1802d3 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:00.496641 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efdc9e-b13e-483b-827d-cfb3051d33e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:00.497346 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efdc9e-b13e-483b-827d-cfb3051d33e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:00.497578 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efdc9e-b13e-483b-827d-cfb3051d33e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:00.497858 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efdc9e-b13e-483b-827d-cfb3051d33e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:00.498552 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6efdc9e-b13e-483b-827d-cfb3051d33e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:00.500499 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6efdc9e-b13e-483b-827d-cfb3051d33e1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:00.526685 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1272/2574] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:13:00 2022] POST /identity/v3/projects => generated 407 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:13:00.530999 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ac397-93c8-4fd5-915b-2154b7578776 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:00.541419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ac397-93c8-4fd5-915b-2154b7578776 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:00.597989 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba11ea-d962-4729-9105-051be9209c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:00.599308 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba11ea-d962-4729-9105-051be9209c51 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:00.599598 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba11ea-d962-4729-9105-051be9209c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:00.599873 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba11ea-d962-4729-9105-051be9209c51 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:00.600580 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba11ea-d962-4729-9105-051be9209c51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:00.602509 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba11ea-d962-4729-9105-051be9209c51 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:00.623791 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1303/2575] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:13:00 2022] POST /identity/v3/users => generated 304 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:13:00.627944 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efdc9e-b13e-483b-827d-cfb3051d33e1 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:00.638349 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efdc9e-b13e-483b-827d-cfb3051d33e1 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:00.643077 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294aa651-7ef7-405e-be99-26e8d577abb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:00.643799 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294aa651-7ef7-405e-be99-26e8d577abb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:00.644091 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294aa651-7ef7-405e-be99-26e8d577abb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:00.644376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294aa651-7ef7-405e-be99-26e8d577abb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:00.645188 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294aa651-7ef7-405e-be99-26e8d577abb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:00.646800 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294aa651-7ef7-405e-be99-26e8d577abb8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:00.657501 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1273/2576] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:13:00.662040 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba11ea-d962-4729-9105-051be9209c51 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:00.671947 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba11ea-d962-4729-9105-051be9209c51 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:00.677153 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ad7c4-45e7-486f-bf15-8f53a832c629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:00.677881 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ad7c4-45e7-486f-bf15-8f53a832c629 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:00.678161 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ad7c4-45e7-486f-bf15-8f53a832c629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:00.678431 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ad7c4-45e7-486f-bf15-8f53a832c629 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:00.679160 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ad7c4-45e7-486f-bf15-8f53a832c629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:00.680782 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ad7c4-45e7-486f-bf15-8f53a832c629 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:00.690913 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1304/2577] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:13:00.695866 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294aa651-7ef7-405e-be99-26e8d577abb8 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:00.706333 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294aa651-7ef7-405e-be99-26e8d577abb8 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:00.712062 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429b01c-8dcd-4e26-bd64-152c4897e0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:00.713044 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429b01c-8dcd-4e26-bd64-152c4897e0b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:00.713329 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429b01c-8dcd-4e26-bd64-152c4897e0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:00.713716 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429b01c-8dcd-4e26-bd64-152c4897e0b7 admin admin] PATH_INFO: `/v3/projects/213499510cd946cf99fef8233eba148f/users/7077cd5b9e28460ca7aa2c249063b313/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:00.729908 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429b01c-8dcd-4e26-bd64-152c4897e0b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=213499510cd946cf99fef8233eba148f, user_id=7077cd5b9e28460ca7aa2c249063b313, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:00.732698 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429b01c-8dcd-4e26-bd64-152c4897e0b7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:00.746138 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1274/2578] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:13:00 2022] PUT /identity/v3/projects/213499510cd946cf99fef8233eba148f/users/7077cd5b9e28460ca7aa2c249063b313/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:00.758263 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016e42e-3fa6-4198-9971-7be820a3a5bc None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:00.758784 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016e42e-3fa6-4198-9971-7be820a3a5bc None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:00.758784 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016e42e-3fa6-4198-9971-7be820a3a5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:00.785182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e016e42e-3fa6-4198-9971-7be820a3a5bc None None] MFA Rules not processed for user `7077cd5b9e28460ca7aa2c249063b313`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:00.786894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e016e42e-3fa6-4198-9971-7be820a3a5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:00.829661 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:00.854939 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1305/2579] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:00 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:13:00.859527 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429b01c-8dcd-4e26-bd64-152c4897e0b7 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:00.872525 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:00.922491 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429b01c-8dcd-4e26-bd64-152c4897e0b7 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:00.927280 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717a52b-132d-425d-b24f-603f838353aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:00.927939 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717a52b-132d-425d-b24f-603f838353aa admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:00.928225 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717a52b-132d-425d-b24f-603f838353aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:00.928505 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717a52b-132d-425d-b24f-603f838353aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:00.929202 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717a52b-132d-425d-b24f-603f838353aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:00.931113 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717a52b-132d-425d-b24f-603f838353aa admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:00.955400 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1275/2580] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:13:00 2022] POST /identity/v3/projects => generated 407 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:13:00.959921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016e42e-3fa6-4198-9971-7be820a3a5bc None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:00.970405 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016e42e-3fa6-4198-9971-7be820a3a5bc None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:01.030716 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ee905-1841-46ca-aa38-4ed4c4d4def4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:01.031419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ee905-1841-46ca-aa38-4ed4c4d4def4 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:01.031713 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ee905-1841-46ca-aa38-4ed4c4d4def4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:01.032061 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ee905-1841-46ca-aa38-4ed4c4d4def4 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:01.032841 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ee905-1841-46ca-aa38-4ed4c4d4def4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:01.034868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ee905-1841-46ca-aa38-4ed4c4d4def4 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:01.058192 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1306/2581] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:13:00 2022] POST /identity/v3/users => generated 310 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:13:01.059701 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717a52b-132d-425d-b24f-603f838353aa admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:01.069860 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717a52b-132d-425d-b24f-603f838353aa admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:01.074516 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c8d59-b3b9-4d93-b73d-de0be0e55b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:01.075169 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c8d59-b3b9-4d93-b73d-de0be0e55b2e admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:01.075489 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c8d59-b3b9-4d93-b73d-de0be0e55b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:01.075764 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c8d59-b3b9-4d93-b73d-de0be0e55b2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:01.076484 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c8d59-b3b9-4d93-b73d-de0be0e55b2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:01.078074 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c8d59-b3b9-4d93-b73d-de0be0e55b2e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:01.091356 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1276/2582] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:13:01.095525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ee905-1841-46ca-aa38-4ed4c4d4def4 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:01.106274 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ee905-1841-46ca-aa38-4ed4c4d4def4 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:01.110894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc9196-2f58-4ecb-b594-252a9b55deab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:01.111820 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc9196-2f58-4ecb-b594-252a9b55deab admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:01.112102 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc9196-2f58-4ecb-b594-252a9b55deab admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:01.112373 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc9196-2f58-4ecb-b594-252a9b55deab admin admin] PATH_INFO: `/v3/projects/4104b0b19acc4675863e7d4927d7582b/users/33cba930d7fc41e48e7a9dfccedf00fc/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:01.128619 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc9196-2f58-4ecb-b594-252a9b55deab admin admin] RBAC: Authorizing `identity:create_grant(project_id=4104b0b19acc4675863e7d4927d7582b, user_id=33cba930d7fc41e48e7a9dfccedf00fc, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:01.131323 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc9196-2f58-4ecb-b594-252a9b55deab admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:01.145877 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1307/2583] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:13:01 2022] PUT /identity/v3/projects/4104b0b19acc4675863e7d4927d7582b/users/33cba930d7fc41e48e7a9dfccedf00fc/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:01.150129 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c8d59-b3b9-4d93-b73d-de0be0e55b2e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:01.160056 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c8d59-b3b9-4d93-b73d-de0be0e55b2e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:01.220546 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e23070-343c-48bb-ba92-763655617b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:01.221218 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e23070-343c-48bb-ba92-763655617b52 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:01.221501 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e23070-343c-48bb-ba92-763655617b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:01.221774 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e23070-343c-48bb-ba92-763655617b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:01.222496 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e23070-343c-48bb-ba92-763655617b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:01.224182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e23070-343c-48bb-ba92-763655617b52 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:01.234694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1277/2584] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:13:01.239229 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc9196-2f58-4ecb-b594-252a9b55deab admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:01.250188 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc9196-2f58-4ecb-b594-252a9b55deab admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:01.255707 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31f443-4897-4d72-a563-bca95cea7bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:01.256636 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31f443-4897-4d72-a563-bca95cea7bb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:01.257012 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31f443-4897-4d72-a563-bca95cea7bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:01.257287 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31f443-4897-4d72-a563-bca95cea7bb5 admin admin] PATH_INFO: `/v3/projects/4104b0b19acc4675863e7d4927d7582b/users/33cba930d7fc41e48e7a9dfccedf00fc/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:01.259457 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31f443-4897-4d72-a563-bca95cea7bb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4104b0b19acc4675863e7d4927d7582b, user_id=33cba930d7fc41e48e7a9dfccedf00fc, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:01.262148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31f443-4897-4d72-a563-bca95cea7bb5 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:01.273626 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1308/2585] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:13:01 2022] PUT /identity/v3/projects/4104b0b19acc4675863e7d4927d7582b/users/33cba930d7fc41e48e7a9dfccedf00fc/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:01.284823 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd04a70-5b9c-4f13-a27f-62634e1b012c None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:01.285142 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd04a70-5b9c-4f13-a27f-62634e1b012c None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:01.285406 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd04a70-5b9c-4f13-a27f-62634e1b012c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:01.335266 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1fd04a70-5b9c-4f13-a27f-62634e1b012c None None] MFA Rules not processed for user `33cba930d7fc41e48e7a9dfccedf00fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:01.336622 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1fd04a70-5b9c-4f13-a27f-62634e1b012c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:01.419815 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1278/2586] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:01 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:13:01.431704 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31f443-4897-4d72-a563-bca95cea7bb5 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:01.433425 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-fb31f443-4897-4d72-a563-bca95cea7bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:01.489796 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31f443-4897-4d72-a563-bca95cea7bb5 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:01.493711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fe49e-5ab7-40e8-bf1f-eec88d2d84ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:01.494344 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fe49e-5ab7-40e8-bf1f-eec88d2d84ad service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:01.494626 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fe49e-5ab7-40e8-bf1f-eec88d2d84ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:01.494906 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fe49e-5ab7-40e8-bf1f-eec88d2d84ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:01.504351 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fe49e-5ab7-40e8-bf1f-eec88d2d84ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:01.505829 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fe49e-5ab7-40e8-bf1f-eec88d2d84ad service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:01.515275 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1309/2587] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:13:01 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:13:01.670482 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd04a70-5b9c-4f13-a27f-62634e1b012c None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:01.680018 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd04a70-5b9c-4f13-a27f-62634e1b012c None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:01.683544 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2978c-4038-4aea-86b3-711d9a0aec62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:01.684181 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2978c-4038-4aea-86b3-711d9a0aec62 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:01.684466 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2978c-4038-4aea-86b3-711d9a0aec62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:01.684745 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2978c-4038-4aea-86b3-711d9a0aec62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:01.688785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:01.751503 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2978c-4038-4aea-86b3-711d9a0aec62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:01.753056 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2978c-4038-4aea-86b3-711d9a0aec62 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:01.762274 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1279/2588] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:13:01 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:13:09.210944 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fe49e-5ab7-40e8-bf1f-eec88d2d84ad service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:09.257894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:09.281685 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fe49e-5ab7-40e8-bf1f-eec88d2d84ad service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:09.286860 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778b924-4cc9-4628-bfed-47e9b4347d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:09.287846 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778b924-4cc9-4628-bfed-47e9b4347d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:09.288132 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778b924-4cc9-4628-bfed-47e9b4347d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:09.288410 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778b924-4cc9-4628-bfed-47e9b4347d99 admin admin] PATH_INFO: `/v3/users/7077cd5b9e28460ca7aa2c249063b313` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:09.289628 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778b924-4cc9-4628-bfed-47e9b4347d99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7077cd5b9e28460ca7aa2c249063b313)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:09.291595 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778b924-4cc9-4628-bfed-47e9b4347d99 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:09.383859 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c778b924-4cc9-4628-bfed-47e9b4347d99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7077cd5b9e28460ca7aa2c249063b313'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:09.384760 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c778b924-4cc9-4628-bfed-47e9b4347d99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7077cd5b9e28460ca7aa2c249063b313'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:09.385746 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c778b924-4cc9-4628-bfed-47e9b4347d99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7077cd5b9e28460ca7aa2c249063b313'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:09.396787 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c778b924-4cc9-4628-bfed-47e9b4347d99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7077cd5b9e28460ca7aa2c249063b313'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:09.414879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c778b924-4cc9-4628-bfed-47e9b4347d99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7077cd5b9e28460ca7aa2c249063b313'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:09.432845 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1310/2589] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:13:09 2022] DELETE /identity/v3/users/7077cd5b9e28460ca7aa2c249063b313 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:09.437891 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766c697-e14f-496c-a3cc-cb0778fb8bda None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:09.438560 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766c697-e14f-496c-a3cc-cb0778fb8bda None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:09.438976 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766c697-e14f-496c-a3cc-cb0778fb8bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:09.459090 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-b766c697-e14f-496c-a3cc-cb0778fb8bda None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:09.460480 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b766c697-e14f-496c-a3cc-cb0778fb8bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:09.539960 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1280/2590] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:13:09.549414 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778b924-4cc9-4628-bfed-47e9b4347d99 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:09.550848 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c778b924-4cc9-4628-bfed-47e9b4347d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:09.607116 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778b924-4cc9-4628-bfed-47e9b4347d99 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:09.612441 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f0455-2a30-473b-9806-fc9bc3a81004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:09.613217 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f0455-2a30-473b-9806-fc9bc3a81004 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:09.613555 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f0455-2a30-473b-9806-fc9bc3a81004 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:09.613838 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f0455-2a30-473b-9806-fc9bc3a81004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:09.624438 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f0455-2a30-473b-9806-fc9bc3a81004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:09.625485 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f0455-2a30-473b-9806-fc9bc3a81004 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:09.636586 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1311/2591] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:13:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:13:09.919337 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766c697-e14f-496c-a3cc-cb0778fb8bda None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:09.920799 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b766c697-e14f-496c-a3cc-cb0778fb8bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:09.933441 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766c697-e14f-496c-a3cc-cb0778fb8bda None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:09.938173 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620a396-717b-435e-8d90-1877712f0602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:09.939050 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620a396-717b-435e-8d90-1877712f0602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:09.939400 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620a396-717b-435e-8d90-1877712f0602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:09.939682 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620a396-717b-435e-8d90-1877712f0602 admin admin] PATH_INFO: `/v3/projects/213499510cd946cf99fef8233eba148f` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:09.941097 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620a396-717b-435e-8d90-1877712f0602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=213499510cd946cf99fef8233eba148f)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:09.943750 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620a396-717b-435e-8d90-1877712f0602 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:09.996422 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c620a396-717b-435e-8d90-1877712f0602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '213499510cd946cf99fef8233eba148f', 'request_id': 'req-c620a396-717b-435e-8d90-1877712f0602'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:10.005156 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c620a396-717b-435e-8d90-1877712f0602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '213499510cd946cf99fef8233eba148f', 'request_id': 'req-c620a396-717b-435e-8d90-1877712f0602'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:10.011656 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c620a396-717b-435e-8d90-1877712f0602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '213499510cd946cf99fef8233eba148f', 'request_id': 'req-c620a396-717b-435e-8d90-1877712f0602'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:10.022285 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c620a396-717b-435e-8d90-1877712f0602 admin admin] The token cache is being invalidate because project 213499510cd946cf99fef8233eba148f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:13:10.022621 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c620a396-717b-435e-8d90-1877712f0602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:10.023300 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-c620a396-717b-435e-8d90-1877712f0602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:10.024862 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1281/2592] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:13:09 2022] DELETE /identity/v3/projects/213499510cd946cf99fef8233eba148f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:10.029200 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f0455-2a30-473b-9806-fc9bc3a81004 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:10.039333 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f0455-2a30-473b-9806-fc9bc3a81004 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:10.103048 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a5450-449c-4344-b80e-cea5118156bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:10.103998 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a5450-449c-4344-b80e-cea5118156bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:10.104283 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a5450-449c-4344-b80e-cea5118156bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:10.104555 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a5450-449c-4344-b80e-cea5118156bd admin admin] PATH_INFO: `/v3/users/33cba930d7fc41e48e7a9dfccedf00fc` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:10.107096 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a5450-449c-4344-b80e-cea5118156bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=33cba930d7fc41e48e7a9dfccedf00fc)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:10.121148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a5450-449c-4344-b80e-cea5118156bd admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:10.121148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:10.170382 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-391a5450-449c-4344-b80e-cea5118156bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33cba930d7fc41e48e7a9dfccedf00fc'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:10.171956 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-391a5450-449c-4344-b80e-cea5118156bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33cba930d7fc41e48e7a9dfccedf00fc'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:10.172966 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-391a5450-449c-4344-b80e-cea5118156bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33cba930d7fc41e48e7a9dfccedf00fc'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:10.183873 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-391a5450-449c-4344-b80e-cea5118156bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33cba930d7fc41e48e7a9dfccedf00fc'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:10.201282 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-391a5450-449c-4344-b80e-cea5118156bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33cba930d7fc41e48e7a9dfccedf00fc'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:10.216815 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1312/2593] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:13:10 2022] DELETE /identity/v3/users/33cba930d7fc41e48e7a9dfccedf00fc => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:10.595320 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a5c83-3cfa-4bea-8b4d-0b7452798c60 None None] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:10.595890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a5c83-3cfa-4bea-8b4d-0b7452798c60 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:10.596126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a5c83-3cfa-4bea-8b4d-0b7452798c60 None None] PATH_INFO: `/` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:10.597852 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1282/2594] 10.222.0.24 () {54 vars in 921 bytes} [Thu May 19 15:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 19 15:13:10.604920 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702249ef-95f3-467b-9760-384c309d05a3 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:10.605380 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702249ef-95f3-467b-9760-384c309d05a3 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:10.605760 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702249ef-95f3-467b-9760-384c309d05a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:10.632847 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-702249ef-95f3-467b-9760-384c309d05a3 None None] MFA Rules not processed for user `06fb8bb5aeb143ad95f33c3b43dbd346`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:10.634087 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-702249ef-95f3-467b-9760-384c309d05a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:10.739162 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1313/2595] 10.222.0.24 () {58 vars in 1018 bytes} [Thu May 19 15:13:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:13:10.751792 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a5c83-3cfa-4bea-8b4d-0b7452798c60 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:10.753794 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-482a5c83-3cfa-4bea-8b4d-0b7452798c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:10.763068 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702249ef-95f3-467b-9760-384c309d05a3 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:10.764886 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-702249ef-95f3-467b-9760-384c309d05a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:10.790959 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:10.828029 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a5c83-3cfa-4bea-8b4d-0b7452798c60 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:10.833562 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeaa238-39ba-4c69-966b-50104a1f19fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:10.834343 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeaa238-39ba-4c69-966b-50104a1f19fc service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:10.834703 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeaa238-39ba-4c69-966b-50104a1f19fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:10.835058 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeaa238-39ba-4c69-966b-50104a1f19fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:10.853649 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeaa238-39ba-4c69-966b-50104a1f19fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:10.855417 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeaa238-39ba-4c69-966b-50104a1f19fc service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:10.862956 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702249ef-95f3-467b-9760-384c309d05a3 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:10.867064 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1283/2596] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:13:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 15:13:10.872418 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe199e-9a2c-4d61-a003-9eeb2dd3407d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:10.873392 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe199e-9a2c-4d61-a003-9eeb2dd3407d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:10.873675 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe199e-9a2c-4d61-a003-9eeb2dd3407d admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:10.873951 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe199e-9a2c-4d61-a003-9eeb2dd3407d admin admin] PATH_INFO: `/v3/projects/4104b0b19acc4675863e7d4927d7582b` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:10.875190 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbe199e-9a2c-4d61-a003-9eeb2dd3407d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4104b0b19acc4675863e7d4927d7582b)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:10.877737 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbe199e-9a2c-4d61-a003-9eeb2dd3407d admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:10.889989 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:10.933137 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ebbe199e-9a2c-4d61-a003-9eeb2dd3407d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4104b0b19acc4675863e7d4927d7582b', 'request_id': 'req-ebbe199e-9a2c-4d61-a003-9eeb2dd3407d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:10.943874 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ebbe199e-9a2c-4d61-a003-9eeb2dd3407d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4104b0b19acc4675863e7d4927d7582b', 'request_id': 'req-ebbe199e-9a2c-4d61-a003-9eeb2dd3407d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:10.950617 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ebbe199e-9a2c-4d61-a003-9eeb2dd3407d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4104b0b19acc4675863e7d4927d7582b', 'request_id': 'req-ebbe199e-9a2c-4d61-a003-9eeb2dd3407d'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:10.966666 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ebbe199e-9a2c-4d61-a003-9eeb2dd3407d admin admin] The token cache is being invalidate because project 4104b0b19acc4675863e7d4927d7582b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:13:10.967010 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ebbe199e-9a2c-4d61-a003-9eeb2dd3407d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:10.968006 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-ebbe199e-9a2c-4d61-a003-9eeb2dd3407d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:10.971269 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1314/2597] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:13:10 2022] DELETE /identity/v3/projects/4104b0b19acc4675863e7d4927d7582b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:10.974810 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4632d-9c11-4332-960c-b1ffa4ff9dc2 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:10.975115 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4632d-9c11-4332-960c-b1ffa4ff9dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:10.975483 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4632d-9c11-4332-960c-b1ffa4ff9dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:10.996652 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-02f4632d-9c11-4332-960c-b1ffa4ff9dc2 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:10.997929 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-02f4632d-9c11-4332-960c-b1ffa4ff9dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:11.075584 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1284/2598] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:13:11.085000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9cc27-1611-4c2c-b6da-355c0d009d99 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:11.085293 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9cc27-1611-4c2c-b6da-355c0d009d99 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:11.085568 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9cc27-1611-4c2c-b6da-355c0d009d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:11.104499 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f1c9cc27-1611-4c2c-b6da-355c0d009d99 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:11.105788 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f1c9cc27-1611-4c2c-b6da-355c0d009d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:11.114904 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1315/2599] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:13:11.120426 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4632d-9c11-4332-960c-b1ffa4ff9dc2 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:11.131533 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4632d-9c11-4332-960c-b1ffa4ff9dc2 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:11.136361 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb7324-e2cc-41b2-b20c-cce059320d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:11.137534 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb7324-e2cc-41b2-b20c-cce059320d0b admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:11.137822 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb7324-e2cc-41b2-b20c-cce059320d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:11.138124 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb7324-e2cc-41b2-b20c-cce059320d0b admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:11.138857 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb7324-e2cc-41b2-b20c-cce059320d0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:13:11.139173 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb7324-e2cc-41b2-b20c-cce059320d0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:11.140974 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb7324-e2cc-41b2-b20c-cce059320d0b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:11.153970 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1285/2600] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:13:11.158801 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9cc27-1611-4c2c-b6da-355c0d009d99 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:11.168431 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9cc27-1611-4c2c-b6da-355c0d009d99 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:11.173468 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5d475-8124-4720-9436-44395adce49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:11.174123 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5d475-8124-4720-9436-44395adce49b admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:11.174416 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5d475-8124-4720-9436-44395adce49b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:11.174691 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5d475-8124-4720-9436-44395adce49b admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:11.175489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5d475-8124-4720-9436-44395adce49b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:11.177365 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5d475-8124-4720-9436-44395adce49b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:11.205494 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1316/2601] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:13:11 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:13:11.210335 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb7324-e2cc-41b2-b20c-cce059320d0b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:11.220601 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb7324-e2cc-41b2-b20c-cce059320d0b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:11.282759 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9c990-48ee-4961-830f-6f46381d242e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:11.283498 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9c990-48ee-4961-830f-6f46381d242e admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:11.283787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9c990-48ee-4961-830f-6f46381d242e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:11.284065 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9c990-48ee-4961-830f-6f46381d242e admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:11.284824 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc9c990-48ee-4961-830f-6f46381d242e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:11.286776 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc9c990-48ee-4961-830f-6f46381d242e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:11.308241 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1286/2602] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:13:11 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:13:11.312448 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5d475-8124-4720-9436-44395adce49b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:11.325709 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5d475-8124-4720-9436-44395adce49b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:11.330401 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97393c9b-e091-44fd-853f-8fc8b4f77050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:11.331067 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97393c9b-e091-44fd-853f-8fc8b4f77050 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:11.331390 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97393c9b-e091-44fd-853f-8fc8b4f77050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:11.331670 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97393c9b-e091-44fd-853f-8fc8b4f77050 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:11.332999 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97393c9b-e091-44fd-853f-8fc8b4f77050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:11.334602 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97393c9b-e091-44fd-853f-8fc8b4f77050 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:11.345139 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1317/2603] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:13:11.349289 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9c990-48ee-4961-830f-6f46381d242e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:11.359579 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9c990-48ee-4961-830f-6f46381d242e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:11.365066 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9148c7-eeef-4d34-9110-8a1d0f25d284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:11.365737 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9148c7-eeef-4d34-9110-8a1d0f25d284 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:11.366051 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9148c7-eeef-4d34-9110-8a1d0f25d284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:11.366330 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9148c7-eeef-4d34-9110-8a1d0f25d284 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:11.367062 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9148c7-eeef-4d34-9110-8a1d0f25d284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:11.368977 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9148c7-eeef-4d34-9110-8a1d0f25d284 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:11.380170 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1287/2604] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:13:11.384400 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97393c9b-e091-44fd-853f-8fc8b4f77050 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:11.396635 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97393c9b-e091-44fd-853f-8fc8b4f77050 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:11.401482 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda6aac-fa1f-43d9-8fa2-15e62e5699b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:11.402363 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda6aac-fa1f-43d9-8fa2-15e62e5699b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:11.402649 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda6aac-fa1f-43d9-8fa2-15e62e5699b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:11.402929 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda6aac-fa1f-43d9-8fa2-15e62e5699b2 admin admin] PATH_INFO: `/v3/projects/c23fe8faf0764d828bde5297a60d4cbd/users/3cc75c7238ca4f969f72c110aaab6a65/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:11.418554 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda6aac-fa1f-43d9-8fa2-15e62e5699b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c23fe8faf0764d828bde5297a60d4cbd, user_id=3cc75c7238ca4f969f72c110aaab6a65, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:11.421363 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda6aac-fa1f-43d9-8fa2-15e62e5699b2 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:11.433853 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1318/2605] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:13:11 2022] PUT /identity/v3/projects/c23fe8faf0764d828bde5297a60d4cbd/users/3cc75c7238ca4f969f72c110aaab6a65/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:11.444153 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951e7f3-6599-4679-9c78-e87542514b1e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:11.444447 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951e7f3-6599-4679-9c78-e87542514b1e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:11.444757 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951e7f3-6599-4679-9c78-e87542514b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:11.474306 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-5951e7f3-6599-4679-9c78-e87542514b1e None None] MFA Rules not processed for user `3cc75c7238ca4f969f72c110aaab6a65`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:11.475643 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5951e7f3-6599-4679-9c78-e87542514b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:11.501554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:11.542494 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1288/2606] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:13:11.547026 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda6aac-fa1f-43d9-8fa2-15e62e5699b2 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:11.611798 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda6aac-fa1f-43d9-8fa2-15e62e5699b2 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:11.616868 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142a1b2-f2a4-4b9a-ad5c-caba4a3f73e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:11.617783 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142a1b2-f2a4-4b9a-ad5c-caba4a3f73e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:11.618102 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142a1b2-f2a4-4b9a-ad5c-caba4a3f73e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:11.618418 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142a1b2-f2a4-4b9a-ad5c-caba4a3f73e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:11.619110 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142a1b2-f2a4-4b9a-ad5c-caba4a3f73e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:11.621050 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142a1b2-f2a4-4b9a-ad5c-caba4a3f73e0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:11.648657 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1319/2607] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:13:11 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:13:11.650766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951e7f3-6599-4679-9c78-e87542514b1e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:11.663561 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951e7f3-6599-4679-9c78-e87542514b1e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:11.726878 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2bfbd-388f-4ef4-8ddf-afcea591d78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:11.727585 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2bfbd-388f-4ef4-8ddf-afcea591d78f admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:11.727870 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2bfbd-388f-4ef4-8ddf-afcea591d78f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:11.728145 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2bfbd-388f-4ef4-8ddf-afcea591d78f admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:11.728909 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2bfbd-388f-4ef4-8ddf-afcea591d78f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:11.735761 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2bfbd-388f-4ef4-8ddf-afcea591d78f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:11.756573 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1289/2608] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:13:11 2022] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:13:11.760440 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142a1b2-f2a4-4b9a-ad5c-caba4a3f73e0 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:11.772843 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142a1b2-f2a4-4b9a-ad5c-caba4a3f73e0 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:11.777840 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a50fc3-faf9-4c2d-b44f-65119eea8c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:11.778499 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a50fc3-faf9-4c2d-b44f-65119eea8c05 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:11.778779 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a50fc3-faf9-4c2d-b44f-65119eea8c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:11.779054 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a50fc3-faf9-4c2d-b44f-65119eea8c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:11.779804 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a50fc3-faf9-4c2d-b44f-65119eea8c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:11.781379 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a50fc3-faf9-4c2d-b44f-65119eea8c05 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:11.792613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1320/2609] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 15:13:11.796746 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2bfbd-388f-4ef4-8ddf-afcea591d78f admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:11.819571 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2bfbd-388f-4ef4-8ddf-afcea591d78f admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:11.829116 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ce9d9-1fd1-4ce9-b051-31e3a1f531d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:11.833307 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ce9d9-1fd1-4ce9-b051-31e3a1f531d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:11.835228 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ce9d9-1fd1-4ce9-b051-31e3a1f531d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:11.835610 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ce9d9-1fd1-4ce9-b051-31e3a1f531d4 admin admin] PATH_INFO: `/v3/projects/65233050ac674533bc24ae9d40f21492/users/ee01b5ed9991495d9cad126201f6b68b/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:11.883799 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ce9d9-1fd1-4ce9-b051-31e3a1f531d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65233050ac674533bc24ae9d40f21492, user_id=ee01b5ed9991495d9cad126201f6b68b, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:11.891112 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ce9d9-1fd1-4ce9-b051-31e3a1f531d4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:11.928593 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1290/2610] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:13:11 2022] PUT /identity/v3/projects/65233050ac674533bc24ae9d40f21492/users/ee01b5ed9991495d9cad126201f6b68b/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:11.931314 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a50fc3-faf9-4c2d-b44f-65119eea8c05 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:11.943898 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a50fc3-faf9-4c2d-b44f-65119eea8c05 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:11.954098 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:12.061993 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda7888-c39c-4255-9523-b045b6828d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:12.062694 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda7888-c39c-4255-9523-b045b6828d07 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:12.062979 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda7888-c39c-4255-9523-b045b6828d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:12.063280 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda7888-c39c-4255-9523-b045b6828d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:12.064024 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda7888-c39c-4255-9523-b045b6828d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:12.065801 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda7888-c39c-4255-9523-b045b6828d07 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:12.078490 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1321/2611] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:13:12.084227 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ce9d9-1fd1-4ce9-b051-31e3a1f531d4 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:12.096104 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ce9d9-1fd1-4ce9-b051-31e3a1f531d4 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:12.101925 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d2bae-2f5e-4ee0-b018-90d143733add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:12.103012 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d2bae-2f5e-4ee0-b018-90d143733add admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:12.103132 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d2bae-2f5e-4ee0-b018-90d143733add admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:12.103408 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d2bae-2f5e-4ee0-b018-90d143733add admin admin] PATH_INFO: `/v3/projects/65233050ac674533bc24ae9d40f21492/users/ee01b5ed9991495d9cad126201f6b68b/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:12.105400 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d2bae-2f5e-4ee0-b018-90d143733add admin admin] RBAC: Authorizing `identity:create_grant(project_id=65233050ac674533bc24ae9d40f21492, user_id=ee01b5ed9991495d9cad126201f6b68b, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:12.108112 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d2bae-2f5e-4ee0-b018-90d143733add admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:12.128690 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1291/2612] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:13:12 2022] PUT /identity/v3/projects/65233050ac674533bc24ae9d40f21492/users/ee01b5ed9991495d9cad126201f6b68b/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:13:12.139899 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8365d-eb1e-423e-a835-aefc98144ae8 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:12.140247 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8365d-eb1e-423e-a835-aefc98144ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:12.140535 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8365d-eb1e-423e-a835-aefc98144ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:12.167418 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-85f8365d-eb1e-423e-a835-aefc98144ae8 None None] MFA Rules not processed for user `ee01b5ed9991495d9cad126201f6b68b`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:12.168687 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-85f8365d-eb1e-423e-a835-aefc98144ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:12.235364 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1322/2613] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:13:12.248182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d2bae-2f5e-4ee0-b018-90d143733add admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:12.249937 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-598d2bae-2f5e-4ee0-b018-90d143733add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:12.312615 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d2bae-2f5e-4ee0-b018-90d143733add admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:12.316305 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da1206-ee89-48a8-9108-828b72315430 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:12.317832 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da1206-ee89-48a8-9108-828b72315430 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:12.317832 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da1206-ee89-48a8-9108-828b72315430 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:12.318123 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da1206-ee89-48a8-9108-828b72315430 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:12.327767 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da1206-ee89-48a8-9108-828b72315430 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:12.329972 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da1206-ee89-48a8-9108-828b72315430 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:12.340107 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1292/2614] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:13:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:13:12.415776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8365d-eb1e-423e-a835-aefc98144ae8 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:12.425794 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8365d-eb1e-423e-a835-aefc98144ae8 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:12.430007 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa2861-06bc-4046-8e70-881cc96ffa6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:12.430660 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa2861-06bc-4046-8e70-881cc96ffa6c service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:12.430944 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa2861-06bc-4046-8e70-881cc96ffa6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:12.431248 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa2861-06bc-4046-8e70-881cc96ffa6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:12.489815 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa2861-06bc-4046-8e70-881cc96ffa6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:12.491290 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa2861-06bc-4046-8e70-881cc96ffa6c service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:12.500753 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1323/2615] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:13:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:13:12.782394 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da1206-ee89-48a8-9108-828b72315430 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:12.815698 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:12.855592 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da1206-ee89-48a8-9108-828b72315430 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:12.860230 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ee89b-2532-4cc3-a59c-59c4fd763b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:12.861104 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ee89b-2532-4cc3-a59c-59c4fd763b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:12.861393 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ee89b-2532-4cc3-a59c-59c4fd763b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:12.861680 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ee89b-2532-4cc3-a59c-59c4fd763b7d admin admin] PATH_INFO: `/v3/users/3cc75c7238ca4f969f72c110aaab6a65` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:12.862860 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ee89b-2532-4cc3-a59c-59c4fd763b7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cc75c7238ca4f969f72c110aaab6a65)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:12.864952 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177ee89b-2532-4cc3-a59c-59c4fd763b7d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:12.914011 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-177ee89b-2532-4cc3-a59c-59c4fd763b7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cc75c7238ca4f969f72c110aaab6a65'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:12.921388 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-177ee89b-2532-4cc3-a59c-59c4fd763b7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cc75c7238ca4f969f72c110aaab6a65'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:12.936856 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-177ee89b-2532-4cc3-a59c-59c4fd763b7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cc75c7238ca4f969f72c110aaab6a65'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:12.938018 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-177ee89b-2532-4cc3-a59c-59c4fd763b7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cc75c7238ca4f969f72c110aaab6a65'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:12.939192 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-177ee89b-2532-4cc3-a59c-59c4fd763b7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cc75c7238ca4f969f72c110aaab6a65'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:12.958492 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1293/2616] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:13:12 2022] DELETE /identity/v3/users/3cc75c7238ca4f969f72c110aaab6a65 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:12.963665 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613b12b-ebf9-4943-a6de-6a3dfbe0f597 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:12.963963 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613b12b-ebf9-4943-a6de-6a3dfbe0f597 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:12.964245 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613b12b-ebf9-4943-a6de-6a3dfbe0f597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:12.981890 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-3613b12b-ebf9-4943-a6de-6a3dfbe0f597 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:12.983099 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3613b12b-ebf9-4943-a6de-6a3dfbe0f597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:13.011854 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:13.045569 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1324/2617] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:13:13.056029 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ee89b-2532-4cc3-a59c-59c4fd763b7d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:13.057438 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-177ee89b-2532-4cc3-a59c-59c4fd763b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:13.123548 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ee89b-2532-4cc3-a59c-59c4fd763b7d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:13.127725 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414b9ce-d41d-4007-ada1-5487c9c2522b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:13.128388 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414b9ce-d41d-4007-ada1-5487c9c2522b service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:13.128677 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414b9ce-d41d-4007-ada1-5487c9c2522b service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:13.128958 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414b9ce-d41d-4007-ada1-5487c9c2522b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:13.139903 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414b9ce-d41d-4007-ada1-5487c9c2522b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:13.140907 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414b9ce-d41d-4007-ada1-5487c9c2522b service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:13.151348 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1294/2618] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:13:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:13:13.456265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613b12b-ebf9-4943-a6de-6a3dfbe0f597 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:13.458337 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3613b12b-ebf9-4943-a6de-6a3dfbe0f597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:13.486951 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613b12b-ebf9-4943-a6de-6a3dfbe0f597 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:13.491708 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5a1e2-c53f-46b8-b0e0-71315107085f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:13.493005 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5a1e2-c53f-46b8-b0e0-71315107085f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:13.493289 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5a1e2-c53f-46b8-b0e0-71315107085f admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:13.493685 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5a1e2-c53f-46b8-b0e0-71315107085f admin admin] PATH_INFO: `/v3/projects/c23fe8faf0764d828bde5297a60d4cbd` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:13.494864 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be5a1e2-c53f-46b8-b0e0-71315107085f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c23fe8faf0764d828bde5297a60d4cbd)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:13.496832 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be5a1e2-c53f-46b8-b0e0-71315107085f admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:13.552191 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9be5a1e2-c53f-46b8-b0e0-71315107085f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c23fe8faf0764d828bde5297a60d4cbd', 'request_id': 'req-9be5a1e2-c53f-46b8-b0e0-71315107085f'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:13.557629 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9be5a1e2-c53f-46b8-b0e0-71315107085f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c23fe8faf0764d828bde5297a60d4cbd', 'request_id': 'req-9be5a1e2-c53f-46b8-b0e0-71315107085f'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:13.563741 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9be5a1e2-c53f-46b8-b0e0-71315107085f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c23fe8faf0764d828bde5297a60d4cbd', 'request_id': 'req-9be5a1e2-c53f-46b8-b0e0-71315107085f'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:13.577013 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9be5a1e2-c53f-46b8-b0e0-71315107085f admin admin] The token cache is being invalidate because project c23fe8faf0764d828bde5297a60d4cbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:13:13.577321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9be5a1e2-c53f-46b8-b0e0-71315107085f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:13.577921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9be5a1e2-c53f-46b8-b0e0-71315107085f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:13.579502 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1325/2619] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:13:13 2022] DELETE /identity/v3/projects/c23fe8faf0764d828bde5297a60d4cbd => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:13:13.583927 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414b9ce-d41d-4007-ada1-5487c9c2522b service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:13.593367 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414b9ce-d41d-4007-ada1-5487c9c2522b service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:13.609511 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5a1e2-c53f-46b8-b0e0-71315107085f admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:13.610909 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-9be5a1e2-c53f-46b8-b0e0-71315107085f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:13.638419 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:13.656811 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73b83e-5907-4362-b312-66343e868e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:13.657788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73b83e-5907-4362-b312-66343e868e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:13.658153 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73b83e-5907-4362-b312-66343e868e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:13.658434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73b83e-5907-4362-b312-66343e868e2d admin admin] PATH_INFO: `/v3/users/ee01b5ed9991495d9cad126201f6b68b` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:13.659806 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73b83e-5907-4362-b312-66343e868e2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee01b5ed9991495d9cad126201f6b68b)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:13.661734 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73b83e-5907-4362-b312-66343e868e2d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:13.673686 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5a1e2-c53f-46b8-b0e0-71315107085f admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:13.678087 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84058e-eb74-4cf4-829a-20642986c7d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:13.678730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84058e-eb74-4cf4-829a-20642986c7d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:13.679017 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84058e-eb74-4cf4-829a-20642986c7d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:13.679321 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84058e-eb74-4cf4-829a-20642986c7d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:13.681216 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ee84058e-eb74-4cf4-829a-20642986c7d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:13.713735 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fa73b83e-5907-4362-b312-66343e868e2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee01b5ed9991495d9cad126201f6b68b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:13.720764 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fa73b83e-5907-4362-b312-66343e868e2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee01b5ed9991495d9cad126201f6b68b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:13.735835 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fa73b83e-5907-4362-b312-66343e868e2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee01b5ed9991495d9cad126201f6b68b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:13.737063 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fa73b83e-5907-4362-b312-66343e868e2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee01b5ed9991495d9cad126201f6b68b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:13.737229 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fa73b83e-5907-4362-b312-66343e868e2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee01b5ed9991495d9cad126201f6b68b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:13.743906 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84058e-eb74-4cf4-829a-20642986c7d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:13.745394 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84058e-eb74-4cf4-829a-20642986c7d0 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:13.752463 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1295/2620] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:13:13 2022] DELETE /identity/v3/users/ee01b5ed9991495d9cad126201f6b68b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:13:13.756235 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1326/2621] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:13:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 15:13:14.043887 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73b83e-5907-4362-b312-66343e868e2d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:14.046283 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fa73b83e-5907-4362-b312-66343e868e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:14.115277 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73b83e-5907-4362-b312-66343e868e2d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:14.120323 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c2712-f4c8-4c9a-893c-dc0b7bf05836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:14.121261 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c2712-f4c8-4c9a-893c-dc0b7bf05836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:14.121539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c2712-f4c8-4c9a-893c-dc0b7bf05836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:14.121915 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c2712-f4c8-4c9a-893c-dc0b7bf05836 admin admin] PATH_INFO: `/v3/projects/65233050ac674533bc24ae9d40f21492` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:14.123356 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c2712-f4c8-4c9a-893c-dc0b7bf05836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65233050ac674533bc24ae9d40f21492)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:14.125536 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c2712-f4c8-4c9a-893c-dc0b7bf05836 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:14.172509 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fd8c2712-f4c8-4c9a-893c-dc0b7bf05836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65233050ac674533bc24ae9d40f21492', 'request_id': 'req-fd8c2712-f4c8-4c9a-893c-dc0b7bf05836'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:14.179372 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fd8c2712-f4c8-4c9a-893c-dc0b7bf05836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65233050ac674533bc24ae9d40f21492', 'request_id': 'req-fd8c2712-f4c8-4c9a-893c-dc0b7bf05836'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:14.185332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fd8c2712-f4c8-4c9a-893c-dc0b7bf05836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65233050ac674533bc24ae9d40f21492', 'request_id': 'req-fd8c2712-f4c8-4c9a-893c-dc0b7bf05836'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:14.189239 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:14.198357 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fd8c2712-f4c8-4c9a-893c-dc0b7bf05836 admin admin] The token cache is being invalidate because project 65233050ac674533bc24ae9d40f21492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:13:14.198668 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fd8c2712-f4c8-4c9a-893c-dc0b7bf05836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:14.199379 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fd8c2712-f4c8-4c9a-893c-dc0b7bf05836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:14.200903 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1296/2622] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:13:14 2022] DELETE /identity/v3/projects/65233050ac674533bc24ae9d40f21492 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:14.205708 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca14ee-cf75-40e9-87c7-7ac18715f7a8 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:14.205999 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca14ee-cf75-40e9-87c7-7ac18715f7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:14.206278 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca14ee-cf75-40e9-87c7-7ac18715f7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:14.226396 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-c8ca14ee-cf75-40e9-87c7-7ac18715f7a8 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:14.227956 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c8ca14ee-cf75-40e9-87c7-7ac18715f7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:14.232308 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:14.292515 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1327/2623] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:13:14.300487 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9345e-f23c-4ab9-b3be-b23c78d0c708 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:14.300847 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9345e-f23c-4ab9-b3be-b23c78d0c708 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:14.301211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9345e-f23c-4ab9-b3be-b23c78d0c708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:14.320446 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-09f9345e-f23c-4ab9-b3be-b23c78d0c708 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:14.321708 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-09f9345e-f23c-4ab9-b3be-b23c78d0c708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:14.329899 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1297/2624] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:13:14.334229 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca14ee-cf75-40e9-87c7-7ac18715f7a8 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:14.344579 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca14ee-cf75-40e9-87c7-7ac18715f7a8 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:14.349476 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610891b-984e-4aec-bb0b-f838af68eeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:14.350167 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610891b-984e-4aec-bb0b-f838af68eeed admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:14.350448 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610891b-984e-4aec-bb0b-f838af68eeed admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:14.350720 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610891b-984e-4aec-bb0b-f838af68eeed admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:14.351711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610891b-984e-4aec-bb0b-f838af68eeed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:13:14.351856 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610891b-984e-4aec-bb0b-f838af68eeed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:14.353349 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610891b-984e-4aec-bb0b-f838af68eeed admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:14.365956 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1328/2625] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:13:14.370521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9345e-f23c-4ab9-b3be-b23c78d0c708 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:14.380639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9345e-f23c-4ab9-b3be-b23c78d0c708 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:14.385829 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7317078-3adb-4359-a760-4d35bf876110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:14.386473 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7317078-3adb-4359-a760-4d35bf876110 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:14.386758 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7317078-3adb-4359-a760-4d35bf876110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:14.387032 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7317078-3adb-4359-a760-4d35bf876110 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:14.387776 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7317078-3adb-4359-a760-4d35bf876110 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:14.389669 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7317078-3adb-4359-a760-4d35bf876110 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:14.415266 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1298/2626] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:13:14 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:13:14.419465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610891b-984e-4aec-bb0b-f838af68eeed admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:14.429356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610891b-984e-4aec-bb0b-f838af68eeed admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:14.483523 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8f232-64c4-409d-b23e-502f3cfeaa7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:14.484184 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8f232-64c4-409d-b23e-502f3cfeaa7a admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:14.484371 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8f232-64c4-409d-b23e-502f3cfeaa7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:14.484644 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8f232-64c4-409d-b23e-502f3cfeaa7a admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:14.485331 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8f232-64c4-409d-b23e-502f3cfeaa7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:14.487236 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8f232-64c4-409d-b23e-502f3cfeaa7a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:14.507633 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1329/2627] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:13:14 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:13:14.511854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7317078-3adb-4359-a760-4d35bf876110 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:14.522376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7317078-3adb-4359-a760-4d35bf876110 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:14.527499 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8ddae-b0ed-4f56-a6b1-c23cf57d8d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:14.528167 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8ddae-b0ed-4f56-a6b1-c23cf57d8d8e admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:14.528457 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8ddae-b0ed-4f56-a6b1-c23cf57d8d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:14.528738 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8ddae-b0ed-4f56-a6b1-c23cf57d8d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:14.529466 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8ddae-b0ed-4f56-a6b1-c23cf57d8d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:14.531098 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8ddae-b0ed-4f56-a6b1-c23cf57d8d8e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:14.542198 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1299/2628] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:13:14.546261 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8f232-64c4-409d-b23e-502f3cfeaa7a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:14.556367 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8f232-64c4-409d-b23e-502f3cfeaa7a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:14.561039 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a648b-d2d1-4c9a-99c5-2873374d320e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:14.561696 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a648b-d2d1-4c9a-99c5-2873374d320e admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:14.561983 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a648b-d2d1-4c9a-99c5-2873374d320e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:14.562265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a648b-d2d1-4c9a-99c5-2873374d320e admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:14.563016 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a648b-d2d1-4c9a-99c5-2873374d320e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:14.564650 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a648b-d2d1-4c9a-99c5-2873374d320e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:14.583034 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1330/2629] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:13:14.587079 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8ddae-b0ed-4f56-a6b1-c23cf57d8d8e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:14.597765 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8ddae-b0ed-4f56-a6b1-c23cf57d8d8e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:14.603906 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091c361-fabe-4353-bbd7-1bd29b9f891e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:14.604855 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091c361-fabe-4353-bbd7-1bd29b9f891e admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:14.605144 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091c361-fabe-4353-bbd7-1bd29b9f891e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:14.605503 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091c361-fabe-4353-bbd7-1bd29b9f891e admin admin] PATH_INFO: `/v3/projects/e12921fccc154769bcabf15351a20c3b/users/7809ae8bd59e408aa42c04caefdba16c/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:14.621259 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091c361-fabe-4353-bbd7-1bd29b9f891e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e12921fccc154769bcabf15351a20c3b, user_id=7809ae8bd59e408aa42c04caefdba16c, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:14.623999 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091c361-fabe-4353-bbd7-1bd29b9f891e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:14.643828 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1300/2630] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:13:14 2022] PUT /identity/v3/projects/e12921fccc154769bcabf15351a20c3b/users/7809ae8bd59e408aa42c04caefdba16c/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:13:14.654625 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d5864-dbb9-4e02-b9b0-92de2a9f1f23 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:14.654923 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d5864-dbb9-4e02-b9b0-92de2a9f1f23 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:14.655230 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d5864-dbb9-4e02-b9b0-92de2a9f1f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:14.685487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ed7d5864-dbb9-4e02-b9b0-92de2a9f1f23 None None] MFA Rules not processed for user `7809ae8bd59e408aa42c04caefdba16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:14.686888 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ed7d5864-dbb9-4e02-b9b0-92de2a9f1f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:14.755373 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1331/2631] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:13:14.764317 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091c361-fabe-4353-bbd7-1bd29b9f891e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:14.766120 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e091c361-fabe-4353-bbd7-1bd29b9f891e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:14.825212 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091c361-fabe-4353-bbd7-1bd29b9f891e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:14.826510 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d5864-dbb9-4e02-b9b0-92de2a9f1f23 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:14.827917 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ed7d5864-dbb9-4e02-b9b0-92de2a9f1f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:14.829425 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499dd8a0-0a51-4ac4-96fb-e97b2a61d432 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:14.830181 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499dd8a0-0a51-4ac4-96fb-e97b2a61d432 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:14.830469 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499dd8a0-0a51-4ac4-96fb-e97b2a61d432 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:14.830744 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499dd8a0-0a51-4ac4-96fb-e97b2a61d432 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:14.834166 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:14.840171 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499dd8a0-0a51-4ac4-96fb-e97b2a61d432 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:14.841757 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499dd8a0-0a51-4ac4-96fb-e97b2a61d432 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:14.851373 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1301/2632] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:13:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:13:14.896118 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d5864-dbb9-4e02-b9b0-92de2a9f1f23 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:14.901287 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db9db9-fc55-4f24-8cb3-057b7b900835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:14.902249 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db9db9-fc55-4f24-8cb3-057b7b900835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:14.902605 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db9db9-fc55-4f24-8cb3-057b7b900835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:14.902955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db9db9-fc55-4f24-8cb3-057b7b900835 admin admin] PATH_INFO: `/v3/users/8c5a57af83e34c0480616bb7ba8028d6` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:14.904299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db9db9-fc55-4f24-8cb3-057b7b900835 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c5a57af83e34c0480616bb7ba8028d6)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:14.906315 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db9db9-fc55-4f24-8cb3-057b7b900835 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:14.954283 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-25db9db9-fc55-4f24-8cb3-057b7b900835 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c5a57af83e34c0480616bb7ba8028d6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:14.955488 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-25db9db9-fc55-4f24-8cb3-057b7b900835 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c5a57af83e34c0480616bb7ba8028d6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:14.956221 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-25db9db9-fc55-4f24-8cb3-057b7b900835 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c5a57af83e34c0480616bb7ba8028d6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:14.967666 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-25db9db9-fc55-4f24-8cb3-057b7b900835 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c5a57af83e34c0480616bb7ba8028d6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:14.982260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-25db9db9-fc55-4f24-8cb3-057b7b900835 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c5a57af83e34c0480616bb7ba8028d6'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:14.996920 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1332/2633] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:13:14 2022] DELETE /identity/v3/users/8c5a57af83e34c0480616bb7ba8028d6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:15.001967 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d481a-25c3-43a6-8675-8bcd55eb50ad None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:15.002266 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d481a-25c3-43a6-8675-8bcd55eb50ad None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:15.002555 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d481a-25c3-43a6-8675-8bcd55eb50ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:15.020925 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-5d1d481a-25c3-43a6-8675-8bcd55eb50ad None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:15.022138 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5d1d481a-25c3-43a6-8675-8bcd55eb50ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:15.086167 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1302/2634] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:13:15.103681 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db9db9-fc55-4f24-8cb3-057b7b900835 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:15.105685 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-25db9db9-fc55-4f24-8cb3-057b7b900835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:15.181951 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db9db9-fc55-4f24-8cb3-057b7b900835 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:15.185898 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa958b-4954-41a8-9f01-964c567c8186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:15.186543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa958b-4954-41a8-9f01-964c567c8186 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:15.186821 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa958b-4954-41a8-9f01-964c567c8186 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:15.187094 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa958b-4954-41a8-9f01-964c567c8186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:15.196422 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa958b-4954-41a8-9f01-964c567c8186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:15.197855 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa958b-4954-41a8-9f01-964c567c8186 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:15.208614 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1333/2635] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:13:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 15:13:15.486739 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d481a-25c3-43a6-8675-8bcd55eb50ad None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:15.488640 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5d1d481a-25c3-43a6-8675-8bcd55eb50ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:15.502294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d481a-25c3-43a6-8675-8bcd55eb50ad None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:15.507858 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21f4ef-40a2-45b8-a278-e00182706e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:15.508812 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21f4ef-40a2-45b8-a278-e00182706e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:15.509171 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21f4ef-40a2-45b8-a278-e00182706e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:15.509531 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21f4ef-40a2-45b8-a278-e00182706e5d admin admin] PATH_INFO: `/v3/projects/0da0d88701ff459eb0117623a0a7b253` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:15.511111 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21f4ef-40a2-45b8-a278-e00182706e5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0da0d88701ff459eb0117623a0a7b253)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:15.513081 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21f4ef-40a2-45b8-a278-e00182706e5d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:15.552648 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:15.569039 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4c21f4ef-40a2-45b8-a278-e00182706e5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0da0d88701ff459eb0117623a0a7b253', 'request_id': 'req-4c21f4ef-40a2-45b8-a278-e00182706e5d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:15.576016 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4c21f4ef-40a2-45b8-a278-e00182706e5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0da0d88701ff459eb0117623a0a7b253', 'request_id': 'req-4c21f4ef-40a2-45b8-a278-e00182706e5d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:15.582076 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4c21f4ef-40a2-45b8-a278-e00182706e5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0da0d88701ff459eb0117623a0a7b253', 'request_id': 'req-4c21f4ef-40a2-45b8-a278-e00182706e5d'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:15.592875 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4c21f4ef-40a2-45b8-a278-e00182706e5d admin admin] The token cache is being invalidate because project 0da0d88701ff459eb0117623a0a7b253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:13:15.593164 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4c21f4ef-40a2-45b8-a278-e00182706e5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:15.593787 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4c21f4ef-40a2-45b8-a278-e00182706e5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:15.595335 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1303/2636] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:13:15 2022] DELETE /identity/v3/projects/0da0d88701ff459eb0117623a0a7b253 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:15.599464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa958b-4954-41a8-9f01-964c567c8186 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:15.608921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa958b-4954-41a8-9f01-964c567c8186 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:15.635265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:15.668778 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884801c-b7d0-40ef-b565-fc49b02fdf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:15.669645 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884801c-b7d0-40ef-b565-fc49b02fdf57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:15.669927 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884801c-b7d0-40ef-b565-fc49b02fdf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:15.670202 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884801c-b7d0-40ef-b565-fc49b02fdf57 admin admin] PATH_INFO: `/v3/users/238eda96da274be9a2167dbcfaca7cc1` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:15.671415 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884801c-b7d0-40ef-b565-fc49b02fdf57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=238eda96da274be9a2167dbcfaca7cc1)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:15.673345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884801c-b7d0-40ef-b565-fc49b02fdf57 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:15.718998 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-7884801c-b7d0-40ef-b565-fc49b02fdf57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '238eda96da274be9a2167dbcfaca7cc1'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:15.719665 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-7884801c-b7d0-40ef-b565-fc49b02fdf57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '238eda96da274be9a2167dbcfaca7cc1'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:15.720269 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-7884801c-b7d0-40ef-b565-fc49b02fdf57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '238eda96da274be9a2167dbcfaca7cc1'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:15.728432 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-7884801c-b7d0-40ef-b565-fc49b02fdf57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '238eda96da274be9a2167dbcfaca7cc1'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:15.740911 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-7884801c-b7d0-40ef-b565-fc49b02fdf57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '238eda96da274be9a2167dbcfaca7cc1'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:15.753897 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1334/2637] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:13:15 2022] DELETE /identity/v3/users/238eda96da274be9a2167dbcfaca7cc1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:16.012447 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21f4ef-40a2-45b8-a278-e00182706e5d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:16.013958 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4c21f4ef-40a2-45b8-a278-e00182706e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:16.027646 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21f4ef-40a2-45b8-a278-e00182706e5d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:16.084563 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa527f00-7777-42bb-a568-d451bfb476e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:16.085425 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa527f00-7777-42bb-a568-d451bfb476e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:16.085714 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa527f00-7777-42bb-a568-d451bfb476e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:16.085993 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa527f00-7777-42bb-a568-d451bfb476e1 admin admin] PATH_INFO: `/v3/projects/29709c4685fb4963aac836b0705a2358` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:16.087158 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa527f00-7777-42bb-a568-d451bfb476e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29709c4685fb4963aac836b0705a2358)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:16.089090 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa527f00-7777-42bb-a568-d451bfb476e1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:16.137206 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aa527f00-7777-42bb-a568-d451bfb476e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29709c4685fb4963aac836b0705a2358', 'request_id': 'req-aa527f00-7777-42bb-a568-d451bfb476e1'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:16.144361 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aa527f00-7777-42bb-a568-d451bfb476e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29709c4685fb4963aac836b0705a2358', 'request_id': 'req-aa527f00-7777-42bb-a568-d451bfb476e1'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:16.150961 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aa527f00-7777-42bb-a568-d451bfb476e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29709c4685fb4963aac836b0705a2358', 'request_id': 'req-aa527f00-7777-42bb-a568-d451bfb476e1'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:16.161965 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aa527f00-7777-42bb-a568-d451bfb476e1 admin admin] The token cache is being invalidate because project 29709c4685fb4963aac836b0705a2358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:13:16.162256 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aa527f00-7777-42bb-a568-d451bfb476e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:16.162893 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-aa527f00-7777-42bb-a568-d451bfb476e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:16.164441 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1304/2638] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:13:16 2022] DELETE /identity/v3/projects/29709c4685fb4963aac836b0705a2358 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:16.170611 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495c850-3c79-4af3-9747-badb68733197 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:16.170978 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495c850-3c79-4af3-9747-badb68733197 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:16.171368 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495c850-3c79-4af3-9747-badb68733197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:16.188937 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-4495c850-3c79-4af3-9747-badb68733197 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:16.190168 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4495c850-3c79-4af3-9747-badb68733197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:16.252556 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1335/2639] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:13:16.261202 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e67e2-128b-4e60-8db3-516193c00cde None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:16.261498 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e67e2-128b-4e60-8db3-516193c00cde None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:16.261783 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e67e2-128b-4e60-8db3-516193c00cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:16.282350 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-2e6e67e2-128b-4e60-8db3-516193c00cde None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:16.283608 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2e6e67e2-128b-4e60-8db3-516193c00cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:16.291653 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1305/2640] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:13:16.295927 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495c850-3c79-4af3-9747-badb68733197 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:16.305502 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495c850-3c79-4af3-9747-badb68733197 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:16.310015 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee793899-abc3-46c6-b311-9ff62fd42c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:16.310670 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee793899-abc3-46c6-b311-9ff62fd42c32 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:16.310952 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee793899-abc3-46c6-b311-9ff62fd42c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:16.311257 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee793899-abc3-46c6-b311-9ff62fd42c32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:16.311983 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee793899-abc3-46c6-b311-9ff62fd42c32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:13:16.312294 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee793899-abc3-46c6-b311-9ff62fd42c32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:16.313882 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee793899-abc3-46c6-b311-9ff62fd42c32 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:16.329495 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1336/2641] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:13:16.330724 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e67e2-128b-4e60-8db3-516193c00cde None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:16.340698 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e67e2-128b-4e60-8db3-516193c00cde None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:16.345438 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe74c9-2819-4c58-a6ff-c3461ba7b154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:16.346093 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe74c9-2819-4c58-a6ff-c3461ba7b154 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:16.346384 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe74c9-2819-4c58-a6ff-c3461ba7b154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:16.346666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe74c9-2819-4c58-a6ff-c3461ba7b154 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:16.347404 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe74c9-2819-4c58-a6ff-c3461ba7b154 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:16.349847 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe74c9-2819-4c58-a6ff-c3461ba7b154 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:16.375695 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1306/2642] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:13:16 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:13:16.379786 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee793899-abc3-46c6-b311-9ff62fd42c32 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:16.389998 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee793899-abc3-46c6-b311-9ff62fd42c32 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:16.421062 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:16.452405 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239e570-e2e3-4b61-840a-4d6511b4c2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:16.453074 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239e570-e2e3-4b61-840a-4d6511b4c2aa admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:16.453356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239e570-e2e3-4b61-840a-4d6511b4c2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:16.453630 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239e570-e2e3-4b61-840a-4d6511b4c2aa admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:16.454313 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239e570-e2e3-4b61-840a-4d6511b4c2aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:16.456288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239e570-e2e3-4b61-840a-4d6511b4c2aa admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:16.475761 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1337/2643] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:13:16 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:13:16.479928 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe74c9-2819-4c58-a6ff-c3461ba7b154 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:16.490896 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe74c9-2819-4c58-a6ff-c3461ba7b154 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:16.495945 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006d346-c631-4a5e-9c68-c82641d7c937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:16.496607 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006d346-c631-4a5e-9c68-c82641d7c937 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:16.496897 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006d346-c631-4a5e-9c68-c82641d7c937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:16.497180 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006d346-c631-4a5e-9c68-c82641d7c937 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:16.497912 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006d346-c631-4a5e-9c68-c82641d7c937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:16.499546 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006d346-c631-4a5e-9c68-c82641d7c937 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:16.509863 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1307/2644] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:13:16.513514 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239e570-e2e3-4b61-840a-4d6511b4c2aa admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:16.523229 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239e570-e2e3-4b61-840a-4d6511b4c2aa admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:16.527835 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d153c86-aa07-4522-88d5-e445c95d3d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:16.528478 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d153c86-aa07-4522-88d5-e445c95d3d7c admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:16.528790 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d153c86-aa07-4522-88d5-e445c95d3d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:16.529068 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d153c86-aa07-4522-88d5-e445c95d3d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:16.529812 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d153c86-aa07-4522-88d5-e445c95d3d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:16.531451 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d153c86-aa07-4522-88d5-e445c95d3d7c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:16.541649 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1338/2645] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:13:16.545709 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006d346-c631-4a5e-9c68-c82641d7c937 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:16.557006 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006d346-c631-4a5e-9c68-c82641d7c937 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:16.562544 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9dfed8-882b-475b-9e21-b31a5be847cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:16.563537 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dfed8-882b-475b-9e21-b31a5be847cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:16.563890 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dfed8-882b-475b-9e21-b31a5be847cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:16.564234 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dfed8-882b-475b-9e21-b31a5be847cd admin admin] PATH_INFO: `/v3/projects/49e53086e76f471ebf5ac6be859810c0/users/84b98144a8994854b7166c11ec9a828a/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:16.566745 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:16.583863 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9dfed8-882b-475b-9e21-b31a5be847cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=49e53086e76f471ebf5ac6be859810c0, user_id=84b98144a8994854b7166c11ec9a828a, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:16.586621 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9dfed8-882b-475b-9e21-b31a5be847cd admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:16.600015 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1308/2646] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:13:16 2022] PUT /identity/v3/projects/49e53086e76f471ebf5ac6be859810c0/users/84b98144a8994854b7166c11ec9a828a/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:13:16.611086 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154d927-d18b-4789-8481-7c9a2a86bd29 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:16.611652 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154d927-d18b-4789-8481-7c9a2a86bd29 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:16.611765 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154d927-d18b-4789-8481-7c9a2a86bd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:16.639176 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f154d927-d18b-4789-8481-7c9a2a86bd29 None None] MFA Rules not processed for user `84b98144a8994854b7166c11ec9a828a`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:16.640488 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f154d927-d18b-4789-8481-7c9a2a86bd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:16.710455 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1339/2647] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:13:16.714971 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9dfed8-882b-475b-9e21-b31a5be847cd admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:16.782833 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9dfed8-882b-475b-9e21-b31a5be847cd admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:16.788095 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9754c33-4dfa-4b2f-9326-70cfd17f63ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:16.788840 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9754c33-4dfa-4b2f-9326-70cfd17f63ef admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:16.789126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9754c33-4dfa-4b2f-9326-70cfd17f63ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:16.789403 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9754c33-4dfa-4b2f-9326-70cfd17f63ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:16.790090 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9754c33-4dfa-4b2f-9326-70cfd17f63ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:16.792024 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9754c33-4dfa-4b2f-9326-70cfd17f63ef admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:16.814819 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1309/2648] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:13:16 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:13:16.818987 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154d927-d18b-4789-8481-7c9a2a86bd29 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:16.829919 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154d927-d18b-4789-8481-7c9a2a86bd29 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:16.885271 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68da9f3-feea-455d-a001-bff2c0c2ecba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:16.885932 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68da9f3-feea-455d-a001-bff2c0c2ecba admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:16.886215 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68da9f3-feea-455d-a001-bff2c0c2ecba admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:16.886489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68da9f3-feea-455d-a001-bff2c0c2ecba admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:16.887173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68da9f3-feea-455d-a001-bff2c0c2ecba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:16.889114 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68da9f3-feea-455d-a001-bff2c0c2ecba admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:16.909758 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1340/2649] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:13:16 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:13:16.914383 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9754c33-4dfa-4b2f-9326-70cfd17f63ef admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:16.924591 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9754c33-4dfa-4b2f-9326-70cfd17f63ef admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:16.929657 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613d33d-a011-43c8-9c7d-9c52e5f24765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:16.930327 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613d33d-a011-43c8-9c7d-9c52e5f24765 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:16.930611 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613d33d-a011-43c8-9c7d-9c52e5f24765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:16.930894 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613d33d-a011-43c8-9c7d-9c52e5f24765 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:16.931660 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613d33d-a011-43c8-9c7d-9c52e5f24765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:16.933273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613d33d-a011-43c8-9c7d-9c52e5f24765 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:16.944555 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1310/2650] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:13:16.948647 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68da9f3-feea-455d-a001-bff2c0c2ecba admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:16.959101 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68da9f3-feea-455d-a001-bff2c0c2ecba admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:16.963711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f686cab-3fd7-4bf8-941b-0fe47053b38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:16.964579 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f686cab-3fd7-4bf8-941b-0fe47053b38a admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:16.964867 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f686cab-3fd7-4bf8-941b-0fe47053b38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:16.965147 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f686cab-3fd7-4bf8-941b-0fe47053b38a admin admin] PATH_INFO: `/v3/projects/e70979111d674fbdb30f642d3540dbbb/users/5df969563c724ba4a3f82b46a58b6f76/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:16.979849 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f686cab-3fd7-4bf8-941b-0fe47053b38a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e70979111d674fbdb30f642d3540dbbb, user_id=5df969563c724ba4a3f82b46a58b6f76, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:16.982544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f686cab-3fd7-4bf8-941b-0fe47053b38a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:16.995578 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1341/2651] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:13:16 2022] PUT /identity/v3/projects/e70979111d674fbdb30f642d3540dbbb/users/5df969563c724ba4a3f82b46a58b6f76/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:16.999436 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613d33d-a011-43c8-9c7d-9c52e5f24765 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:17.010188 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613d33d-a011-43c8-9c7d-9c52e5f24765 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:17.069239 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95facc3a-082d-4317-b340-080e63f0e26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:17.069911 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95facc3a-082d-4317-b340-080e63f0e26d admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:17.070235 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95facc3a-082d-4317-b340-080e63f0e26d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:17.070454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95facc3a-082d-4317-b340-080e63f0e26d admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:17.071169 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95facc3a-082d-4317-b340-080e63f0e26d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:17.072793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95facc3a-082d-4317-b340-080e63f0e26d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:17.083380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1311/2652] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:13:17.087450 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f686cab-3fd7-4bf8-941b-0fe47053b38a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:17.098282 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f686cab-3fd7-4bf8-941b-0fe47053b38a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:17.102747 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9761f6-1626-4823-ba2d-5a9ef246250b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:17.103640 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9761f6-1626-4823-ba2d-5a9ef246250b admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:17.103921 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9761f6-1626-4823-ba2d-5a9ef246250b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:17.105156 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9761f6-1626-4823-ba2d-5a9ef246250b admin admin] PATH_INFO: `/v3/projects/e70979111d674fbdb30f642d3540dbbb/users/5df969563c724ba4a3f82b46a58b6f76/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:17.106166 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9761f6-1626-4823-ba2d-5a9ef246250b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e70979111d674fbdb30f642d3540dbbb, user_id=5df969563c724ba4a3f82b46a58b6f76, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:17.108816 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9761f6-1626-4823-ba2d-5a9ef246250b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:17.111275 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:17.123479 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1342/2653] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:13:17 2022] PUT /identity/v3/projects/e70979111d674fbdb30f642d3540dbbb/users/5df969563c724ba4a3f82b46a58b6f76/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:17.134649 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be0062-d3f3-47a4-af3d-6c2cfb18b69e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:17.135173 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be0062-d3f3-47a4-af3d-6c2cfb18b69e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:17.135382 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be0062-d3f3-47a4-af3d-6c2cfb18b69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:17.165437 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-10be0062-d3f3-47a4-af3d-6c2cfb18b69e None None] MFA Rules not processed for user `5df969563c724ba4a3f82b46a58b6f76`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:17.166572 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-10be0062-d3f3-47a4-af3d-6c2cfb18b69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:17.208934 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:17.256323 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1312/2654] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:13:17.385615 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9761f6-1626-4823-ba2d-5a9ef246250b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:17.387356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1f9761f6-1626-4823-ba2d-5a9ef246250b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:17.473208 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9761f6-1626-4823-ba2d-5a9ef246250b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:17.479970 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61a885-4fd1-4458-a5ef-060d36bfb6e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:17.480755 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61a885-4fd1-4458-a5ef-060d36bfb6e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:17.481148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61a885-4fd1-4458-a5ef-060d36bfb6e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:17.481525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61a885-4fd1-4458-a5ef-060d36bfb6e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:17.546320 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61a885-4fd1-4458-a5ef-060d36bfb6e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:17.547803 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61a885-4fd1-4458-a5ef-060d36bfb6e2 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:17.557097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1343/2655] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:13:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:13:22.767332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f636e2c-a26f-480c-9191-3ea8a4adfaf4 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:22.767806 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f636e2c-a26f-480c-9191-3ea8a4adfaf4 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:22.767906 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f636e2c-a26f-480c-9191-3ea8a4adfaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:22.785206 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0f636e2c-a26f-480c-9191-3ea8a4adfaf4 None None] MFA Rules not processed for user `9877b9bbc14141bba21625fc8f1046d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:22.787011 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0f636e2c-a26f-480c-9191-3ea8a4adfaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:22.838354 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1313/2656] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:13:23.154063 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61a885-4fd1-4458-a5ef-060d36bfb6e2 service cinder] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:23.155697 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-cc61a885-4fd1-4458-a5ef-060d36bfb6e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:23.230106 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61a885-4fd1-4458-a5ef-060d36bfb6e2 service cinder] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:23.234627 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8561f7e-9842-47ab-b437-dca29ff06873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:23.235382 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8561f7e-9842-47ab-b437-dca29ff06873 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:23.235749 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8561f7e-9842-47ab-b437-dca29ff06873 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:23.236200 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8561f7e-9842-47ab-b437-dca29ff06873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:23.238011 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a8561f7e-9842-47ab-b437-dca29ff06873 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:23.250685 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8561f7e-9842-47ab-b437-dca29ff06873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:23.252285 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8561f7e-9842-47ab-b437-dca29ff06873 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:23.263533 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1344/2657] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:13:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:13:24.355936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f636e2c-a26f-480c-9191-3ea8a4adfaf4 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:24.357508 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0f636e2c-a26f-480c-9191-3ea8a4adfaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:24.427734 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f636e2c-a26f-480c-9191-3ea8a4adfaf4 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:24.432217 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb45c67-5c96-43a9-9158-a931ce6ec76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:24.433083 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb45c67-5c96-43a9-9158-a931ce6ec76c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:24.433372 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb45c67-5c96-43a9-9158-a931ce6ec76c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:24.433650 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb45c67-5c96-43a9-9158-a931ce6ec76c admin admin] PATH_INFO: `/v3/users/7809ae8bd59e408aa42c04caefdba16c` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:24.434841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb45c67-5c96-43a9-9158-a931ce6ec76c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7809ae8bd59e408aa42c04caefdba16c)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:24.436808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb45c67-5c96-43a9-9158-a931ce6ec76c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:24.482309 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0eb45c67-5c96-43a9-9158-a931ce6ec76c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7809ae8bd59e408aa42c04caefdba16c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:24.489724 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0eb45c67-5c96-43a9-9158-a931ce6ec76c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7809ae8bd59e408aa42c04caefdba16c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:24.501594 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0eb45c67-5c96-43a9-9158-a931ce6ec76c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7809ae8bd59e408aa42c04caefdba16c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:24.502263 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0eb45c67-5c96-43a9-9158-a931ce6ec76c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7809ae8bd59e408aa42c04caefdba16c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:24.502885 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-0eb45c67-5c96-43a9-9158-a931ce6ec76c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7809ae8bd59e408aa42c04caefdba16c'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:24.515344 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1314/2658] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:13:24 2022] DELETE /identity/v3/users/7809ae8bd59e408aa42c04caefdba16c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:24.520103 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d9849-b2e5-4976-9cb6-9fcd96ff40a1 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:24.520600 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d9849-b2e5-4976-9cb6-9fcd96ff40a1 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:24.520726 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d9849-b2e5-4976-9cb6-9fcd96ff40a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:24.538373 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-839d9849-b2e5-4976-9cb6-9fcd96ff40a1 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:24.539860 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-839d9849-b2e5-4976-9cb6-9fcd96ff40a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:24.593246 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:24.612996 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1345/2659] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:13:24.627218 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb45c67-5c96-43a9-9158-a931ce6ec76c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:24.628273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0eb45c67-5c96-43a9-9158-a931ce6ec76c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:24.634018 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:24.702741 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb45c67-5c96-43a9-9158-a931ce6ec76c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:24.706422 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4a371-b726-4cd4-a5d5-8b35310c5706 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:24.707073 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4a371-b726-4cd4-a5d5-8b35310c5706 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:24.707430 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4a371-b726-4cd4-a5d5-8b35310c5706 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:24.707713 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4a371-b726-4cd4-a5d5-8b35310c5706 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:24.717110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4a371-b726-4cd4-a5d5-8b35310c5706 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:24.718551 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4a371-b726-4cd4-a5d5-8b35310c5706 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:24.728795 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1315/2660] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:13:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:13:25.201632 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d9849-b2e5-4976-9cb6-9fcd96ff40a1 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:25.203150 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-839d9849-b2e5-4976-9cb6-9fcd96ff40a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:25.216542 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d9849-b2e5-4976-9cb6-9fcd96ff40a1 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:25.221485 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a824b2-f84a-4892-801a-941303505849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:25.222198 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a824b2-f84a-4892-801a-941303505849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:25.222484 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a824b2-f84a-4892-801a-941303505849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:25.222786 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a824b2-f84a-4892-801a-941303505849 admin admin] PATH_INFO: `/v3/projects/e12921fccc154769bcabf15351a20c3b` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:25.224537 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a824b2-f84a-4892-801a-941303505849 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e12921fccc154769bcabf15351a20c3b)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:25.226821 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a824b2-f84a-4892-801a-941303505849 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:25.276031 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-10a824b2-f84a-4892-801a-941303505849 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e12921fccc154769bcabf15351a20c3b', 'request_id': 'req-10a824b2-f84a-4892-801a-941303505849'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:25.281750 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-10a824b2-f84a-4892-801a-941303505849 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e12921fccc154769bcabf15351a20c3b', 'request_id': 'req-10a824b2-f84a-4892-801a-941303505849'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:25.288080 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-10a824b2-f84a-4892-801a-941303505849 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e12921fccc154769bcabf15351a20c3b', 'request_id': 'req-10a824b2-f84a-4892-801a-941303505849'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:25.300540 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-10a824b2-f84a-4892-801a-941303505849 admin admin] The token cache is being invalidate because project e12921fccc154769bcabf15351a20c3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:13:25.300827 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-10a824b2-f84a-4892-801a-941303505849 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:25.301469 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-10a824b2-f84a-4892-801a-941303505849 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:25.303067 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1346/2661] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:13:25 2022] DELETE /identity/v3/projects/e12921fccc154769bcabf15351a20c3b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:25.308482 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b06a4-1068-4008-93c7-885f3f3a5c1b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:25.308915 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b06a4-1068-4008-93c7-885f3f3a5c1b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:25.309263 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b06a4-1068-4008-93c7-885f3f3a5c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:25.328964 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-cc8b06a4-1068-4008-93c7-885f3f3a5c1b None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:25.330176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-cc8b06a4-1068-4008-93c7-885f3f3a5c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:25.401988 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1316/2662] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:13:25.464243 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b953e-f630-4947-8007-39215e45a4a9 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:25.464532 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b953e-f630-4947-8007-39215e45a4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:25.464814 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b953e-f630-4947-8007-39215e45a4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:25.483045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-048b953e-f630-4947-8007-39215e45a4a9 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:25.484286 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-048b953e-f630-4947-8007-39215e45a4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:25.492164 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1347/2663] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:13:25.496632 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b06a4-1068-4008-93c7-885f3f3a5c1b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:25.507125 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b06a4-1068-4008-93c7-885f3f3a5c1b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:25.511811 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82a379-1925-47d2-ad9b-c90d33f0079c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:25.512468 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82a379-1925-47d2-ad9b-c90d33f0079c admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:25.512749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82a379-1925-47d2-ad9b-c90d33f0079c admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:25.513029 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82a379-1925-47d2-ad9b-c90d33f0079c admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:25.513783 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82a379-1925-47d2-ad9b-c90d33f0079c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:13:25.514093 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82a379-1925-47d2-ad9b-c90d33f0079c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:25.516003 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82a379-1925-47d2-ad9b-c90d33f0079c admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:25.532342 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1317/2664] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:13:25.533408 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b953e-f630-4947-8007-39215e45a4a9 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:25.542976 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b953e-f630-4947-8007-39215e45a4a9 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:25.548438 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181a4b2-a7dc-4c03-96e4-105bc6240718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:25.549095 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181a4b2-a7dc-4c03-96e4-105bc6240718 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:25.549380 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181a4b2-a7dc-4c03-96e4-105bc6240718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:25.549661 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181a4b2-a7dc-4c03-96e4-105bc6240718 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:25.550550 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181a4b2-a7dc-4c03-96e4-105bc6240718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:25.552505 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181a4b2-a7dc-4c03-96e4-105bc6240718 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:25.577510 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1348/2665] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:13:25 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:13:25.582032 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82a379-1925-47d2-ad9b-c90d33f0079c admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:25.592547 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82a379-1925-47d2-ad9b-c90d33f0079c admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:25.660423 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f280f67-193b-41cf-aa6c-d7983132f5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:25.661607 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f280f67-193b-41cf-aa6c-d7983132f5c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:25.661893 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f280f67-193b-41cf-aa6c-d7983132f5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:25.662166 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f280f67-193b-41cf-aa6c-d7983132f5c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:25.663372 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f280f67-193b-41cf-aa6c-d7983132f5c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:25.666304 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f280f67-193b-41cf-aa6c-d7983132f5c6 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:25.701837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1318/2666] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:13:25 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:13:25.706186 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181a4b2-a7dc-4c03-96e4-105bc6240718 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:25.716588 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181a4b2-a7dc-4c03-96e4-105bc6240718 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:25.725270 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec22064-fa0b-4b72-b49e-ade6b9285c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:25.725958 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec22064-fa0b-4b72-b49e-ade6b9285c15 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:25.726243 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec22064-fa0b-4b72-b49e-ade6b9285c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:25.726524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec22064-fa0b-4b72-b49e-ade6b9285c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:25.727289 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec22064-fa0b-4b72-b49e-ade6b9285c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:25.728945 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec22064-fa0b-4b72-b49e-ade6b9285c15 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:25.741610 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1349/2667] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:13:25.746457 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f280f67-193b-41cf-aa6c-d7983132f5c6 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:25.757308 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f280f67-193b-41cf-aa6c-d7983132f5c6 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:25.762456 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c7ddf-d5a4-4d62-bb7a-870c685a75ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:25.763182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c7ddf-d5a4-4d62-bb7a-870c685a75ed admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:25.763506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c7ddf-d5a4-4d62-bb7a-870c685a75ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:25.763791 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c7ddf-d5a4-4d62-bb7a-870c685a75ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:25.764526 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c7ddf-d5a4-4d62-bb7a-870c685a75ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:25.766151 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c7ddf-d5a4-4d62-bb7a-870c685a75ed admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:25.778817 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1319/2668] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:13:25.783090 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec22064-fa0b-4b72-b49e-ade6b9285c15 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:25.793480 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec22064-fa0b-4b72-b49e-ade6b9285c15 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:25.798094 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755167d-afce-4bdd-bd8d-78c32adfa0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:25.798969 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755167d-afce-4bdd-bd8d-78c32adfa0a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:25.799287 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755167d-afce-4bdd-bd8d-78c32adfa0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:25.799596 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755167d-afce-4bdd-bd8d-78c32adfa0a5 admin admin] PATH_INFO: `/v3/projects/9210c96ef1df42bd83aa7fe94f6a0e53/users/ae8e9fabd7714d6483d89d18db6aac34/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:25.815326 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755167d-afce-4bdd-bd8d-78c32adfa0a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9210c96ef1df42bd83aa7fe94f6a0e53, user_id=ae8e9fabd7714d6483d89d18db6aac34, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:25.818582 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755167d-afce-4bdd-bd8d-78c32adfa0a5 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:25.833050 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1350/2669] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:13:25 2022] PUT /identity/v3/projects/9210c96ef1df42bd83aa7fe94f6a0e53/users/ae8e9fabd7714d6483d89d18db6aac34/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:25.842931 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5e3bb-7e63-46bd-a603-6a7e7754a2eb None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:25.843255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5e3bb-7e63-46bd-a603-6a7e7754a2eb None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:25.843550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5e3bb-7e63-46bd-a603-6a7e7754a2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:25.865190 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:25.875597 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-85a5e3bb-7e63-46bd-a603-6a7e7754a2eb None None] MFA Rules not processed for user `ae8e9fabd7714d6483d89d18db6aac34`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:25.877689 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-85a5e3bb-7e63-46bd-a603-6a7e7754a2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:25.968204 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1320/2670] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:13:25.973393 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755167d-afce-4bdd-bd8d-78c32adfa0a5 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:26.069388 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5e3bb-7e63-46bd-a603-6a7e7754a2eb None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:26.072738 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-85a5e3bb-7e63-46bd-a603-6a7e7754a2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:26.121749 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755167d-afce-4bdd-bd8d-78c32adfa0a5 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:26.133025 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d66119-2f3e-4bd9-9470-ffe70fa87953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:26.133982 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d66119-2f3e-4bd9-9470-ffe70fa87953 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:26.134582 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d66119-2f3e-4bd9-9470-ffe70fa87953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:26.135019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d66119-2f3e-4bd9-9470-ffe70fa87953 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:26.135947 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d66119-2f3e-4bd9-9470-ffe70fa87953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:26.138192 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d66119-2f3e-4bd9-9470-ffe70fa87953 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:26.159798 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:26.189380 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1351/2671] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:13:25 2022] POST /identity/v3/projects => generated 373 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:13:26.194967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d66119-2f3e-4bd9-9470-ffe70fa87953 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:26.253570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5e3bb-7e63-46bd-a603-6a7e7754a2eb None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:26.334089 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598b3eb-91f8-416b-977e-99bc5737463d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:26.334749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598b3eb-91f8-416b-977e-99bc5737463d service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:26.335033 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598b3eb-91f8-416b-977e-99bc5737463d service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:26.335391 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598b3eb-91f8-416b-977e-99bc5737463d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:26.337713 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3598b3eb-91f8-416b-977e-99bc5737463d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:26.338811 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d66119-2f3e-4bd9-9470-ffe70fa87953 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:26.344482 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbf5f1-771f-451f-a419-db3fa3db9a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:26.345683 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbf5f1-771f-451f-a419-db3fa3db9a3c admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:26.346122 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbf5f1-771f-451f-a419-db3fa3db9a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:26.346429 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbf5f1-771f-451f-a419-db3fa3db9a3c admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:26.347498 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdbf5f1-771f-451f-a419-db3fa3db9a3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:26.349900 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdbf5f1-771f-451f-a419-db3fa3db9a3c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:26.381641 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1352/2672] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:13:26 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:13:26.389464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbf5f1-771f-451f-a419-db3fa3db9a3c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:26.407678 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbf5f1-771f-451f-a419-db3fa3db9a3c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:26.414559 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598b3eb-91f8-416b-977e-99bc5737463d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:26.415061 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cfd53-1fc5-4803-85b8-6f91dad50f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:26.415178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cfd53-1fc5-4803-85b8-6f91dad50f53 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:26.415858 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cfd53-1fc5-4803-85b8-6f91dad50f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:26.415858 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cfd53-1fc5-4803-85b8-6f91dad50f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:26.416243 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598b3eb-91f8-416b-977e-99bc5737463d service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:26.417007 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4cfd53-1fc5-4803-85b8-6f91dad50f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:26.426440 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4cfd53-1fc5-4803-85b8-6f91dad50f53 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:26.432981 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1321/2673] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:13:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:13:26.451221 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1353/2674] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:13:26.455801 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598b3eb-91f8-416b-977e-99bc5737463d service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:26.468699 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598b3eb-91f8-416b-977e-99bc5737463d service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:26.474255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824a8f8-48dd-4f0c-a9a5-267f625be98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:26.475433 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824a8f8-48dd-4f0c-a9a5-267f625be98d admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:26.475789 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824a8f8-48dd-4f0c-a9a5-267f625be98d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:26.476149 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824a8f8-48dd-4f0c-a9a5-267f625be98d admin admin] PATH_INFO: `/v3/projects/e4529199ff404e35ad552c5cd640713d/users/7f735ccab89944959ed738538e786bd2/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:26.478747 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=100 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:26.493823 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2824a8f8-48dd-4f0c-a9a5-267f625be98d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4529199ff404e35ad552c5cd640713d, user_id=7f735ccab89944959ed738538e786bd2, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:26.496786 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2824a8f8-48dd-4f0c-a9a5-267f625be98d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:26.512295 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1322/2675] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:13:26 2022] PUT /identity/v3/projects/e4529199ff404e35ad552c5cd640713d/users/7f735ccab89944959ed738538e786bd2/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:26.516711 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cfd53-1fc5-4803-85b8-6f91dad50f53 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:26.527635 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cfd53-1fc5-4803-85b8-6f91dad50f53 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:26.596446 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28718ac2-b78f-42ed-9424-7464b4a9ae5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:26.598514 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28718ac2-b78f-42ed-9424-7464b4a9ae5a admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:26.599103 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28718ac2-b78f-42ed-9424-7464b4a9ae5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:26.599803 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28718ac2-b78f-42ed-9424-7464b4a9ae5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:26.600623 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28718ac2-b78f-42ed-9424-7464b4a9ae5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:26.602494 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28718ac2-b78f-42ed-9424-7464b4a9ae5a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:26.616464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1354/2676] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:13:26.621000 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824a8f8-48dd-4f0c-a9a5-267f625be98d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:26.632284 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824a8f8-48dd-4f0c-a9a5-267f625be98d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:26.637086 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1370d-36cf-4f1e-98f3-38cec64f16de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:26.638023 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1370d-36cf-4f1e-98f3-38cec64f16de admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:26.638356 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1370d-36cf-4f1e-98f3-38cec64f16de admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:26.638852 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1370d-36cf-4f1e-98f3-38cec64f16de admin admin] PATH_INFO: `/v3/projects/e4529199ff404e35ad552c5cd640713d/users/7f735ccab89944959ed738538e786bd2/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:26.641187 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1370d-36cf-4f1e-98f3-38cec64f16de admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4529199ff404e35ad552c5cd640713d, user_id=7f735ccab89944959ed738538e786bd2, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:26.644022 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1370d-36cf-4f1e-98f3-38cec64f16de admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:26.656538 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1323/2677] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:13:26 2022] PUT /identity/v3/projects/e4529199ff404e35ad552c5cd640713d/users/7f735ccab89944959ed738538e786bd2/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:13:26.667999 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e059b8-d548-41af-bf48-f5b1be5f4efd None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:26.668871 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e059b8-d548-41af-bf48-f5b1be5f4efd None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:26.669229 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e059b8-d548-41af-bf48-f5b1be5f4efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:26.703033 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-f7e059b8-d548-41af-bf48-f5b1be5f4efd None None] MFA Rules not processed for user `7f735ccab89944959ed738538e786bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:26.704400 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f7e059b8-d548-41af-bf48-f5b1be5f4efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:26.822995 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:26.836257 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1355/2678] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:13:26.848512 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1370d-36cf-4f1e-98f3-38cec64f16de admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:26.929012 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1370d-36cf-4f1e-98f3-38cec64f16de admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:26.933206 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df91e16-7976-49e0-b697-9c7893dca98e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:26.933888 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df91e16-7976-49e0-b697-9c7893dca98e service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:26.934176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df91e16-7976-49e0-b697-9c7893dca98e service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:26.934614 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df91e16-7976-49e0-b697-9c7893dca98e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:27.027036 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df91e16-7976-49e0-b697-9c7893dca98e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:27.028814 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df91e16-7976-49e0-b697-9c7893dca98e service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:27.046700 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1324/2679] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:13:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:13:29.619880 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e059b8-d548-41af-bf48-f5b1be5f4efd None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:29.682000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e059b8-d548-41af-bf48-f5b1be5f4efd None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:29.686585 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f50b11-ac57-4a37-8222-a269f0422043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:29.687480 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f50b11-ac57-4a37-8222-a269f0422043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:29.687764 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f50b11-ac57-4a37-8222-a269f0422043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:29.688039 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f50b11-ac57-4a37-8222-a269f0422043 admin admin] PATH_INFO: `/v3/users/ae8e9fabd7714d6483d89d18db6aac34` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:29.689221 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f50b11-ac57-4a37-8222-a269f0422043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae8e9fabd7714d6483d89d18db6aac34)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:29.691167 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f50b11-ac57-4a37-8222-a269f0422043 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:29.738566 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-64f50b11-ac57-4a37-8222-a269f0422043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae8e9fabd7714d6483d89d18db6aac34'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:29.739331 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-64f50b11-ac57-4a37-8222-a269f0422043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae8e9fabd7714d6483d89d18db6aac34'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:29.739892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-64f50b11-ac57-4a37-8222-a269f0422043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae8e9fabd7714d6483d89d18db6aac34'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:29.747877 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-64f50b11-ac57-4a37-8222-a269f0422043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae8e9fabd7714d6483d89d18db6aac34'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:29.760304 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-64f50b11-ac57-4a37-8222-a269f0422043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae8e9fabd7714d6483d89d18db6aac34'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:29.773288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1356/2680] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:13:29 2022] DELETE /identity/v3/users/ae8e9fabd7714d6483d89d18db6aac34 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:29.777839 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e11ef6-d016-4827-a803-c8f5794561b6 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:29.778312 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e11ef6-d016-4827-a803-c8f5794561b6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:29.778411 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e11ef6-d016-4827-a803-c8f5794561b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:29.796647 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-35e11ef6-d016-4827-a803-c8f5794561b6 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:29.797854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-35e11ef6-d016-4827-a803-c8f5794561b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:29.857043 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1325/2681] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:13:29.866822 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f50b11-ac57-4a37-8222-a269f0422043 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:29.868614 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-64f50b11-ac57-4a37-8222-a269f0422043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:29.927096 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f50b11-ac57-4a37-8222-a269f0422043 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:29.930712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed720a-2659-4301-b60d-47baf3c66a2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:29.931399 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed720a-2659-4301-b60d-47baf3c66a2b service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:29.931684 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed720a-2659-4301-b60d-47baf3c66a2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:29.931959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed720a-2659-4301-b60d-47baf3c66a2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:29.940988 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed720a-2659-4301-b60d-47baf3c66a2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:29.943014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed720a-2659-4301-b60d-47baf3c66a2b service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:29.952381 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1357/2682] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:13:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:13:30.235461 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e11ef6-d016-4827-a803-c8f5794561b6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:30.236975 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-35e11ef6-d016-4827-a803-c8f5794561b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:30.267168 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e11ef6-d016-4827-a803-c8f5794561b6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:30.273768 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee436ba5-14af-426f-8621-950f3a690cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:30.274661 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee436ba5-14af-426f-8621-950f3a690cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:30.275076 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee436ba5-14af-426f-8621-950f3a690cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:30.275187 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee436ba5-14af-426f-8621-950f3a690cf3 admin admin] PATH_INFO: `/v3/projects/9210c96ef1df42bd83aa7fe94f6a0e53` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:30.276422 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee436ba5-14af-426f-8621-950f3a690cf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9210c96ef1df42bd83aa7fe94f6a0e53)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:30.278591 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee436ba5-14af-426f-8621-950f3a690cf3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:30.302369 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:30.338857 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ee436ba5-14af-426f-8621-950f3a690cf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9210c96ef1df42bd83aa7fe94f6a0e53', 'request_id': 'req-ee436ba5-14af-426f-8621-950f3a690cf3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:30.348981 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ee436ba5-14af-426f-8621-950f3a690cf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9210c96ef1df42bd83aa7fe94f6a0e53', 'request_id': 'req-ee436ba5-14af-426f-8621-950f3a690cf3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:30.355989 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ee436ba5-14af-426f-8621-950f3a690cf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9210c96ef1df42bd83aa7fe94f6a0e53', 'request_id': 'req-ee436ba5-14af-426f-8621-950f3a690cf3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:30.367279 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ee436ba5-14af-426f-8621-950f3a690cf3 admin admin] The token cache is being invalidate because project 9210c96ef1df42bd83aa7fe94f6a0e53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:13:30.367584 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ee436ba5-14af-426f-8621-950f3a690cf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:30.368479 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-ee436ba5-14af-426f-8621-950f3a690cf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:30.370009 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1326/2683] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:13:30 2022] DELETE /identity/v3/projects/9210c96ef1df42bd83aa7fe94f6a0e53 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:30.374351 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed720a-2659-4301-b60d-47baf3c66a2b service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:30.383896 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed720a-2659-4301-b60d-47baf3c66a2b service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:30.396366 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:30.441227 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50666e5a-ecd8-49bf-92e4-02cd71e3c160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:30.442557 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50666e5a-ecd8-49bf-92e4-02cd71e3c160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:30.442834 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50666e5a-ecd8-49bf-92e4-02cd71e3c160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:30.443104 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50666e5a-ecd8-49bf-92e4-02cd71e3c160 admin admin] PATH_INFO: `/v3/users/7f735ccab89944959ed738538e786bd2` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:30.444376 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50666e5a-ecd8-49bf-92e4-02cd71e3c160 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f735ccab89944959ed738538e786bd2)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:30.446292 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50666e5a-ecd8-49bf-92e4-02cd71e3c160 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:30.491537 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-50666e5a-ecd8-49bf-92e4-02cd71e3c160 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f735ccab89944959ed738538e786bd2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:30.492216 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-50666e5a-ecd8-49bf-92e4-02cd71e3c160 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f735ccab89944959ed738538e786bd2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:30.493234 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-50666e5a-ecd8-49bf-92e4-02cd71e3c160 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f735ccab89944959ed738538e786bd2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:30.500543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-50666e5a-ecd8-49bf-92e4-02cd71e3c160 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f735ccab89944959ed738538e786bd2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:30.513554 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-50666e5a-ecd8-49bf-92e4-02cd71e3c160 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f735ccab89944959ed738538e786bd2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:30.526255 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1358/2684] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:13:30 2022] DELETE /identity/v3/users/7f735ccab89944959ed738538e786bd2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:30.793363 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee436ba5-14af-426f-8621-950f3a690cf3 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:30.795435 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ee436ba5-14af-426f-8621-950f3a690cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:30.810594 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee436ba5-14af-426f-8621-950f3a690cf3 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:30.868304 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56cde9-28a5-44e7-9330-94a3b324661f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:30.869200 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56cde9-28a5-44e7-9330-94a3b324661f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:30.869487 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56cde9-28a5-44e7-9330-94a3b324661f admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:30.869766 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56cde9-28a5-44e7-9330-94a3b324661f admin admin] PATH_INFO: `/v3/projects/e4529199ff404e35ad552c5cd640713d` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:30.870943 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56cde9-28a5-44e7-9330-94a3b324661f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4529199ff404e35ad552c5cd640713d)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:30.872954 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56cde9-28a5-44e7-9330-94a3b324661f admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:30.918871 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-cc56cde9-28a5-44e7-9330-94a3b324661f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4529199ff404e35ad552c5cd640713d', 'request_id': 'req-cc56cde9-28a5-44e7-9330-94a3b324661f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:30.926645 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-cc56cde9-28a5-44e7-9330-94a3b324661f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4529199ff404e35ad552c5cd640713d', 'request_id': 'req-cc56cde9-28a5-44e7-9330-94a3b324661f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:30.932778 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-cc56cde9-28a5-44e7-9330-94a3b324661f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4529199ff404e35ad552c5cd640713d', 'request_id': 'req-cc56cde9-28a5-44e7-9330-94a3b324661f'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:30.943481 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-cc56cde9-28a5-44e7-9330-94a3b324661f admin admin] The token cache is being invalidate because project e4529199ff404e35ad552c5cd640713d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:13:30.943772 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-cc56cde9-28a5-44e7-9330-94a3b324661f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:30.944409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-cc56cde9-28a5-44e7-9330-94a3b324661f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:30.946159 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1327/2685] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:13:30 2022] DELETE /identity/v3/projects/e4529199ff404e35ad552c5cd640713d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:31.389886 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50666e5a-ecd8-49bf-92e4-02cd71e3c160 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:31.391325 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-50666e5a-ecd8-49bf-92e4-02cd71e3c160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:31.404356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50666e5a-ecd8-49bf-92e4-02cd71e3c160 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:31.459441 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef63ac-4d90-40de-a882-cde9e671d38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:31.460307 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef63ac-4d90-40de-a882-cde9e671d38a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:31.460621 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef63ac-4d90-40de-a882-cde9e671d38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:31.460895 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef63ac-4d90-40de-a882-cde9e671d38a admin admin] PATH_INFO: `/v3/users/84b98144a8994854b7166c11ec9a828a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:31.462061 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edef63ac-4d90-40de-a882-cde9e671d38a admin admin] RBAC: Authorizing `identity:delete_user(user_id=84b98144a8994854b7166c11ec9a828a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:31.464008 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edef63ac-4d90-40de-a882-cde9e671d38a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:31.502901 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:31.510293 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-edef63ac-4d90-40de-a882-cde9e671d38a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84b98144a8994854b7166c11ec9a828a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:31.510997 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-edef63ac-4d90-40de-a882-cde9e671d38a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84b98144a8994854b7166c11ec9a828a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:31.511800 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-edef63ac-4d90-40de-a882-cde9e671d38a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84b98144a8994854b7166c11ec9a828a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:31.519381 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-edef63ac-4d90-40de-a882-cde9e671d38a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84b98144a8994854b7166c11ec9a828a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:31.531734 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-edef63ac-4d90-40de-a882-cde9e671d38a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84b98144a8994854b7166c11ec9a828a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:31.543793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1359/2686] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:13:31 2022] DELETE /identity/v3/users/84b98144a8994854b7166c11ec9a828a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:31.548418 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53786bdf-bb78-4a27-87bd-56e068b675ee None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:31.548713 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53786bdf-bb78-4a27-87bd-56e068b675ee None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:31.548993 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53786bdf-bb78-4a27-87bd-56e068b675ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:31.567013 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-53786bdf-bb78-4a27-87bd-56e068b675ee None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:31.568144 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-53786bdf-bb78-4a27-87bd-56e068b675ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:31.600980 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:31.630103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1328/2687] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:13:31.639600 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef63ac-4d90-40de-a882-cde9e671d38a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:31.641060 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-edef63ac-4d90-40de-a882-cde9e671d38a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:31.697236 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef63ac-4d90-40de-a882-cde9e671d38a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:31.700824 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d37fa2-de6e-4d7a-a72f-eb62cc0db989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:31.701462 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d37fa2-de6e-4d7a-a72f-eb62cc0db989 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:31.701749 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d37fa2-de6e-4d7a-a72f-eb62cc0db989 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:31.702026 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d37fa2-de6e-4d7a-a72f-eb62cc0db989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:31.710786 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d37fa2-de6e-4d7a-a72f-eb62cc0db989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:31.712246 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d37fa2-de6e-4d7a-a72f-eb62cc0db989 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:31.721391 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1360/2688] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:13:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:13:31.991749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53786bdf-bb78-4a27-87bd-56e068b675ee None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:31.993477 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-53786bdf-bb78-4a27-87bd-56e068b675ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:32.006823 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53786bdf-bb78-4a27-87bd-56e068b675ee None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:32.013034 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41de76-d94a-435b-a727-d18282cdb418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:32.013898 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41de76-d94a-435b-a727-d18282cdb418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:32.014184 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41de76-d94a-435b-a727-d18282cdb418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:32.014462 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41de76-d94a-435b-a727-d18282cdb418 admin admin] PATH_INFO: `/v3/projects/49e53086e76f471ebf5ac6be859810c0` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:32.015711 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41de76-d94a-435b-a727-d18282cdb418 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49e53086e76f471ebf5ac6be859810c0)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:32.017709 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41de76-d94a-435b-a727-d18282cdb418 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:32.065170 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1f41de76-d94a-435b-a727-d18282cdb418 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49e53086e76f471ebf5ac6be859810c0', 'request_id': 'req-1f41de76-d94a-435b-a727-d18282cdb418'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:32.072575 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1f41de76-d94a-435b-a727-d18282cdb418 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49e53086e76f471ebf5ac6be859810c0', 'request_id': 'req-1f41de76-d94a-435b-a727-d18282cdb418'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:32.078643 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1f41de76-d94a-435b-a727-d18282cdb418 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49e53086e76f471ebf5ac6be859810c0', 'request_id': 'req-1f41de76-d94a-435b-a727-d18282cdb418'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:32.088793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1f41de76-d94a-435b-a727-d18282cdb418 admin admin] The token cache is being invalidate because project 49e53086e76f471ebf5ac6be859810c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:13:32.089082 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1f41de76-d94a-435b-a727-d18282cdb418 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:32.089712 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-1f41de76-d94a-435b-a727-d18282cdb418 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:32.091254 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1329/2689] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:13:31 2022] DELETE /identity/v3/projects/49e53086e76f471ebf5ac6be859810c0 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:32.095154 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d37fa2-de6e-4d7a-a72f-eb62cc0db989 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:32.105241 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d37fa2-de6e-4d7a-a72f-eb62cc0db989 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:32.164817 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542adce0-4712-48de-bb9c-19b65e302ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:32.165699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542adce0-4712-48de-bb9c-19b65e302ec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:32.165984 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542adce0-4712-48de-bb9c-19b65e302ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:32.166635 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542adce0-4712-48de-bb9c-19b65e302ec0 admin admin] PATH_INFO: `/v3/users/5df969563c724ba4a3f82b46a58b6f76` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:32.167488 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542adce0-4712-48de-bb9c-19b65e302ec0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5df969563c724ba4a3f82b46a58b6f76)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:32.169420 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542adce0-4712-48de-bb9c-19b65e302ec0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:32.225760 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-542adce0-4712-48de-bb9c-19b65e302ec0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5df969563c724ba4a3f82b46a58b6f76'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:32.226435 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-542adce0-4712-48de-bb9c-19b65e302ec0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5df969563c724ba4a3f82b46a58b6f76'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:32.227036 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-542adce0-4712-48de-bb9c-19b65e302ec0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5df969563c724ba4a3f82b46a58b6f76'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:32.234540 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-542adce0-4712-48de-bb9c-19b65e302ec0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5df969563c724ba4a3f82b46a58b6f76'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:32.241484 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:32.251557 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-542adce0-4712-48de-bb9c-19b65e302ec0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5df969563c724ba4a3f82b46a58b6f76'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:32.265059 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1361/2690] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:13:32 2022] DELETE /identity/v3/users/5df969563c724ba4a3f82b46a58b6f76 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:32.533416 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41de76-d94a-435b-a727-d18282cdb418 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:32.534996 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1f41de76-d94a-435b-a727-d18282cdb418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:32.548699 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41de76-d94a-435b-a727-d18282cdb418 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:32.610158 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e06b32-3c27-4227-8357-89fb58c5c053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:32.611046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e06b32-3c27-4227-8357-89fb58c5c053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:32.611361 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e06b32-3c27-4227-8357-89fb58c5c053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:32.611638 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e06b32-3c27-4227-8357-89fb58c5c053 admin admin] PATH_INFO: `/v3/projects/e70979111d674fbdb30f642d3540dbbb` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:32.612792 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e06b32-3c27-4227-8357-89fb58c5c053 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e70979111d674fbdb30f642d3540dbbb)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:32.614755 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e06b32-3c27-4227-8357-89fb58c5c053 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:32.659105 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a4e06b32-3c27-4227-8357-89fb58c5c053 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e70979111d674fbdb30f642d3540dbbb', 'request_id': 'req-a4e06b32-3c27-4227-8357-89fb58c5c053'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:32.666727 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a4e06b32-3c27-4227-8357-89fb58c5c053 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e70979111d674fbdb30f642d3540dbbb', 'request_id': 'req-a4e06b32-3c27-4227-8357-89fb58c5c053'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:32.672697 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a4e06b32-3c27-4227-8357-89fb58c5c053 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e70979111d674fbdb30f642d3540dbbb', 'request_id': 'req-a4e06b32-3c27-4227-8357-89fb58c5c053'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:32.674619 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:32.684361 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a4e06b32-3c27-4227-8357-89fb58c5c053 admin admin] The token cache is being invalidate because project e70979111d674fbdb30f642d3540dbbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:13:32.684676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a4e06b32-3c27-4227-8357-89fb58c5c053 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:32.685301 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-a4e06b32-3c27-4227-8357-89fb58c5c053 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:32.686794 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1330/2691] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:13:32 2022] DELETE /identity/v3/projects/e70979111d674fbdb30f642d3540dbbb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:32.693308 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4922b-07cf-4cc8-b2cd-5be20233ef15 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:32.693788 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4922b-07cf-4cc8-b2cd-5be20233ef15 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:32.693888 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4922b-07cf-4cc8-b2cd-5be20233ef15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:32.712037 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-87c4922b-07cf-4cc8-b2cd-5be20233ef15 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:32.713213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-87c4922b-07cf-4cc8-b2cd-5be20233ef15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:32.769606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1362/2692] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:13:32.779356 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3824000-54f9-48c7-a895-8d5ebec25ce8 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:32.779655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3824000-54f9-48c7-a895-8d5ebec25ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:32.779964 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3824000-54f9-48c7-a895-8d5ebec25ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:32.798769 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-c3824000-54f9-48c7-a895-8d5ebec25ce8 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:32.800012 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c3824000-54f9-48c7-a895-8d5ebec25ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:32.808356 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1331/2693] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:13:32.812517 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4922b-07cf-4cc8-b2cd-5be20233ef15 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:32.822494 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4922b-07cf-4cc8-b2cd-5be20233ef15 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:32.827215 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef648eac-d636-441d-9b90-a4620b469f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:32.827814 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef648eac-d636-441d-9b90-a4620b469f57 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:32.828098 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef648eac-d636-441d-9b90-a4620b469f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:32.828375 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef648eac-d636-441d-9b90-a4620b469f57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:32.829102 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef648eac-d636-441d-9b90-a4620b469f57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:13:32.829405 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef648eac-d636-441d-9b90-a4620b469f57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:32.830990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef648eac-d636-441d-9b90-a4620b469f57 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:32.842879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1363/2694] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:13:32.847113 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3824000-54f9-48c7-a895-8d5ebec25ce8 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:32.856241 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3824000-54f9-48c7-a895-8d5ebec25ce8 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:32.860851 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1da6b-16d4-4fc0-b1fb-fd8b02c2d2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:32.861489 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1da6b-16d4-4fc0-b1fb-fd8b02c2d2c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:32.861776 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1da6b-16d4-4fc0-b1fb-fd8b02c2d2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:32.862055 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c1da6b-16d4-4fc0-b1fb-fd8b02c2d2c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:32.862742 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1da6b-16d4-4fc0-b1fb-fd8b02c2d2c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:32.864676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c1da6b-16d4-4fc0-b1fb-fd8b02c2d2c9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:32.890167 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1332/2695] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:13:32 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:13:32.893977 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef648eac-d636-441d-9b90-a4620b469f57 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:32.904272 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef648eac-d636-441d-9b90-a4620b469f57 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:32.959055 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d73786-9e1d-4186-b26a-4b16a66d1aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:32.959933 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d73786-9e1d-4186-b26a-4b16a66d1aad admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:32.960222 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d73786-9e1d-4186-b26a-4b16a66d1aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:32.960524 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d73786-9e1d-4186-b26a-4b16a66d1aad admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:32.961213 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d73786-9e1d-4186-b26a-4b16a66d1aad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:32.963144 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d73786-9e1d-4186-b26a-4b16a66d1aad admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:32.982242 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1364/2696] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:13:32 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:13:32.986290 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1da6b-16d4-4fc0-b1fb-fd8b02c2d2c9 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:32.996966 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c1da6b-16d4-4fc0-b1fb-fd8b02c2d2c9 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:33.001568 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75517a-6da6-4079-9d6a-b87a5f50c1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:33.002232 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75517a-6da6-4079-9d6a-b87a5f50c1dd admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:33.002523 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75517a-6da6-4079-9d6a-b87a5f50c1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:33.002807 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75517a-6da6-4079-9d6a-b87a5f50c1dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:33.003579 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75517a-6da6-4079-9d6a-b87a5f50c1dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:33.005715 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75517a-6da6-4079-9d6a-b87a5f50c1dd admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:33.015958 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1333/2697] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:13:33.020261 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d73786-9e1d-4186-b26a-4b16a66d1aad admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:33.029953 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d73786-9e1d-4186-b26a-4b16a66d1aad admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:33.034495 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f2329-52d8-41be-8254-415035d55f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:33.035137 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f2329-52d8-41be-8254-415035d55f3c admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:33.035477 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f2329-52d8-41be-8254-415035d55f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:33.035756 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f2329-52d8-41be-8254-415035d55f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:33.036471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f2329-52d8-41be-8254-415035d55f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:33.038058 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f2329-52d8-41be-8254-415035d55f3c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:33.048563 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1365/2698] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:13:33.052552 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75517a-6da6-4079-9d6a-b87a5f50c1dd admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:33.062521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75517a-6da6-4079-9d6a-b87a5f50c1dd admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:33.067662 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce68005-952d-44db-87d1-5e9082e06eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:33.068539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce68005-952d-44db-87d1-5e9082e06eeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:33.068830 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce68005-952d-44db-87d1-5e9082e06eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:33.069107 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce68005-952d-44db-87d1-5e9082e06eeb admin admin] PATH_INFO: `/v3/projects/fc0e01fa962d4dd18fd4035b87c578e0/users/7f588cc1bb7d4774b0cd9772ef325cbe/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:33.083866 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce68005-952d-44db-87d1-5e9082e06eeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc0e01fa962d4dd18fd4035b87c578e0, user_id=7f588cc1bb7d4774b0cd9772ef325cbe, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:33.086501 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce68005-952d-44db-87d1-5e9082e06eeb admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:33.099276 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1334/2699] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:13:33 2022] PUT /identity/v3/projects/fc0e01fa962d4dd18fd4035b87c578e0/users/7f588cc1bb7d4774b0cd9772ef325cbe/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:33.110119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a286e5e-d823-43a5-b399-9f3b8046bedb None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:33.110487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a286e5e-d823-43a5-b399-9f3b8046bedb None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:33.110767 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a286e5e-d823-43a5-b399-9f3b8046bedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:33.140142 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-0a286e5e-d823-43a5-b399-9f3b8046bedb None None] MFA Rules not processed for user `7f588cc1bb7d4774b0cd9772ef325cbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:33.141340 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0a286e5e-d823-43a5-b399-9f3b8046bedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:33.171849 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:33.211553 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1366/2700] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:13:33.222834 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce68005-952d-44db-87d1-5e9082e06eeb admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:33.225169 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5ce68005-952d-44db-87d1-5e9082e06eeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:33.286942 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce68005-952d-44db-87d1-5e9082e06eeb admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:33.291983 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56869f00-e7a1-4439-a803-8d01e6e0f76a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:33.292637 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56869f00-e7a1-4439-a803-8d01e6e0f76a service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:33.293202 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56869f00-e7a1-4439-a803-8d01e6e0f76a service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:33.293485 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56869f00-e7a1-4439-a803-8d01e6e0f76a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:33.305605 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56869f00-e7a1-4439-a803-8d01e6e0f76a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:33.307048 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56869f00-e7a1-4439-a803-8d01e6e0f76a service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:33.317369 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1335/2701] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:13:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:13:33.337900 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a286e5e-d823-43a5-b399-9f3b8046bedb None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:33.415000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a286e5e-d823-43a5-b399-9f3b8046bedb None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:33.419733 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47fee3f-b1b9-4583-b5ee-5aeee6a80a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:33.420643 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fee3f-b1b9-4583-b5ee-5aeee6a80a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:33.420926 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fee3f-b1b9-4583-b5ee-5aeee6a80a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:33.421229 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fee3f-b1b9-4583-b5ee-5aeee6a80a80 admin admin] PATH_INFO: `/v3/users/7f588cc1bb7d4774b0cd9772ef325cbe` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:33.425929 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47fee3f-b1b9-4583-b5ee-5aeee6a80a80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f588cc1bb7d4774b0cd9772ef325cbe)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:33.428074 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47fee3f-b1b9-4583-b5ee-5aeee6a80a80 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:33.490065 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a47fee3f-b1b9-4583-b5ee-5aeee6a80a80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f588cc1bb7d4774b0cd9772ef325cbe'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:33.490960 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a47fee3f-b1b9-4583-b5ee-5aeee6a80a80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f588cc1bb7d4774b0cd9772ef325cbe'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:33.491674 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a47fee3f-b1b9-4583-b5ee-5aeee6a80a80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f588cc1bb7d4774b0cd9772ef325cbe'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:33.504672 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a47fee3f-b1b9-4583-b5ee-5aeee6a80a80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f588cc1bb7d4774b0cd9772ef325cbe'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:33.517061 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-a47fee3f-b1b9-4583-b5ee-5aeee6a80a80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f588cc1bb7d4774b0cd9772ef325cbe'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:33.530855 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1367/2702] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:13:33 2022] DELETE /identity/v3/users/7f588cc1bb7d4774b0cd9772ef325cbe => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:33.535433 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a834b-5711-4889-8d26-caa40d3a58ca None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:33.535732 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a834b-5711-4889-8d26-caa40d3a58ca None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:33.536015 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a834b-5711-4889-8d26-caa40d3a58ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:33.554683 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-166a834b-5711-4889-8d26-caa40d3a58ca None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:33.555936 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-166a834b-5711-4889-8d26-caa40d3a58ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:33.614268 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1336/2703] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:13:33.623923 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47fee3f-b1b9-4583-b5ee-5aeee6a80a80 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:33.625371 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a47fee3f-b1b9-4583-b5ee-5aeee6a80a80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:33.682405 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47fee3f-b1b9-4583-b5ee-5aeee6a80a80 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:33.686044 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33007ccb-9201-43bc-94ff-c99f73f9fe0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:33.686687 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33007ccb-9201-43bc-94ff-c99f73f9fe0b service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:33.686971 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33007ccb-9201-43bc-94ff-c99f73f9fe0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:33.687276 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33007ccb-9201-43bc-94ff-c99f73f9fe0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:33.694883 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:33.697571 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33007ccb-9201-43bc-94ff-c99f73f9fe0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:33.699373 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33007ccb-9201-43bc-94ff-c99f73f9fe0b service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:33.710852 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1368/2704] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:13:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:13:33.990800 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a834b-5711-4889-8d26-caa40d3a58ca None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:33.992352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-166a834b-5711-4889-8d26-caa40d3a58ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:34.011684 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a834b-5711-4889-8d26-caa40d3a58ca None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:34.016684 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9c85c-5081-4771-833e-11d49c539e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:34.017645 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9c85c-5081-4771-833e-11d49c539e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:34.017993 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9c85c-5081-4771-833e-11d49c539e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:34.018367 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9c85c-5081-4771-833e-11d49c539e69 admin admin] PATH_INFO: `/v3/projects/fc0e01fa962d4dd18fd4035b87c578e0` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:34.019683 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9c85c-5081-4771-833e-11d49c539e69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc0e01fa962d4dd18fd4035b87c578e0)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:34.021688 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9c85c-5081-4771-833e-11d49c539e69 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:34.058954 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:34.077841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8ec9c85c-5081-4771-833e-11d49c539e69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc0e01fa962d4dd18fd4035b87c578e0', 'request_id': 'req-8ec9c85c-5081-4771-833e-11d49c539e69'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:34.084756 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8ec9c85c-5081-4771-833e-11d49c539e69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc0e01fa962d4dd18fd4035b87c578e0', 'request_id': 'req-8ec9c85c-5081-4771-833e-11d49c539e69'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:34.091093 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8ec9c85c-5081-4771-833e-11d49c539e69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc0e01fa962d4dd18fd4035b87c578e0', 'request_id': 'req-8ec9c85c-5081-4771-833e-11d49c539e69'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:34.101570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8ec9c85c-5081-4771-833e-11d49c539e69 admin admin] The token cache is being invalidate because project fc0e01fa962d4dd18fd4035b87c578e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:13:34.101918 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8ec9c85c-5081-4771-833e-11d49c539e69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:34.102574 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8ec9c85c-5081-4771-833e-11d49c539e69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:13:34.104158 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1337/2705] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:13:33 2022] DELETE /identity/v3/projects/fc0e01fa962d4dd18fd4035b87c578e0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:13:34.109348 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1006253-2806-44a9-aae1-2d56c95cff66 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:34.109701 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1006253-2806-44a9-aae1-2d56c95cff66 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:34.110077 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1006253-2806-44a9-aae1-2d56c95cff66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:34.129117 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d1006253-2806-44a9-aae1-2d56c95cff66 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:34.130823 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d1006253-2806-44a9-aae1-2d56c95cff66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:34.192699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1369/2706] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:13:34.203038 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949274a-e3b8-41e7-b661-9a71657cbc0d None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:34.203409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949274a-e3b8-41e7-b661-9a71657cbc0d None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:34.203742 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949274a-e3b8-41e7-b661-9a71657cbc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:34.227392 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8949274a-e3b8-41e7-b661-9a71657cbc0d None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:34.228604 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8949274a-e3b8-41e7-b661-9a71657cbc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:34.236840 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1338/2707] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:13:34.241695 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1006253-2806-44a9-aae1-2d56c95cff66 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:34.251908 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1006253-2806-44a9-aae1-2d56c95cff66 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:34.256753 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8ee10-c542-4a97-b235-b5d61672a547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:34.257407 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8ee10-c542-4a97-b235-b5d61672a547 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:34.257688 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8ee10-c542-4a97-b235-b5d61672a547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:34.257992 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8ee10-c542-4a97-b235-b5d61672a547 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:34.258716 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8ee10-c542-4a97-b235-b5d61672a547 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:13:34.259021 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8ee10-c542-4a97-b235-b5d61672a547 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:34.260679 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8ee10-c542-4a97-b235-b5d61672a547 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:34.272617 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1370/2708] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:13:34.276584 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949274a-e3b8-41e7-b661-9a71657cbc0d None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:34.286255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949274a-e3b8-41e7-b661-9a71657cbc0d None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:34.290882 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ea63c-54d6-4b9d-84a6-7cae399115a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:34.291565 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ea63c-54d6-4b9d-84a6-7cae399115a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:34.291854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ea63c-54d6-4b9d-84a6-7cae399115a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:34.292131 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ea63c-54d6-4b9d-84a6-7cae399115a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:34.292822 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ea63c-54d6-4b9d-84a6-7cae399115a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:34.294708 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ea63c-54d6-4b9d-84a6-7cae399115a5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:34.325253 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1339/2709] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:13:34 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:13:34.326514 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8ee10-c542-4a97-b235-b5d61672a547 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:34.336615 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8ee10-c542-4a97-b235-b5d61672a547 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:34.393504 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f13127-20de-4a58-81f2-b75f7b6300d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:34.394092 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f13127-20de-4a58-81f2-b75f7b6300d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:34.394379 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f13127-20de-4a58-81f2-b75f7b6300d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:34.394681 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f13127-20de-4a58-81f2-b75f7b6300d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:34.395540 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f13127-20de-4a58-81f2-b75f7b6300d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:34.397452 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f13127-20de-4a58-81f2-b75f7b6300d1 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:34.418950 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1371/2710] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:13:34 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:13:34.423054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ea63c-54d6-4b9d-84a6-7cae399115a5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:34.433772 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ea63c-54d6-4b9d-84a6-7cae399115a5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:34.438358 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8afc0-8150-4ad1-b708-c520d2ea7edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:34.439020 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8afc0-8150-4ad1-b708-c520d2ea7edf admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:34.439343 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8afc0-8150-4ad1-b708-c520d2ea7edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:34.439629 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8afc0-8150-4ad1-b708-c520d2ea7edf admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:34.440359 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8afc0-8150-4ad1-b708-c520d2ea7edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:34.441977 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8afc0-8150-4ad1-b708-c520d2ea7edf admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:34.452398 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1340/2711] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:13:34.456345 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f13127-20de-4a58-81f2-b75f7b6300d1 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:34.466702 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f13127-20de-4a58-81f2-b75f7b6300d1 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:34.471361 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1cef5f-607c-44c0-bd48-786af987e95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:34.472015 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cef5f-607c-44c0-bd48-786af987e95b admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:34.472298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cef5f-607c-44c0-bd48-786af987e95b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:34.472571 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cef5f-607c-44c0-bd48-786af987e95b admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:34.473823 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1cef5f-607c-44c0-bd48-786af987e95b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:34.475465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1cef5f-607c-44c0-bd48-786af987e95b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:34.486446 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1372/2712] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:13:34.491317 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8afc0-8150-4ad1-b708-c520d2ea7edf admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:34.502556 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8afc0-8150-4ad1-b708-c520d2ea7edf admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:34.508224 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf10ff-c3cf-4f64-866b-dc8ed484f163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:34.509130 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf10ff-c3cf-4f64-866b-dc8ed484f163 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:34.509541 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf10ff-c3cf-4f64-866b-dc8ed484f163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:34.510241 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf10ff-c3cf-4f64-866b-dc8ed484f163 admin admin] PATH_INFO: `/v3/projects/5818d7e3ac5946d9a461cabd216feeee/users/c8876815343540c284561a0e308cb6e9/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:34.531490 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf10ff-c3cf-4f64-866b-dc8ed484f163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5818d7e3ac5946d9a461cabd216feeee, user_id=c8876815343540c284561a0e308cb6e9, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:34.534209 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf10ff-c3cf-4f64-866b-dc8ed484f163 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:34.550588 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1341/2713] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:13:34 2022] PUT /identity/v3/projects/5818d7e3ac5946d9a461cabd216feeee/users/c8876815343540c284561a0e308cb6e9/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:13:34.557020 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3231e-c3c0-4ecf-b95b-dae63b6d0bfc None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:34.557867 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3231e-c3c0-4ecf-b95b-dae63b6d0bfc None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:34.558646 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3231e-c3c0-4ecf-b95b-dae63b6d0bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:34.583710 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-71e3231e-c3c0-4ecf-b95b-dae63b6d0bfc None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:34.585501 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-71e3231e-c3c0-4ecf-b95b-dae63b6d0bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:34.657443 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1373/2714] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:13:34.667290 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf10ff-c3cf-4f64-866b-dc8ed484f163 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:34.669101 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-c5bf10ff-c3cf-4f64-866b-dc8ed484f163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:34.725522 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf10ff-c3cf-4f64-866b-dc8ed484f163 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:34.729158 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3208317-6768-4878-94ac-0c781a2fe473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:34.729802 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3208317-6768-4878-94ac-0c781a2fe473 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:34.730088 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3208317-6768-4878-94ac-0c781a2fe473 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:34.730362 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3208317-6768-4878-94ac-0c781a2fe473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:34.739349 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3208317-6768-4878-94ac-0c781a2fe473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:34.740808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3208317-6768-4878-94ac-0c781a2fe473 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:34.750418 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1342/2715] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:13:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:13:35.583742 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56630897-e042-449c-83eb-8f6e2431f2ba None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:35.584273 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56630897-e042-449c-83eb-8f6e2431f2ba None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:35.584369 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56630897-e042-449c-83eb-8f6e2431f2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:35.590113 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:35.613090 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-56630897-e042-449c-83eb-8f6e2431f2ba None None] MFA Rules not processed for user `c8876815343540c284561a0e308cb6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:35.614800 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-56630897-e042-449c-83eb-8f6e2431f2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:35.682293 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1374/2716] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:13:35.694062 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3208317-6768-4878-94ac-0c781a2fe473 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:35.695663 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-b3208317-6768-4878-94ac-0c781a2fe473 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:35.762869 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3208317-6768-4878-94ac-0c781a2fe473 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:35.766515 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870e1be-e887-4e7c-99ef-d2be3e509925 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:35.767175 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870e1be-e887-4e7c-99ef-d2be3e509925 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:35.767506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870e1be-e887-4e7c-99ef-d2be3e509925 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:35.767786 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870e1be-e887-4e7c-99ef-d2be3e509925 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:35.774349 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:35.777519 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870e1be-e887-4e7c-99ef-d2be3e509925 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:35.779068 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3870e1be-e887-4e7c-99ef-d2be3e509925 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:35.793436 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1343/2717] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:13:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:13:37.178405 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966eee6-dab5-483c-88a0-da70eab1cd6c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:37.178881 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966eee6-dab5-483c-88a0-da70eab1cd6c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:37.178981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966eee6-dab5-483c-88a0-da70eab1cd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:37.196866 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-0966eee6-dab5-483c-88a0-da70eab1cd6c None None] MFA Rules not processed for user `c8876815343540c284561a0e308cb6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:37.198043 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0966eee6-dab5-483c-88a0-da70eab1cd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:37.204833 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1375/2718] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:13:38.465215 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870e1be-e887-4e7c-99ef-d2be3e509925 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:13:38.467730 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-3870e1be-e887-4e7c-99ef-d2be3e509925 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:38.537870 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870e1be-e887-4e7c-99ef-d2be3e509925 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:13:38.542895 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0ebcb-8960-460e-b7f5-89d722ed9a0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adec680c4f5f4e6dbe5989d5d7acf620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:13:38.543695 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0ebcb-8960-460e-b7f5-89d722ed9a0c service placement] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:38.543985 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0ebcb-8960-460e-b7f5-89d722ed9a0c service placement] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:38.544265 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0ebcb-8960-460e-b7f5-89d722ed9a0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:38.546062 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-fdc0ebcb-8960-460e-b7f5-89d722ed9a0c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:38.559933 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0ebcb-8960-460e-b7f5-89d722ed9a0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:13:38.561528 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0ebcb-8960-460e-b7f5-89d722ed9a0c service placement] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:13:38.572158 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1344/2719] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:13:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 15:13:47.190925 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=34 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:48.567296 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=34 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:55.127397 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22aba9f-ccf5-428c-9d4c-336e8d999761 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:55.127954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22aba9f-ccf5-428c-9d4c-336e8d999761 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:55.127954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22aba9f-ccf5-428c-9d4c-336e8d999761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:55.146761 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-a22aba9f-ccf5-428c-9d4c-336e8d999761 None None] MFA Rules not processed for user `c8876815343540c284561a0e308cb6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:55.148002 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a22aba9f-ccf5-428c-9d4c-336e8d999761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:55.157204 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1376/2720] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:13:56.927167 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f88e1-d7da-4524-a60d-d84b5d86726f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:13:56.928082 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f88e1-d7da-4524-a60d-d84b5d86726f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:13:56.928368 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f88e1-d7da-4524-a60d-d84b5d86726f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:13:56.947588 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-e60f88e1-d7da-4524-a60d-d84b5d86726f None None] MFA Rules not processed for user `0022fc1107834a5cbe30f0146361213b`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:13:56.949148 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e60f88e1-d7da-4524-a60d-d84b5d86726f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:13:57.015048 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1345/2721] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:13:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:14:05.139928 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:14:07.003178 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=25 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:14:15.511622 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afe1f0-83de-4ad7-9889-ba58c6f31c7f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:14:15.512131 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afe1f0-83de-4ad7-9889-ba58c6f31c7f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:14:15.512237 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afe1f0-83de-4ad7-9889-ba58c6f31c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:14:15.530023 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d7afe1f0-83de-4ad7-9889-ba58c6f31c7f None None] MFA Rules not processed for user `fcd1725924134616b903b3e374d45817`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:14:15.531193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d7afe1f0-83de-4ad7-9889-ba58c6f31c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:14:15.586676 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1377/2722] 10.222.0.24 () {58 vars in 1009 bytes} [Thu May 19 15:14:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:14:15.634342 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f88e1-d7da-4524-a60d-d84b5d86726f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:14:15.635973 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e60f88e1-d7da-4524-a60d-d84b5d86726f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:14:15.703855 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f88e1-d7da-4524-a60d-d84b5d86726f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:14:15.709625 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4176b53-5f32-46e6-bf1d-731fc84edd04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecbeee0c1cf4c58be6c22aa11d7ff5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:14:15.710277 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4176b53-5f32-46e6-bf1d-731fc84edd04 service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:14:15.710568 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4176b53-5f32-46e6-bf1d-731fc84edd04 service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:14:15.710849 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4176b53-5f32-46e6-bf1d-731fc84edd04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:14:15.718796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4176b53-5f32-46e6-bf1d-731fc84edd04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:14:15.720468 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4176b53-5f32-46e6-bf1d-731fc84edd04 service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:14:15.728772 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1346/2723] 10.222.0.24 () {60 vars in 1384 bytes} [Thu May 19 15:14:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 15:14:25.579571 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=25 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:14:25.725575 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=32 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:14:30.116919 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e38d1-f91c-491f-bd7a-d8873736df0d None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:14:30.117372 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e38d1-f91c-491f-bd7a-d8873736df0d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:14:30.117471 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e38d1-f91c-491f-bd7a-d8873736df0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:14:30.135860 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e72e38d1-f91c-491f-bd7a-d8873736df0d None None] MFA Rules not processed for user `fcd1725924134616b903b3e374d45817`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:14:30.137038 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e72e38d1-f91c-491f-bd7a-d8873736df0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:14:30.144117 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1378/2724] 10.222.0.24 () {58 vars in 967 bytes} [Thu May 19 15:14:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:14:30.157965 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4176b53-5f32-46e6-bf1d-731fc84edd04 service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:14:30.169882 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4176b53-5f32-46e6-bf1d-731fc84edd04 service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:14:30.180564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9458a8-e84b-459a-8f9c-26276a3113a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecbeee0c1cf4c58be6c22aa11d7ff5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:14:30.181216 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9458a8-e84b-459a-8f9c-26276a3113a6 service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:14:30.181505 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9458a8-e84b-459a-8f9c-26276a3113a6 service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:14:30.181785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9458a8-e84b-459a-8f9c-26276a3113a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:14:30.192382 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9458a8-e84b-459a-8f9c-26276a3113a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:14:30.193974 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9458a8-e84b-459a-8f9c-26276a3113a6 service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:14:30.202142 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1347/2725] 10.222.0.24 () {60 vars in 1384 bytes} [Thu May 19 15:14:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 15:14:32.089360 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e38d1-f91c-491f-bd7a-d8873736df0d None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:14:32.101871 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e38d1-f91c-491f-bd7a-d8873736df0d None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:14:32.106672 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896b602-dec3-41f5-9851-57b6243f71f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:14:32.107501 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896b602-dec3-41f5-9851-57b6243f71f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:14:32.107791 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896b602-dec3-41f5-9851-57b6243f71f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:14:32.108069 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896b602-dec3-41f5-9851-57b6243f71f5 admin admin] PATH_INFO: `/v3/users/c8876815343540c284561a0e308cb6e9` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:14:32.109307 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896b602-dec3-41f5-9851-57b6243f71f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8876815343540c284561a0e308cb6e9)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:14:32.112353 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896b602-dec3-41f5-9851-57b6243f71f5 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:14:32.159553 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-2896b602-dec3-41f5-9851-57b6243f71f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8876815343540c284561a0e308cb6e9'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:14:32.160200 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-2896b602-dec3-41f5-9851-57b6243f71f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8876815343540c284561a0e308cb6e9'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:14:32.160797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-2896b602-dec3-41f5-9851-57b6243f71f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8876815343540c284561a0e308cb6e9'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:14:32.168406 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-2896b602-dec3-41f5-9851-57b6243f71f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8876815343540c284561a0e308cb6e9'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:14:32.180438 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-2896b602-dec3-41f5-9851-57b6243f71f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8876815343540c284561a0e308cb6e9'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:14:32.192084 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1379/2726] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:14:32 2022] DELETE /identity/v3/users/c8876815343540c284561a0e308cb6e9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:14:32.359007 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9458a8-e84b-459a-8f9c-26276a3113a6 service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:14:32.372156 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9458a8-e84b-459a-8f9c-26276a3113a6 service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:14:32.429097 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965993a1-7ca7-4267-9770-03d06abfdf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:14:32.429945 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965993a1-7ca7-4267-9770-03d06abfdf99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:14:32.430241 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965993a1-7ca7-4267-9770-03d06abfdf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:14:32.430519 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965993a1-7ca7-4267-9770-03d06abfdf99 admin admin] PATH_INFO: `/v3/projects/5818d7e3ac5946d9a461cabd216feeee` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:14:32.431850 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965993a1-7ca7-4267-9770-03d06abfdf99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5818d7e3ac5946d9a461cabd216feeee)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:14:32.433788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965993a1-7ca7-4267-9770-03d06abfdf99 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:14:32.478683 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-965993a1-7ca7-4267-9770-03d06abfdf99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5818d7e3ac5946d9a461cabd216feeee', 'request_id': 'req-965993a1-7ca7-4267-9770-03d06abfdf99'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:14:32.485376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-965993a1-7ca7-4267-9770-03d06abfdf99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5818d7e3ac5946d9a461cabd216feeee', 'request_id': 'req-965993a1-7ca7-4267-9770-03d06abfdf99'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:14:32.492069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-965993a1-7ca7-4267-9770-03d06abfdf99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5818d7e3ac5946d9a461cabd216feeee', 'request_id': 'req-965993a1-7ca7-4267-9770-03d06abfdf99'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:14:32.502402 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-965993a1-7ca7-4267-9770-03d06abfdf99 admin admin] The token cache is being invalidate because project 5818d7e3ac5946d9a461cabd216feeee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:14:32.502693 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-965993a1-7ca7-4267-9770-03d06abfdf99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:14:32.503506 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-965993a1-7ca7-4267-9770-03d06abfdf99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:14:32.505243 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1348/2727] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:14:32 2022] DELETE /identity/v3/projects/5818d7e3ac5946d9a461cabd216feeee => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:14:32.509847 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bf990-64a1-4333-973f-fa52e9b67cfb None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:14:32.510137 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bf990-64a1-4333-973f-fa52e9b67cfb None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:14:32.510540 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bf990-64a1-4333-973f-fa52e9b67cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:14:32.529306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-db3bf990-64a1-4333-973f-fa52e9b67cfb None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:14:32.530485 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-db3bf990-64a1-4333-973f-fa52e9b67cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:14:32.591705 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1380/2728] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:14:32.599384 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b039e22-eb10-4a4c-a26b-3a47526ed1be None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:14:32.600250 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b039e22-eb10-4a4c-a26b-3a47526ed1be None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:14:32.600536 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b039e22-eb10-4a4c-a26b-3a47526ed1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:14:32.618389 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0b039e22-eb10-4a4c-a26b-3a47526ed1be None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:14:32.619881 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0b039e22-eb10-4a4c-a26b-3a47526ed1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:14:32.627958 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1349/2729] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:14:32.632725 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bf990-64a1-4333-973f-fa52e9b67cfb None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:14:32.642459 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bf990-64a1-4333-973f-fa52e9b67cfb None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:14:32.647747 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c53c1-ae37-45be-99d0-8b3a9632b81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:14:32.648424 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c53c1-ae37-45be-99d0-8b3a9632b81c admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:14:32.648710 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c53c1-ae37-45be-99d0-8b3a9632b81c admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:14:32.648986 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c53c1-ae37-45be-99d0-8b3a9632b81c admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:14:32.649708 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c53c1-ae37-45be-99d0-8b3a9632b81c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:14:32.650015 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c53c1-ae37-45be-99d0-8b3a9632b81c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:14:32.651642 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c53c1-ae37-45be-99d0-8b3a9632b81c admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:14:32.663092 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1381/2730] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:14:32.667137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b039e22-eb10-4a4c-a26b-3a47526ed1be None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:14:32.676367 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b039e22-eb10-4a4c-a26b-3a47526ed1be None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:14:32.681084 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf76a9-1b75-47cc-bf32-7443d74fee9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:14:32.681664 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf76a9-1b75-47cc-bf32-7443d74fee9a admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:14:32.681948 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf76a9-1b75-47cc-bf32-7443d74fee9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:14:32.682221 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf76a9-1b75-47cc-bf32-7443d74fee9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:14:32.682908 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf76a9-1b75-47cc-bf32-7443d74fee9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:14:32.684860 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf76a9-1b75-47cc-bf32-7443d74fee9a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:14:32.713480 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1350/2731] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:14:32 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:14:32.715164 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c53c1-ae37-45be-99d0-8b3a9632b81c admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:14:32.725280 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c53c1-ae37-45be-99d0-8b3a9632b81c admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:14:32.771363 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:14:32.783182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada63e60-9e83-4492-98b4-f7bbb1c7ca6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:14:32.783879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada63e60-9e83-4492-98b4-f7bbb1c7ca6e admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:14:32.784192 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada63e60-9e83-4492-98b4-f7bbb1c7ca6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:14:32.784469 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada63e60-9e83-4492-98b4-f7bbb1c7ca6e admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:14:32.785200 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada63e60-9e83-4492-98b4-f7bbb1c7ca6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:14:32.787630 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada63e60-9e83-4492-98b4-f7bbb1c7ca6e admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:14:32.807059 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1382/2732] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:14:32 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:14:32.811327 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf76a9-1b75-47cc-bf32-7443d74fee9a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:14:32.821507 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf76a9-1b75-47cc-bf32-7443d74fee9a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:14:32.826224 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7ed87-1413-4486-a34b-14354f697f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:14:32.826899 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7ed87-1413-4486-a34b-14354f697f35 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:14:32.827188 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7ed87-1413-4486-a34b-14354f697f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:14:32.827494 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7ed87-1413-4486-a34b-14354f697f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:14:32.828232 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc7ed87-1413-4486-a34b-14354f697f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:14:32.829864 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc7ed87-1413-4486-a34b-14354f697f35 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:14:32.840317 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1351/2733] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:14:32.844288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada63e60-9e83-4492-98b4-f7bbb1c7ca6e admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:14:32.855297 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada63e60-9e83-4492-98b4-f7bbb1c7ca6e admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:14:32.859898 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562ba37-cbad-49e4-ac94-29b054642f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:14:32.860551 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562ba37-cbad-49e4-ac94-29b054642f39 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:14:32.860839 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562ba37-cbad-49e4-ac94-29b054642f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:14:32.861121 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562ba37-cbad-49e4-ac94-29b054642f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:14:32.861850 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562ba37-cbad-49e4-ac94-29b054642f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:14:32.863479 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562ba37-cbad-49e4-ac94-29b054642f39 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:14:32.874120 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1383/2734] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 15:14:32.877999 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7ed87-1413-4486-a34b-14354f697f35 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:14:32.890062 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7ed87-1413-4486-a34b-14354f697f35 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:14:32.897176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f44fb1-cb6f-410b-afcb-026a7ff5ccc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:14:32.898072 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f44fb1-cb6f-410b-afcb-026a7ff5ccc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:14:32.898364 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f44fb1-cb6f-410b-afcb-026a7ff5ccc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:14:32.898647 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f44fb1-cb6f-410b-afcb-026a7ff5ccc9 admin admin] PATH_INFO: `/v3/projects/1993c742baa24b3c9d9d39976b7617f6/users/b5b5687a72d84665ac05fd818b2d133a/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:14:32.915514 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f44fb1-cb6f-410b-afcb-026a7ff5ccc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1993c742baa24b3c9d9d39976b7617f6, user_id=b5b5687a72d84665ac05fd818b2d133a, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:14:32.918211 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f44fb1-cb6f-410b-afcb-026a7ff5ccc9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:14:32.931525 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1352/2735] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:14:32 2022] PUT /identity/v3/projects/1993c742baa24b3c9d9d39976b7617f6/users/b5b5687a72d84665ac05fd818b2d133a/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:14:32.941487 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ec0d8-dc72-45e9-9493-35df1179c089 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:14:32.941779 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ec0d8-dc72-45e9-9493-35df1179c089 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:14:32.942054 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ec0d8-dc72-45e9-9493-35df1179c089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:14:32.967795 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-791ec0d8-dc72-45e9-9493-35df1179c089 None None] MFA Rules not processed for user `b5b5687a72d84665ac05fd818b2d133a`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:14:32.968995 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-791ec0d8-dc72-45e9-9493-35df1179c089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:14:33.032353 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1384/2736] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:14:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:14:33.043447 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f44fb1-cb6f-410b-afcb-026a7ff5ccc9 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:14:33.045185 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-61f44fb1-cb6f-410b-afcb-026a7ff5ccc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:14:33.059260 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:14:33.103814 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f44fb1-cb6f-410b-afcb-026a7ff5ccc9 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:14:33.107539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf6621-7540-4d15-ae7f-bf3e1e7ba02e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:14:33.108194 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf6621-7540-4d15-ae7f-bf3e1e7ba02e service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:14:33.108481 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf6621-7540-4d15-ae7f-bf3e1e7ba02e service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:14:33.108759 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf6621-7540-4d15-ae7f-bf3e1e7ba02e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:14:33.117457 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf6621-7540-4d15-ae7f-bf3e1e7ba02e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:14:33.118929 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf6621-7540-4d15-ae7f-bf3e1e7ba02e service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:14:33.128850 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1353/2737] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:14:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:14:42.939826 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ec0d8-dc72-45e9-9493-35df1179c089 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:14:42.999590 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ec0d8-dc72-45e9-9493-35df1179c089 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:14:43.003954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94de56-2695-4df4-97f3-455ebc5066c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:14:43.004834 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94de56-2695-4df4-97f3-455ebc5066c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:14:43.005112 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94de56-2695-4df4-97f3-455ebc5066c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:14:43.005383 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94de56-2695-4df4-97f3-455ebc5066c7 admin admin] PATH_INFO: `/v3/users/b5b5687a72d84665ac05fd818b2d133a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:14:43.007129 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94de56-2695-4df4-97f3-455ebc5066c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5b5687a72d84665ac05fd818b2d133a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:14:43.009051 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94de56-2695-4df4-97f3-455ebc5066c7 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:14:43.053414 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6f94de56-2695-4df4-97f3-455ebc5066c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5b5687a72d84665ac05fd818b2d133a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:14:43.054047 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6f94de56-2695-4df4-97f3-455ebc5066c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5b5687a72d84665ac05fd818b2d133a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:14:43.054636 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6f94de56-2695-4df4-97f3-455ebc5066c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5b5687a72d84665ac05fd818b2d133a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:14:43.061730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6f94de56-2695-4df4-97f3-455ebc5066c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5b5687a72d84665ac05fd818b2d133a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:14:43.069465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:14:43.075885 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-6f94de56-2695-4df4-97f3-455ebc5066c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5b5687a72d84665ac05fd818b2d133a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:14:43.088953 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1385/2738] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:14:42 2022] DELETE /identity/v3/users/b5b5687a72d84665ac05fd818b2d133a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:14:43.093419 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a52d46-b29e-4927-a3ad-99ce51cc0e54 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:14:43.093894 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a52d46-b29e-4927-a3ad-99ce51cc0e54 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:14:43.094024 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a52d46-b29e-4927-a3ad-99ce51cc0e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:14:43.110546 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d4a52d46-b29e-4927-a3ad-99ce51cc0e54 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:14:43.111767 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d4a52d46-b29e-4927-a3ad-99ce51cc0e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:14:43.171803 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1354/2739] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:14:43.181913 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94de56-2695-4df4-97f3-455ebc5066c7 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:14:43.183415 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-6f94de56-2695-4df4-97f3-455ebc5066c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:14:43.239795 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94de56-2695-4df4-97f3-455ebc5066c7 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:14:43.244039 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4a4ab-f054-4fa6-9b4f-69efee4e13e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:14:43.244945 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4a4ab-f054-4fa6-9b4f-69efee4e13e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:14:43.245230 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4a4ab-f054-4fa6-9b4f-69efee4e13e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:14:43.245509 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4a4ab-f054-4fa6-9b4f-69efee4e13e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:14:43.254294 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4a4ab-f054-4fa6-9b4f-69efee4e13e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:14:43.255749 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4a4ab-f054-4fa6-9b4f-69efee4e13e2 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:14:43.265288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1386/2740] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:14:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:14:43.533446 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a52d46-b29e-4927-a3ad-99ce51cc0e54 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:14:43.534934 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d4a52d46-b29e-4927-a3ad-99ce51cc0e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:14:43.547512 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a52d46-b29e-4927-a3ad-99ce51cc0e54 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:14:43.552110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba14a86-e348-4260-86d8-87ecb821960b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:14:43.553003 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba14a86-e348-4260-86d8-87ecb821960b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:14:43.553282 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba14a86-e348-4260-86d8-87ecb821960b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:14:43.553553 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba14a86-e348-4260-86d8-87ecb821960b admin admin] PATH_INFO: `/v3/projects/1993c742baa24b3c9d9d39976b7617f6` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:14:43.554753 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba14a86-e348-4260-86d8-87ecb821960b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1993c742baa24b3c9d9d39976b7617f6)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:14:43.557501 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba14a86-e348-4260-86d8-87ecb821960b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:14:43.603591 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fba14a86-e348-4260-86d8-87ecb821960b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1993c742baa24b3c9d9d39976b7617f6', 'request_id': 'req-fba14a86-e348-4260-86d8-87ecb821960b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:14:43.610819 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fba14a86-e348-4260-86d8-87ecb821960b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1993c742baa24b3c9d9d39976b7617f6', 'request_id': 'req-fba14a86-e348-4260-86d8-87ecb821960b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:14:43.617136 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fba14a86-e348-4260-86d8-87ecb821960b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1993c742baa24b3c9d9d39976b7617f6', 'request_id': 'req-fba14a86-e348-4260-86d8-87ecb821960b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:14:43.627793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fba14a86-e348-4260-86d8-87ecb821960b admin admin] The token cache is being invalidate because project 1993c742baa24b3c9d9d39976b7617f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:14:43.628087 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fba14a86-e348-4260-86d8-87ecb821960b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:14:43.628728 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-fba14a86-e348-4260-86d8-87ecb821960b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:14:43.630517 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1355/2741] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:14:43 2022] DELETE /identity/v3/projects/1993c742baa24b3c9d9d39976b7617f6 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:14:43.636837 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9d62e-b70c-48ac-9b1b-4dd8d0c86b04 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:14:43.637131 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9d62e-b70c-48ac-9b1b-4dd8d0c86b04 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:14:43.637416 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9d62e-b70c-48ac-9b1b-4dd8d0c86b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:14:43.654996 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-33d9d62e-b70c-48ac-9b1b-4dd8d0c86b04 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:14:43.656245 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-33d9d62e-b70c-48ac-9b1b-4dd8d0c86b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:14:43.713438 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1387/2742] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:14:43.770539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdcbc6-507e-4c8e-94d1-7649abcc51fe None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:14:43.770835 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdcbc6-507e-4c8e-94d1-7649abcc51fe None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:14:43.771127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdcbc6-507e-4c8e-94d1-7649abcc51fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:14:43.790357 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-76fdcbc6-507e-4c8e-94d1-7649abcc51fe None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:14:43.791826 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-76fdcbc6-507e-4c8e-94d1-7649abcc51fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:14:43.800551 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1356/2743] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:14:43.804729 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9d62e-b70c-48ac-9b1b-4dd8d0c86b04 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:14:43.814350 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9d62e-b70c-48ac-9b1b-4dd8d0c86b04 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:14:43.819044 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a7e03-3db8-421d-955f-fccd0e03ae98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:14:43.819799 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a7e03-3db8-421d-955f-fccd0e03ae98 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:14:43.820086 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a7e03-3db8-421d-955f-fccd0e03ae98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:14:43.820361 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a7e03-3db8-421d-955f-fccd0e03ae98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:14:43.821087 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a7e03-3db8-421d-955f-fccd0e03ae98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:14:43.821399 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a7e03-3db8-421d-955f-fccd0e03ae98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:14:43.823045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a7e03-3db8-421d-955f-fccd0e03ae98 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:14:43.835630 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1388/2744] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:14:43.839450 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fdcbc6-507e-4c8e-94d1-7649abcc51fe None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:14:43.848561 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fdcbc6-507e-4c8e-94d1-7649abcc51fe None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:14:43.853999 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a323d-cab7-45f9-bf46-fe2ada83deea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:14:43.854655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a323d-cab7-45f9-bf46-fe2ada83deea admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:14:43.854943 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a323d-cab7-45f9-bf46-fe2ada83deea admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:14:43.855253 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a323d-cab7-45f9-bf46-fe2ada83deea admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:14:43.855957 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a323d-cab7-45f9-bf46-fe2ada83deea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:14:43.857867 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a323d-cab7-45f9-bf46-fe2ada83deea admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:14:43.884107 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1357/2745] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:14:43 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:14:43.887757 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a7e03-3db8-421d-955f-fccd0e03ae98 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:14:43.898178 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a7e03-3db8-421d-955f-fccd0e03ae98 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:14:43.952822 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4b6db-1ffe-4fde-bc77-4a7148572dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:14:43.953485 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4b6db-1ffe-4fde-bc77-4a7148572dcd admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:14:43.953771 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4b6db-1ffe-4fde-bc77-4a7148572dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:14:43.954050 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4b6db-1ffe-4fde-bc77-4a7148572dcd admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:14:43.954753 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4b6db-1ffe-4fde-bc77-4a7148572dcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:14:43.956694 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4b6db-1ffe-4fde-bc77-4a7148572dcd admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:14:43.971928 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:14:43.977932 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1389/2746] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:14:43 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:14:43.981888 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a323d-cab7-45f9-bf46-fe2ada83deea admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:14:43.991970 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a323d-cab7-45f9-bf46-fe2ada83deea admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:14:43.996781 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237fc857-1482-4776-a710-e8d719393b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:14:43.997424 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237fc857-1482-4776-a710-e8d719393b2a admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:14:43.997708 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237fc857-1482-4776-a710-e8d719393b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:14:43.997982 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237fc857-1482-4776-a710-e8d719393b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:14:43.998699 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237fc857-1482-4776-a710-e8d719393b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:14:44.000325 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237fc857-1482-4776-a710-e8d719393b2a admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:14:44.005341 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:14:44.014660 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1358/2747] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:14:44.015945 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4b6db-1ffe-4fde-bc77-4a7148572dcd admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:14:44.026959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4b6db-1ffe-4fde-bc77-4a7148572dcd admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:14:44.031781 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917485fc-42d6-4c3b-a831-222102ca6200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:14:44.033391 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917485fc-42d6-4c3b-a831-222102ca6200 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:14:44.033714 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917485fc-42d6-4c3b-a831-222102ca6200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:14:44.033940 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917485fc-42d6-4c3b-a831-222102ca6200 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:14:44.034661 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917485fc-42d6-4c3b-a831-222102ca6200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:14:44.036285 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917485fc-42d6-4c3b-a831-222102ca6200 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:14:44.046663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1390/2748] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:14:44.051997 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237fc857-1482-4776-a710-e8d719393b2a admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:14:44.061918 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237fc857-1482-4776-a710-e8d719393b2a admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:14:44.066474 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceabf3e-3171-463a-b1fc-b9df2c244f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:14:44.067382 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceabf3e-3171-463a-b1fc-b9df2c244f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:14:44.067666 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceabf3e-3171-463a-b1fc-b9df2c244f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:14:44.067937 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceabf3e-3171-463a-b1fc-b9df2c244f3e admin admin] PATH_INFO: `/v3/projects/f2bcd4570a054c0eb8131280512ada61/users/fbd500b2e8e54534b368c3bd664baa24/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:14:44.082432 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceabf3e-3171-463a-b1fc-b9df2c244f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2bcd4570a054c0eb8131280512ada61, user_id=fbd500b2e8e54534b368c3bd664baa24, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:14:44.085767 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceabf3e-3171-463a-b1fc-b9df2c244f3e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:14:44.098874 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1359/2749] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:14:44 2022] PUT /identity/v3/projects/f2bcd4570a054c0eb8131280512ada61/users/fbd500b2e8e54534b368c3bd664baa24/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:14:44.108757 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadc14b-bfe7-48a2-be46-b9ab3fbc4c4f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:14:44.109074 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadc14b-bfe7-48a2-be46-b9ab3fbc4c4f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:14:44.109388 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffadc14b-bfe7-48a2-be46-b9ab3fbc4c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:14:44.139019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-ffadc14b-bfe7-48a2-be46-b9ab3fbc4c4f None None] MFA Rules not processed for user `fbd500b2e8e54534b368c3bd664baa24`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:14:44.140298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ffadc14b-bfe7-48a2-be46-b9ab3fbc4c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:14:44.203288 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1391/2750] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:14:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:14:44.214572 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceabf3e-3171-463a-b1fc-b9df2c244f3e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:14:44.216283 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4ceabf3e-3171-463a-b1fc-b9df2c244f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:14:44.280031 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceabf3e-3171-463a-b1fc-b9df2c244f3e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:14:44.283678 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0efd27-5cd8-46c5-82b2-0009731fbd62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:14:44.284332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0efd27-5cd8-46c5-82b2-0009731fbd62 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:14:44.284621 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0efd27-5cd8-46c5-82b2-0009731fbd62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:14:44.284906 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0efd27-5cd8-46c5-82b2-0009731fbd62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:14:44.293303 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0efd27-5cd8-46c5-82b2-0009731fbd62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:14:44.294847 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0efd27-5cd8-46c5-82b2-0009731fbd62 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:14:44.304060 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1360/2751] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:14:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:14:45.644006 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08808d5-bf38-4aa5-a3b7-bf5df77d353c None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:14:45.644522 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08808d5-bf38-4aa5-a3b7-bf5df77d353c None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:14:45.644639 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08808d5-bf38-4aa5-a3b7-bf5df77d353c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:14:45.662406 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-d08808d5-bf38-4aa5-a3b7-bf5df77d353c None None] MFA Rules not processed for user `fbd500b2e8e54534b368c3bd664baa24`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:14:45.663629 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d08808d5-bf38-4aa5-a3b7-bf5df77d353c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:14:45.670334 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1392/2752] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:14:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:14:54.299620 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=36,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:14:55.657222 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=40 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:01.165321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9d284-9e67-4414-8d43-0c438d8ab8d7 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:01.166418 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9d284-9e67-4414-8d43-0c438d8ab8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:01.166893 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9d284-9e67-4414-8d43-0c438d8ab8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:01.194778 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-15e9d284-9e67-4414-8d43-0c438d8ab8d7 None None] MFA Rules not processed for user `fcd1725924134616b903b3e374d45817`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:15:01.196420 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-15e9d284-9e67-4414-8d43-0c438d8ab8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:01.275362 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1361/2753] 10.222.0.24 () {58 vars in 1009 bytes} [Thu May 19 15:15:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:15:01.285429 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08808d5-bf38-4aa5-a3b7-bf5df77d353c None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:01.287292 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d08808d5-bf38-4aa5-a3b7-bf5df77d353c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:01.428672 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08808d5-bf38-4aa5-a3b7-bf5df77d353c None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:01.434306 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9d284-9e67-4414-8d43-0c438d8ab8d7 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:01.435954 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-15e9d284-9e67-4414-8d43-0c438d8ab8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:01.437437 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5024b-54ce-4e44-a1ce-b92e6bac53ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecbeee0c1cf4c58be6c22aa11d7ff5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:01.438122 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5024b-54ce-4e44-a1ce-b92e6bac53ee service swift] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:01.438525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5024b-54ce-4e44-a1ce-b92e6bac53ee service swift] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:01.438807 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5024b-54ce-4e44-a1ce-b92e6bac53ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:01.450790 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5024b-54ce-4e44-a1ce-b92e6bac53ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:01.452457 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5024b-54ce-4e44-a1ce-b92e6bac53ee service swift] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:01.472563 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1393/2754] 10.222.0.24 () {60 vars in 1384 bytes} [Thu May 19 15:15:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 15:15:01.560729 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9d284-9e67-4414-8d43-0c438d8ab8d7 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:01.565845 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8167d6b-c036-4ada-aad1-3c92b53900e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:01.566808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8167d6b-c036-4ada-aad1-3c92b53900e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:01.567223 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8167d6b-c036-4ada-aad1-3c92b53900e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:01.567571 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8167d6b-c036-4ada-aad1-3c92b53900e8 admin admin] PATH_INFO: `/v3/users/48e29cb55f7d4acabfc451e996b07791` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:01.569358 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8167d6b-c036-4ada-aad1-3c92b53900e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48e29cb55f7d4acabfc451e996b07791)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:01.571468 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8167d6b-c036-4ada-aad1-3c92b53900e8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:01.628326 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d8167d6b-c036-4ada-aad1-3c92b53900e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48e29cb55f7d4acabfc451e996b07791'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:01.636311 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d8167d6b-c036-4ada-aad1-3c92b53900e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48e29cb55f7d4acabfc451e996b07791'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:01.653487 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d8167d6b-c036-4ada-aad1-3c92b53900e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48e29cb55f7d4acabfc451e996b07791'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:01.654204 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d8167d6b-c036-4ada-aad1-3c92b53900e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48e29cb55f7d4acabfc451e996b07791'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:01.654970 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d8167d6b-c036-4ada-aad1-3c92b53900e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48e29cb55f7d4acabfc451e996b07791'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:01.671492 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1362/2755] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:15:01 2022] DELETE /identity/v3/users/48e29cb55f7d4acabfc451e996b07791 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:15:01.876693 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5024b-54ce-4e44-a1ce-b92e6bac53ee service swift] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:01.890041 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5024b-54ce-4e44-a1ce-b92e6bac53ee service swift] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:01.953386 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ed363-4f72-4bc4-be5a-a0bebee6559a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:01.954258 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ed363-4f72-4bc4-be5a-a0bebee6559a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:01.954543 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ed363-4f72-4bc4-be5a-a0bebee6559a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:01.954829 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ed363-4f72-4bc4-be5a-a0bebee6559a admin admin] PATH_INFO: `/v3/projects/ee9ba7310e7e4d558dba77f08668b77b` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:01.956063 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ed363-4f72-4bc4-be5a-a0bebee6559a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee9ba7310e7e4d558dba77f08668b77b)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:01.957979 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ed363-4f72-4bc4-be5a-a0bebee6559a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:02.005304 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-175ed363-4f72-4bc4-be5a-a0bebee6559a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee9ba7310e7e4d558dba77f08668b77b', 'request_id': 'req-175ed363-4f72-4bc4-be5a-a0bebee6559a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:02.011323 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-175ed363-4f72-4bc4-be5a-a0bebee6559a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee9ba7310e7e4d558dba77f08668b77b', 'request_id': 'req-175ed363-4f72-4bc4-be5a-a0bebee6559a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:02.017910 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-175ed363-4f72-4bc4-be5a-a0bebee6559a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee9ba7310e7e4d558dba77f08668b77b', 'request_id': 'req-175ed363-4f72-4bc4-be5a-a0bebee6559a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:02.030840 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-175ed363-4f72-4bc4-be5a-a0bebee6559a admin admin] The token cache is being invalidate because project ee9ba7310e7e4d558dba77f08668b77b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:15:02.031183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-175ed363-4f72-4bc4-be5a-a0bebee6559a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:02.031903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-175ed363-4f72-4bc4-be5a-a0bebee6559a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:02.033549 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1394/2756] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:15:01 2022] DELETE /identity/v3/projects/ee9ba7310e7e4d558dba77f08668b77b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:15:02.037940 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8167d6b-c036-4ada-aad1-3c92b53900e8 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:02.039573 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d8167d6b-c036-4ada-aad1-3c92b53900e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:02.043928 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dde91-e950-423a-acce-910d98a41905 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:02.044227 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dde91-e950-423a-acce-910d98a41905 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:02.044544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dde91-e950-423a-acce-910d98a41905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:02.053590 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8167d6b-c036-4ada-aad1-3c92b53900e8 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:02.062892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-989dde91-e950-423a-acce-910d98a41905 None None] MFA Rules not processed for user `fcd1725924134616b903b3e374d45817`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:15:02.064209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-989dde91-e950-423a-acce-910d98a41905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:02.074512 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:02.078071 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:02.116089 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7046c39-9c5f-49f4-9189-66eb64351232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:02.116975 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7046c39-9c5f-49f4-9189-66eb64351232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:02.117263 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7046c39-9c5f-49f4-9189-66eb64351232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:02.117540 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7046c39-9c5f-49f4-9189-66eb64351232 admin admin] PATH_INFO: `/v3/users/ff95cbb5fcca4170992793ec3fe89dcb` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:02.118711 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7046c39-9c5f-49f4-9189-66eb64351232 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff95cbb5fcca4170992793ec3fe89dcb)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:02.120962 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7046c39-9c5f-49f4-9189-66eb64351232 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:02.123555 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1395/2757] 10.222.0.24 () {58 vars in 967 bytes} [Thu May 19 15:15:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:15:02.136537 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989dde91-e950-423a-acce-910d98a41905 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:02.137902 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-989dde91-e950-423a-acce-910d98a41905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:02.169544 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d7046c39-9c5f-49f4-9189-66eb64351232 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff95cbb5fcca4170992793ec3fe89dcb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:02.176485 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d7046c39-9c5f-49f4-9189-66eb64351232 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff95cbb5fcca4170992793ec3fe89dcb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:02.188918 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d7046c39-9c5f-49f4-9189-66eb64351232 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff95cbb5fcca4170992793ec3fe89dcb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:02.189609 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d7046c39-9c5f-49f4-9189-66eb64351232 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff95cbb5fcca4170992793ec3fe89dcb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:02.190224 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d7046c39-9c5f-49f4-9189-66eb64351232 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff95cbb5fcca4170992793ec3fe89dcb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:02.202951 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1363/2758] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:15:02 2022] DELETE /identity/v3/users/ff95cbb5fcca4170992793ec3fe89dcb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:15:02.208389 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989dde91-e950-423a-acce-910d98a41905 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:02.273511 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfdae1-d912-490d-9270-0914c516f25a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecbeee0c1cf4c58be6c22aa11d7ff5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:02.274707 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfdae1-d912-490d-9270-0914c516f25a service swift] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:02.275304 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfdae1-d912-490d-9270-0914c516f25a service swift] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:02.275596 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfdae1-d912-490d-9270-0914c516f25a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:02.277967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-afbfdae1-d912-490d-9270-0914c516f25a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:02.338137 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbfdae1-d912-490d-9270-0914c516f25a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:02.339717 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbfdae1-d912-490d-9270-0914c516f25a service swift] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:02.348202 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1396/2759] 10.222.0.24 () {60 vars in 1384 bytes} [Thu May 19 15:15:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 19 15:15:02.379029 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7046c39-9c5f-49f4-9189-66eb64351232 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:02.380583 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d7046c39-9c5f-49f4-9189-66eb64351232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:02.465397 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7046c39-9c5f-49f4-9189-66eb64351232 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:02.469854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607df2b2-1cfd-46fd-b2b3-c7faf9b700b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:02.470718 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607df2b2-1cfd-46fd-b2b3-c7faf9b700b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:02.471002 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607df2b2-1cfd-46fd-b2b3-c7faf9b700b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:02.471314 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607df2b2-1cfd-46fd-b2b3-c7faf9b700b8 admin admin] PATH_INFO: `/v3/projects/c02cc267fc614f1fb0ff3b573b244a9b` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:02.472523 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607df2b2-1cfd-46fd-b2b3-c7faf9b700b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c02cc267fc614f1fb0ff3b573b244a9b)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:02.475026 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607df2b2-1cfd-46fd-b2b3-c7faf9b700b8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:02.522492 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:02.525578 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-607df2b2-1cfd-46fd-b2b3-c7faf9b700b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c02cc267fc614f1fb0ff3b573b244a9b', 'request_id': 'req-607df2b2-1cfd-46fd-b2b3-c7faf9b700b8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:02.533987 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-607df2b2-1cfd-46fd-b2b3-c7faf9b700b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c02cc267fc614f1fb0ff3b573b244a9b', 'request_id': 'req-607df2b2-1cfd-46fd-b2b3-c7faf9b700b8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:02.541850 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-607df2b2-1cfd-46fd-b2b3-c7faf9b700b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c02cc267fc614f1fb0ff3b573b244a9b', 'request_id': 'req-607df2b2-1cfd-46fd-b2b3-c7faf9b700b8'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:02.552796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-607df2b2-1cfd-46fd-b2b3-c7faf9b700b8 admin admin] The token cache is being invalidate because project c02cc267fc614f1fb0ff3b573b244a9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:15:02.553197 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-607df2b2-1cfd-46fd-b2b3-c7faf9b700b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:02.553862 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-607df2b2-1cfd-46fd-b2b3-c7faf9b700b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:02.555570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1364/2760] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:15:02 2022] DELETE /identity/v3/projects/c02cc267fc614f1fb0ff3b573b244a9b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:15:02.567959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553c10f-d16e-4538-8843-2ab498c305f6 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:02.568293 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553c10f-d16e-4538-8843-2ab498c305f6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:02.568624 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553c10f-d16e-4538-8843-2ab498c305f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:02.588503 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-3553c10f-d16e-4538-8843-2ab498c305f6 None None] MFA Rules not processed for user `fcd1725924134616b903b3e374d45817`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:15:02.590061 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-3553c10f-d16e-4538-8843-2ab498c305f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:02.594903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=100 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:02.657464 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1397/2761] 10.222.0.24 () {58 vars in 1009 bytes} [Thu May 19 15:15:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:15:02.669965 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607df2b2-1cfd-46fd-b2b3-c7faf9b700b8 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:02.671476 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-607df2b2-1cfd-46fd-b2b3-c7faf9b700b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:02.749411 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607df2b2-1cfd-46fd-b2b3-c7faf9b700b8 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:02.755226 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bd1a2-0a8d-4fbd-a25f-b1491357df77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecbeee0c1cf4c58be6c22aa11d7ff5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:02.756448 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bd1a2-0a8d-4fbd-a25f-b1491357df77 service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:02.756745 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bd1a2-0a8d-4fbd-a25f-b1491357df77 service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:02.757045 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bd1a2-0a8d-4fbd-a25f-b1491357df77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:02.767343 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32bd1a2-0a8d-4fbd-a25f-b1491357df77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:02.769024 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32bd1a2-0a8d-4fbd-a25f-b1491357df77 service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:02.779007 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1365/2762] 10.222.0.24 () {60 vars in 1384 bytes} [Thu May 19 15:15:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 19 15:15:03.102018 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1ff1b-5f79-4e23-ba1b-318c93d01b2e None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:03.102336 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1ff1b-5f79-4e23-ba1b-318c93d01b2e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:03.102622 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1ff1b-5f79-4e23-ba1b-318c93d01b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:03.121477 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-e4e1ff1b-5f79-4e23-ba1b-318c93d01b2e None None] MFA Rules not processed for user `fcd1725924134616b903b3e374d45817`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:15:03.123011 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e4e1ff1b-5f79-4e23-ba1b-318c93d01b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:03.130540 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1398/2763] 10.222.0.24 () {58 vars in 967 bytes} [Thu May 19 15:15:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:15:03.143514 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bd1a2-0a8d-4fbd-a25f-b1491357df77 service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:03.153939 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bd1a2-0a8d-4fbd-a25f-b1491357df77 service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:03.158899 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab973a72-1582-4c39-8798-b515d4ad7b2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecbeee0c1cf4c58be6c22aa11d7ff5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:03.159578 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab973a72-1582-4c39-8798-b515d4ad7b2e service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:03.159869 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab973a72-1582-4c39-8798-b515d4ad7b2e service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:03.160149 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab973a72-1582-4c39-8798-b515d4ad7b2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:03.168048 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab973a72-1582-4c39-8798-b515d4ad7b2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:03.169633 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab973a72-1582-4c39-8798-b515d4ad7b2e service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:03.177564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1366/2764] 10.222.0.24 () {60 vars in 1384 bytes} [Thu May 19 15:15:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 15:15:05.210992 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1ff1b-5f79-4e23-ba1b-318c93d01b2e None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:05.212459 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-e4e1ff1b-5f79-4e23-ba1b-318c93d01b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:05.276806 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1ff1b-5f79-4e23-ba1b-318c93d01b2e None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:05.281241 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcea451-f048-41ce-abc9-bdefc5e647ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:05.282102 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcea451-f048-41ce-abc9-bdefc5e647ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:05.282381 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcea451-f048-41ce-abc9-bdefc5e647ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:05.282655 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcea451-f048-41ce-abc9-bdefc5e647ee admin admin] PATH_INFO: `/v3/users/fbd500b2e8e54534b368c3bd664baa24` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:05.283852 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcea451-f048-41ce-abc9-bdefc5e647ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbd500b2e8e54534b368c3bd664baa24)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:05.285768 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcea451-f048-41ce-abc9-bdefc5e647ee admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:05.332429 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-bfcea451-f048-41ce-abc9-bdefc5e647ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbd500b2e8e54534b368c3bd664baa24'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:05.333116 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-bfcea451-f048-41ce-abc9-bdefc5e647ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbd500b2e8e54534b368c3bd664baa24'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:05.333731 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-bfcea451-f048-41ce-abc9-bdefc5e647ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbd500b2e8e54534b368c3bd664baa24'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:05.341473 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-bfcea451-f048-41ce-abc9-bdefc5e647ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbd500b2e8e54534b368c3bd664baa24'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:05.353997 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-bfcea451-f048-41ce-abc9-bdefc5e647ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbd500b2e8e54534b368c3bd664baa24'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:05.366737 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1399/2765] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:15:05 2022] DELETE /identity/v3/users/fbd500b2e8e54534b368c3bd664baa24 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:15:05.371470 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53fd47-967b-45c7-af75-dd6263a7441b None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:05.371865 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53fd47-967b-45c7-af75-dd6263a7441b None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:05.372037 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53fd47-967b-45c7-af75-dd6263a7441b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:05.389368 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0c53fd47-967b-45c7-af75-dd6263a7441b None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:15:05.390554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0c53fd47-967b-45c7-af75-dd6263a7441b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:05.447010 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1367/2766] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:15:05.456496 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcea451-f048-41ce-abc9-bdefc5e647ee admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:05.457970 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-bfcea451-f048-41ce-abc9-bdefc5e647ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:05.489356 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:05.517663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcea451-f048-41ce-abc9-bdefc5e647ee admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:05.521793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e823b-f3ab-4fd0-af61-04e4fda6c461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:05.522426 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e823b-f3ab-4fd0-af61-04e4fda6c461 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:05.522707 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e823b-f3ab-4fd0-af61-04e4fda6c461 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:05.522982 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e823b-f3ab-4fd0-af61-04e4fda6c461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:05.532013 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e823b-f3ab-4fd0-af61-04e4fda6c461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:05.533446 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e823b-f3ab-4fd0-af61-04e4fda6c461 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:05.543355 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1400/2767] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:15:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:15:05.710280 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53fd47-967b-45c7-af75-dd6263a7441b None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:05.711839 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0c53fd47-967b-45c7-af75-dd6263a7441b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:05.723875 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53fd47-967b-45c7-af75-dd6263a7441b None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:05.728542 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512f191-1c46-4ce3-827e-0788027c5150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:05.729404 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512f191-1c46-4ce3-827e-0788027c5150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:05.729693 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512f191-1c46-4ce3-827e-0788027c5150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:05.729973 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512f191-1c46-4ce3-827e-0788027c5150 admin admin] PATH_INFO: `/v3/projects/f2bcd4570a054c0eb8131280512ada61` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:05.731169 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512f191-1c46-4ce3-827e-0788027c5150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2bcd4570a054c0eb8131280512ada61)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:05.733129 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512f191-1c46-4ce3-827e-0788027c5150 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:05.777647 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:05.781085 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9512f191-1c46-4ce3-827e-0788027c5150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2bcd4570a054c0eb8131280512ada61', 'request_id': 'req-9512f191-1c46-4ce3-827e-0788027c5150'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:05.789193 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9512f191-1c46-4ce3-827e-0788027c5150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2bcd4570a054c0eb8131280512ada61', 'request_id': 'req-9512f191-1c46-4ce3-827e-0788027c5150'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:05.795433 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9512f191-1c46-4ce3-827e-0788027c5150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2bcd4570a054c0eb8131280512ada61', 'request_id': 'req-9512f191-1c46-4ce3-827e-0788027c5150'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:05.805452 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9512f191-1c46-4ce3-827e-0788027c5150 admin admin] The token cache is being invalidate because project f2bcd4570a054c0eb8131280512ada61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:15:05.805720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9512f191-1c46-4ce3-827e-0788027c5150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:05.806351 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-9512f191-1c46-4ce3-827e-0788027c5150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:05.807906 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1368/2768] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:15:05 2022] DELETE /identity/v3/projects/f2bcd4570a054c0eb8131280512ada61 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:15:15.539173 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=14 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:15.802433 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:20.095282 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e823b-f3ab-4fd0-af61-04e4fda6c461 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:20.096836 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-d92e823b-f3ab-4fd0-af61-04e4fda6c461 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:20.113468 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e823b-f3ab-4fd0-af61-04e4fda6c461 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:20.170839 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e448779-d59f-4472-ac64-28a95f4dac60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:20.171907 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e448779-d59f-4472-ac64-28a95f4dac60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:20.172196 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e448779-d59f-4472-ac64-28a95f4dac60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:20.172472 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e448779-d59f-4472-ac64-28a95f4dac60 admin admin] PATH_INFO: `/v3/users/0022fc1107834a5cbe30f0146361213b` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:20.173755 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e448779-d59f-4472-ac64-28a95f4dac60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0022fc1107834a5cbe30f0146361213b)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:20.175726 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e448779-d59f-4472-ac64-28a95f4dac60 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:20.220849 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9e448779-d59f-4472-ac64-28a95f4dac60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0022fc1107834a5cbe30f0146361213b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:20.221489 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9e448779-d59f-4472-ac64-28a95f4dac60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0022fc1107834a5cbe30f0146361213b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:20.222083 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9e448779-d59f-4472-ac64-28a95f4dac60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0022fc1107834a5cbe30f0146361213b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:20.228933 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9e448779-d59f-4472-ac64-28a95f4dac60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0022fc1107834a5cbe30f0146361213b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:20.240261 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-9e448779-d59f-4472-ac64-28a95f4dac60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0022fc1107834a5cbe30f0146361213b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:20.252697 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1401/2769] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:15:20 2022] DELETE /identity/v3/users/0022fc1107834a5cbe30f0146361213b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:15:20.439441 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512f191-1c46-4ce3-827e-0788027c5150 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:20.440932 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-9512f191-1c46-4ce3-827e-0788027c5150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:20.454397 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512f191-1c46-4ce3-827e-0788027c5150 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:20.511275 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c177e4-afce-4ab2-9e67-2387f6342a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:20.512139 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c177e4-afce-4ab2-9e67-2387f6342a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:20.512432 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c177e4-afce-4ab2-9e67-2387f6342a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:20.512710 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c177e4-afce-4ab2-9e67-2387f6342a86 admin admin] PATH_INFO: `/v3/projects/5b1521fd041a446e851d82487479930b` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:20.513889 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c177e4-afce-4ab2-9e67-2387f6342a86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b1521fd041a446e851d82487479930b)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:20.515860 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c177e4-afce-4ab2-9e67-2387f6342a86 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:20.561256 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-33c177e4-afce-4ab2-9e67-2387f6342a86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b1521fd041a446e851d82487479930b', 'request_id': 'req-33c177e4-afce-4ab2-9e67-2387f6342a86'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:20.568254 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-33c177e4-afce-4ab2-9e67-2387f6342a86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b1521fd041a446e851d82487479930b', 'request_id': 'req-33c177e4-afce-4ab2-9e67-2387f6342a86'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:20.574747 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-33c177e4-afce-4ab2-9e67-2387f6342a86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b1521fd041a446e851d82487479930b', 'request_id': 'req-33c177e4-afce-4ab2-9e67-2387f6342a86'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:20.585356 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-33c177e4-afce-4ab2-9e67-2387f6342a86 admin admin] The token cache is being invalidate because project 5b1521fd041a446e851d82487479930b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:15:20.585647 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-33c177e4-afce-4ab2-9e67-2387f6342a86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:20.586301 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-33c177e4-afce-4ab2-9e67-2387f6342a86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:20.587858 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1369/2770] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:15:20 2022] DELETE /identity/v3/projects/5b1521fd041a446e851d82487479930b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:15:20.592800 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd43e97-c6ed-4df8-a960-8767bcff0272 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:20.593097 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd43e97-c6ed-4df8-a960-8767bcff0272 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:20.593375 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd43e97-c6ed-4df8-a960-8767bcff0272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:20.611908 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-4bd43e97-c6ed-4df8-a960-8767bcff0272 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:15:20.613109 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-4bd43e97-c6ed-4df8-a960-8767bcff0272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:20.670941 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1402/2771] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:15:20.679358 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2cbbb-2441-4794-b598-a68c39faba4f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:20.679662 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2cbbb-2441-4794-b598-a68c39faba4f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:20.679943 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2cbbb-2441-4794-b598-a68c39faba4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:20.697785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-74d2cbbb-2441-4794-b598-a68c39faba4f None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:15:20.698981 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-74d2cbbb-2441-4794-b598-a68c39faba4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:20.709502 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1370/2772] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:15:20.714645 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd43e97-c6ed-4df8-a960-8767bcff0272 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:20.724160 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd43e97-c6ed-4df8-a960-8767bcff0272 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:20.729181 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c361348-ec57-4965-b1de-20991f92f4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:20.729821 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c361348-ec57-4965-b1de-20991f92f4ed admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:20.730098 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c361348-ec57-4965-b1de-20991f92f4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:20.730371 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c361348-ec57-4965-b1de-20991f92f4ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:20.731088 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c361348-ec57-4965-b1de-20991f92f4ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:15:20.731422 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c361348-ec57-4965-b1de-20991f92f4ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:20.733002 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c361348-ec57-4965-b1de-20991f92f4ed admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:20.744683 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1403/2773] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 19 15:15:20.749069 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2cbbb-2441-4794-b598-a68c39faba4f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:20.758262 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2cbbb-2441-4794-b598-a68c39faba4f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:20.763006 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71deec21-1c10-4ef4-a925-f5ac2b73efe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:20.763641 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71deec21-1c10-4ef4-a925-f5ac2b73efe9 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:20.763928 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71deec21-1c10-4ef4-a925-f5ac2b73efe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:20.764209 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71deec21-1c10-4ef4-a925-f5ac2b73efe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:20.764905 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71deec21-1c10-4ef4-a925-f5ac2b73efe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:20.766796 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71deec21-1c10-4ef4-a925-f5ac2b73efe9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:20.794061 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1371/2774] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:15:20 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:15:20.798465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c361348-ec57-4965-b1de-20991f92f4ed admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:20.809235 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c361348-ec57-4965-b1de-20991f92f4ed admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:20.813040 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:20.866390 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ff56f-9fa5-46c8-9208-197940c19454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:20.867063 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ff56f-9fa5-46c8-9208-197940c19454 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:20.867379 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ff56f-9fa5-46c8-9208-197940c19454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:20.867663 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ff56f-9fa5-46c8-9208-197940c19454 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:20.868358 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ff56f-9fa5-46c8-9208-197940c19454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:20.870566 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ff56f-9fa5-46c8-9208-197940c19454 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:20.889849 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1404/2775] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:15:20 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:15:20.893933 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71deec21-1c10-4ef4-a925-f5ac2b73efe9 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:20.904093 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71deec21-1c10-4ef4-a925-f5ac2b73efe9 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:20.908719 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c104c-452b-40fd-a8af-9eabcbebb48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:20.909376 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c104c-452b-40fd-a8af-9eabcbebb48d admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:20.909667 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c104c-452b-40fd-a8af-9eabcbebb48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:20.909949 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c104c-452b-40fd-a8af-9eabcbebb48d admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:20.910675 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c104c-452b-40fd-a8af-9eabcbebb48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:20.912869 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c104c-452b-40fd-a8af-9eabcbebb48d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:20.923055 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1372/2776] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:15:20.926667 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ff56f-9fa5-46c8-9208-197940c19454 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:20.937107 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ff56f-9fa5-46c8-9208-197940c19454 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:20.941689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d04999-7b4b-464d-ae1f-ffdf32197503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:20.942343 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d04999-7b4b-464d-ae1f-ffdf32197503 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:20.942626 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d04999-7b4b-464d-ae1f-ffdf32197503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:20.942903 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d04999-7b4b-464d-ae1f-ffdf32197503 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:20.943728 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d04999-7b4b-464d-ae1f-ffdf32197503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:20.945335 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d04999-7b4b-464d-ae1f-ffdf32197503 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:20.956789 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1405/2777] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:15:20.960756 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c104c-452b-40fd-a8af-9eabcbebb48d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:20.970505 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c104c-452b-40fd-a8af-9eabcbebb48d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:20.975629 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e68bb-c5b3-4258-91a5-ee147053dfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:20.976578 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e68bb-c5b3-4258-91a5-ee147053dfb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:20.976853 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e68bb-c5b3-4258-91a5-ee147053dfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:20.977137 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e68bb-c5b3-4258-91a5-ee147053dfb8 admin admin] PATH_INFO: `/v3/projects/46cb1d3120ed4c06ae2cb4734e720716/users/43defe55293e4690bbd4d2492b929ba7/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:20.992315 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e68bb-c5b3-4258-91a5-ee147053dfb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46cb1d3120ed4c06ae2cb4734e720716, user_id=43defe55293e4690bbd4d2492b929ba7, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:20.994942 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e68bb-c5b3-4258-91a5-ee147053dfb8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:21.007468 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1373/2778] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:15:20 2022] PUT /identity/v3/projects/46cb1d3120ed4c06ae2cb4734e720716/users/43defe55293e4690bbd4d2492b929ba7/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:15:21.017465 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1c3f6-0a7c-4666-aea4-84989276d2d6 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:21.017725 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1c3f6-0a7c-4666-aea4-84989276d2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:21.018002 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1c3f6-0a7c-4666-aea4-84989276d2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:21.044340 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-c3f1c3f6-0a7c-4666-aea4-84989276d2d6 None None] MFA Rules not processed for user `43defe55293e4690bbd4d2492b929ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:15:21.045531 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c3f1c3f6-0a7c-4666-aea4-84989276d2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:21.107485 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1406/2779] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:15:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:15:21.111952 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e68bb-c5b3-4258-91a5-ee147053dfb8 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:21.142353 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:21.176457 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e68bb-c5b3-4258-91a5-ee147053dfb8 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:21.181065 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26616362-f975-4cf3-bb31-f1d7b26eadd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:21.181739 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26616362-f975-4cf3-bb31-f1d7b26eadd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:21.182009 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26616362-f975-4cf3-bb31-f1d7b26eadd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:21.182287 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26616362-f975-4cf3-bb31-f1d7b26eadd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:21.182981 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26616362-f975-4cf3-bb31-f1d7b26eadd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:21.184939 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26616362-f975-4cf3-bb31-f1d7b26eadd5 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:21.208898 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1374/2780] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:15:21 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:15:21.213573 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1c3f6-0a7c-4666-aea4-84989276d2d6 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:21.224148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1c3f6-0a7c-4666-aea4-84989276d2d6 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:21.280147 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac785f9-7191-4a78-b4ad-5de220afecf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:21.280770 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac785f9-7191-4a78-b4ad-5de220afecf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:21.281052 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac785f9-7191-4a78-b4ad-5de220afecf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:21.281325 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac785f9-7191-4a78-b4ad-5de220afecf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:21.282014 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac785f9-7191-4a78-b4ad-5de220afecf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:21.283978 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac785f9-7191-4a78-b4ad-5de220afecf7 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:21.303816 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1407/2781] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:15:21 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:15:21.308029 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26616362-f975-4cf3-bb31-f1d7b26eadd5 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:21.318522 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26616362-f975-4cf3-bb31-f1d7b26eadd5 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:21.323091 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9205b-50f2-4389-a7d4-d04206c6fea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:21.323789 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9205b-50f2-4389-a7d4-d04206c6fea8 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:21.324074 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9205b-50f2-4389-a7d4-d04206c6fea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:21.324489 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9205b-50f2-4389-a7d4-d04206c6fea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:21.325073 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9205b-50f2-4389-a7d4-d04206c6fea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:21.326674 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9205b-50f2-4389-a7d4-d04206c6fea8 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:21.338064 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1375/2782] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:15:21.342420 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac785f9-7191-4a78-b4ad-5de220afecf7 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:21.348628 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:21.353426 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac785f9-7191-4a78-b4ad-5de220afecf7 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:21.358942 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30079296-cec1-4a47-a5b2-2ca9cc3c04d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:21.359851 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30079296-cec1-4a47-a5b2-2ca9cc3c04d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:21.360134 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30079296-cec1-4a47-a5b2-2ca9cc3c04d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:21.360413 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30079296-cec1-4a47-a5b2-2ca9cc3c04d5 admin admin] PATH_INFO: `/v3/projects/f083dfd51f4c4aa7915232b25af36be7/users/d95bdcb12afb425f894679073a2f9870/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:21.375564 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30079296-cec1-4a47-a5b2-2ca9cc3c04d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f083dfd51f4c4aa7915232b25af36be7, user_id=d95bdcb12afb425f894679073a2f9870, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:21.378604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30079296-cec1-4a47-a5b2-2ca9cc3c04d5 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:21.392973 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1408/2783] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:15:21 2022] PUT /identity/v3/projects/f083dfd51f4c4aa7915232b25af36be7/users/d95bdcb12afb425f894679073a2f9870/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:15:21.397541 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9205b-50f2-4389-a7d4-d04206c6fea8 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:21.407920 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9205b-50f2-4389-a7d4-d04206c6fea8 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:21.465468 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3208cee-2ff1-4f6c-b476-d717c18ceb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:21.466146 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3208cee-2ff1-4f6c-b476-d717c18ceb27 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:21.466431 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3208cee-2ff1-4f6c-b476-d717c18ceb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:21.466706 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3208cee-2ff1-4f6c-b476-d717c18ceb27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:21.467494 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3208cee-2ff1-4f6c-b476-d717c18ceb27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:21.469112 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3208cee-2ff1-4f6c-b476-d717c18ceb27 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:21.479163 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1376/2784] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:15:21.483397 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30079296-cec1-4a47-a5b2-2ca9cc3c04d5 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:21.494027 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30079296-cec1-4a47-a5b2-2ca9cc3c04d5 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:21.498819 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b433b4b-f958-455f-b422-ef855043cb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:21.499721 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b433b4b-f958-455f-b422-ef855043cb06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:21.500002 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b433b4b-f958-455f-b422-ef855043cb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:21.500273 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b433b4b-f958-455f-b422-ef855043cb06 admin admin] PATH_INFO: `/v3/projects/f083dfd51f4c4aa7915232b25af36be7/users/d95bdcb12afb425f894679073a2f9870/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:21.502226 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b433b4b-f958-455f-b422-ef855043cb06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f083dfd51f4c4aa7915232b25af36be7, user_id=d95bdcb12afb425f894679073a2f9870, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:21.504879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b433b4b-f958-455f-b422-ef855043cb06 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:21.516026 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1409/2785] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:15:21 2022] PUT /identity/v3/projects/f083dfd51f4c4aa7915232b25af36be7/users/d95bdcb12afb425f894679073a2f9870/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:15:21.527765 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a146d2-3ece-4c0f-bad2-82aa6009b297 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:21.528068 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a146d2-3ece-4c0f-bad2-82aa6009b297 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:21.528352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a146d2-3ece-4c0f-bad2-82aa6009b297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:21.553846 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-a1a146d2-3ece-4c0f-bad2-82aa6009b297 None None] MFA Rules not processed for user `d95bdcb12afb425f894679073a2f9870`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:15:21.555002 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-a1a146d2-3ece-4c0f-bad2-82aa6009b297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:21.621090 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1377/2786] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:15:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:15:21.632551 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b433b4b-f958-455f-b422-ef855043cb06 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:21.634297 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1b433b4b-f958-455f-b422-ef855043cb06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:21.692590 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b433b4b-f958-455f-b422-ef855043cb06 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:21.696751 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5161f-6671-49cc-b309-5388626fcd44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:21.697389 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5161f-6671-49cc-b309-5388626fcd44 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:21.697672 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5161f-6671-49cc-b309-5388626fcd44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:21.697955 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5161f-6671-49cc-b309-5388626fcd44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:21.706850 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5161f-6671-49cc-b309-5388626fcd44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:21.708331 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5161f-6671-49cc-b309-5388626fcd44 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:21.718223 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1410/2787] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:15:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:15:21.745795 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a146d2-3ece-4c0f-bad2-82aa6009b297 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:21.770472 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:21.808216 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a146d2-3ece-4c0f-bad2-82aa6009b297 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:21.812875 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582eed28-cae3-4e74-b02b-6138197f9e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:21.813747 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582eed28-cae3-4e74-b02b-6138197f9e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:21.814034 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582eed28-cae3-4e74-b02b-6138197f9e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:21.814311 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582eed28-cae3-4e74-b02b-6138197f9e3e admin admin] PATH_INFO: `/v3/users/43defe55293e4690bbd4d2492b929ba7` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:21.815573 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582eed28-cae3-4e74-b02b-6138197f9e3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=43defe55293e4690bbd4d2492b929ba7)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:21.817584 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582eed28-cae3-4e74-b02b-6138197f9e3e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:21.862316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-582eed28-cae3-4e74-b02b-6138197f9e3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43defe55293e4690bbd4d2492b929ba7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:21.869191 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-582eed28-cae3-4e74-b02b-6138197f9e3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43defe55293e4690bbd4d2492b929ba7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:21.881655 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-582eed28-cae3-4e74-b02b-6138197f9e3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43defe55293e4690bbd4d2492b929ba7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:21.882352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-582eed28-cae3-4e74-b02b-6138197f9e3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43defe55293e4690bbd4d2492b929ba7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:21.882987 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-582eed28-cae3-4e74-b02b-6138197f9e3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43defe55293e4690bbd4d2492b929ba7'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:21.898051 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1378/2788] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:15:21 2022] DELETE /identity/v3/users/43defe55293e4690bbd4d2492b929ba7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:15:21.902526 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5c253-6ec6-45f2-95fe-4e834ac11c8b None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:21.902825 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5c253-6ec6-45f2-95fe-4e834ac11c8b None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:21.903105 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5c253-6ec6-45f2-95fe-4e834ac11c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:21.920606 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-91a5c253-6ec6-45f2-95fe-4e834ac11c8b None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:15:21.921805 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-91a5c253-6ec6-45f2-95fe-4e834ac11c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:21.979160 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1411/2789] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:15:21.989177 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582eed28-cae3-4e74-b02b-6138197f9e3e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:21.990570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-582eed28-cae3-4e74-b02b-6138197f9e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:22.046374 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582eed28-cae3-4e74-b02b-6138197f9e3e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:22.049941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9789e-8cbf-4c8e-bf48-03c0fe613d23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:22.050578 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9789e-8cbf-4c8e-bf48-03c0fe613d23 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:22.050859 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9789e-8cbf-4c8e-bf48-03c0fe613d23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:22.051141 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9789e-8cbf-4c8e-bf48-03c0fe613d23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:22.059980 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9789e-8cbf-4c8e-bf48-03c0fe613d23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:22.061344 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9789e-8cbf-4c8e-bf48-03c0fe613d23 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:22.071344 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1379/2790] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:15:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 15:15:22.342019 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5c253-6ec6-45f2-95fe-4e834ac11c8b None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:22.343556 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-91a5c253-6ec6-45f2-95fe-4e834ac11c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:22.355926 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5c253-6ec6-45f2-95fe-4e834ac11c8b None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:22.360720 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906db505-0616-4208-bb9a-371bce7f7206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:22.361594 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906db505-0616-4208-bb9a-371bce7f7206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:22.361876 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906db505-0616-4208-bb9a-371bce7f7206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:22.362151 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906db505-0616-4208-bb9a-371bce7f7206 admin admin] PATH_INFO: `/v3/projects/46cb1d3120ed4c06ae2cb4734e720716` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:22.364050 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906db505-0616-4208-bb9a-371bce7f7206 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46cb1d3120ed4c06ae2cb4734e720716)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:22.366433 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906db505-0616-4208-bb9a-371bce7f7206 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:22.412766 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-906db505-0616-4208-bb9a-371bce7f7206 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46cb1d3120ed4c06ae2cb4734e720716', 'request_id': 'req-906db505-0616-4208-bb9a-371bce7f7206'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:22.418124 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-906db505-0616-4208-bb9a-371bce7f7206 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46cb1d3120ed4c06ae2cb4734e720716', 'request_id': 'req-906db505-0616-4208-bb9a-371bce7f7206'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:22.424125 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-906db505-0616-4208-bb9a-371bce7f7206 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46cb1d3120ed4c06ae2cb4734e720716', 'request_id': 'req-906db505-0616-4208-bb9a-371bce7f7206'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:22.426574 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:22.438633 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-906db505-0616-4208-bb9a-371bce7f7206 admin admin] The token cache is being invalidate because project 46cb1d3120ed4c06ae2cb4734e720716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:15:22.438920 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-906db505-0616-4208-bb9a-371bce7f7206 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:22.439548 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-906db505-0616-4208-bb9a-371bce7f7206 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:22.441206 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1412/2791] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:15:22 2022] DELETE /identity/v3/projects/46cb1d3120ed4c06ae2cb4734e720716 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:15:22.445808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9789e-8cbf-4c8e-bf48-03c0fe613d23 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:22.455767 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9789e-8cbf-4c8e-bf48-03c0fe613d23 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:22.497470 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:22.514163 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355a825-7dec-4693-b9cc-a2f6f7f644b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:22.515034 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355a825-7dec-4693-b9cc-a2f6f7f644b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:22.515351 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355a825-7dec-4693-b9cc-a2f6f7f644b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:22.515630 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355a825-7dec-4693-b9cc-a2f6f7f644b7 admin admin] PATH_INFO: `/v3/users/d95bdcb12afb425f894679073a2f9870` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:22.516810 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355a825-7dec-4693-b9cc-a2f6f7f644b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d95bdcb12afb425f894679073a2f9870)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:22.518728 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355a825-7dec-4693-b9cc-a2f6f7f644b7 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:22.564024 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4355a825-7dec-4693-b9cc-a2f6f7f644b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd95bdcb12afb425f894679073a2f9870'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:22.570763 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4355a825-7dec-4693-b9cc-a2f6f7f644b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd95bdcb12afb425f894679073a2f9870'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:22.582282 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4355a825-7dec-4693-b9cc-a2f6f7f644b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd95bdcb12afb425f894679073a2f9870'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:22.582957 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4355a825-7dec-4693-b9cc-a2f6f7f644b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd95bdcb12afb425f894679073a2f9870'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:22.583588 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-4355a825-7dec-4693-b9cc-a2f6f7f644b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd95bdcb12afb425f894679073a2f9870'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:22.597568 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1380/2792] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:15:22 2022] DELETE /identity/v3/users/d95bdcb12afb425f894679073a2f9870 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:15:22.871045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906db505-0616-4208-bb9a-371bce7f7206 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:22.872501 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-906db505-0616-4208-bb9a-371bce7f7206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:22.885933 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906db505-0616-4208-bb9a-371bce7f7206 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:22.944361 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9455523-6435-4b91-b0d8-6167ed691632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:22.945229 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9455523-6435-4b91-b0d8-6167ed691632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:22.945516 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9455523-6435-4b91-b0d8-6167ed691632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:22.945793 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9455523-6435-4b91-b0d8-6167ed691632 admin admin] PATH_INFO: `/v3/projects/f083dfd51f4c4aa7915232b25af36be7` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:22.947008 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9455523-6435-4b91-b0d8-6167ed691632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f083dfd51f4c4aa7915232b25af36be7)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:22.949005 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9455523-6435-4b91-b0d8-6167ed691632 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:23.002601 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f9455523-6435-4b91-b0d8-6167ed691632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f083dfd51f4c4aa7915232b25af36be7', 'request_id': 'req-f9455523-6435-4b91-b0d8-6167ed691632'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:23.009529 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f9455523-6435-4b91-b0d8-6167ed691632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f083dfd51f4c4aa7915232b25af36be7', 'request_id': 'req-f9455523-6435-4b91-b0d8-6167ed691632'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:23.014622 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f9455523-6435-4b91-b0d8-6167ed691632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f083dfd51f4c4aa7915232b25af36be7', 'request_id': 'req-f9455523-6435-4b91-b0d8-6167ed691632'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:23.027838 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f9455523-6435-4b91-b0d8-6167ed691632 admin admin] The token cache is being invalidate because project f083dfd51f4c4aa7915232b25af36be7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:15:23.028113 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f9455523-6435-4b91-b0d8-6167ed691632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:23.028733 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-f9455523-6435-4b91-b0d8-6167ed691632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:23.030274 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1413/2793] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:15:22 2022] DELETE /identity/v3/projects/f083dfd51f4c4aa7915232b25af36be7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:15:23.035154 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e478a3a-5bf5-4ac2-8896-eba5a5440d98 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:23.035494 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e478a3a-5bf5-4ac2-8896-eba5a5440d98 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:23.035781 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e478a3a-5bf5-4ac2-8896-eba5a5440d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:23.053978 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-5e478a3a-5bf5-4ac2-8896-eba5a5440d98 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:15:23.055177 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-5e478a3a-5bf5-4ac2-8896-eba5a5440d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:23.112478 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1381/2794] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:15:23.120162 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca93339-75d0-415e-9dc9-aa87e4b35ecd None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:23.120655 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca93339-75d0-415e-9dc9-aa87e4b35ecd None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:23.120991 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca93339-75d0-415e-9dc9-aa87e4b35ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:23.138963 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-dca93339-75d0-415e-9dc9-aa87e4b35ecd None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:15:23.140223 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-dca93339-75d0-415e-9dc9-aa87e4b35ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:23.148931 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1414/2795] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:15:23.153094 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e478a3a-5bf5-4ac2-8896-eba5a5440d98 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:23.163128 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e478a3a-5bf5-4ac2-8896-eba5a5440d98 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:23.167669 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87924e74-5119-452e-a9c5-63fd5a04f91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:23.168312 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87924e74-5119-452e-a9c5-63fd5a04f91e admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:23.168600 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87924e74-5119-452e-a9c5-63fd5a04f91e admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:23.168876 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87924e74-5119-452e-a9c5-63fd5a04f91e admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:23.169598 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87924e74-5119-452e-a9c5-63fd5a04f91e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:15:23.169907 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87924e74-5119-452e-a9c5-63fd5a04f91e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:23.171554 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87924e74-5119-452e-a9c5-63fd5a04f91e admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:23.182844 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1382/2796] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:15:23.186914 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca93339-75d0-415e-9dc9-aa87e4b35ecd None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:23.196033 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca93339-75d0-415e-9dc9-aa87e4b35ecd None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:23.200645 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6283b2e-9ba6-458e-a718-63ef67b91ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:23.201286 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6283b2e-9ba6-458e-a718-63ef67b91ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:23.201575 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6283b2e-9ba6-458e-a718-63ef67b91ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:23.201854 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6283b2e-9ba6-458e-a718-63ef67b91ed2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:23.202584 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6283b2e-9ba6-458e-a718-63ef67b91ed2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:23.204517 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6283b2e-9ba6-458e-a718-63ef67b91ed2 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:23.230578 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1415/2797] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:15:23 2022] POST /identity/v3/projects => generated 401 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:15:23.234564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87924e74-5119-452e-a9c5-63fd5a04f91e admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:23.244510 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87924e74-5119-452e-a9c5-63fd5a04f91e admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:23.292539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:23.304093 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed6a27-b891-4355-b643-00536949ab66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:23.304823 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed6a27-b891-4355-b643-00536949ab66 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:23.305292 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed6a27-b891-4355-b643-00536949ab66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:23.305572 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed6a27-b891-4355-b643-00536949ab66 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:23.306260 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed6a27-b891-4355-b643-00536949ab66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:23.308300 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed6a27-b891-4355-b643-00536949ab66 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:23.331076 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1383/2798] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:15:23 2022] POST /identity/v3/users => generated 301 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:15:23.332263 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6283b2e-9ba6-458e-a718-63ef67b91ed2 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:23.343613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6283b2e-9ba6-458e-a718-63ef67b91ed2 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:23.351110 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991973e-59d5-4d38-ab0d-0146034ce1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:23.352197 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991973e-59d5-4d38-ab0d-0146034ce1eb admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:23.352648 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991973e-59d5-4d38-ab0d-0146034ce1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:23.353082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991973e-59d5-4d38-ab0d-0146034ce1eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:23.353832 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991973e-59d5-4d38-ab0d-0146034ce1eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:23.356234 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991973e-59d5-4d38-ab0d-0146034ce1eb admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:23.368035 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1416/2799] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:15:23.372304 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed6a27-b891-4355-b643-00536949ab66 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:23.383167 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed6a27-b891-4355-b643-00536949ab66 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:23.387911 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb57da-dd7d-4305-b626-cdc0a4ce71c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:23.388569 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb57da-dd7d-4305-b626-cdc0a4ce71c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:23.388857 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb57da-dd7d-4305-b626-cdc0a4ce71c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:23.389135 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb57da-dd7d-4305-b626-cdc0a4ce71c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:23.389858 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb57da-dd7d-4305-b626-cdc0a4ce71c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:23.391481 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb57da-dd7d-4305-b626-cdc0a4ce71c1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:23.402379 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1384/2800] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 15:15:23.406451 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991973e-59d5-4d38-ab0d-0146034ce1eb admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:23.416508 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991973e-59d5-4d38-ab0d-0146034ce1eb admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:23.421119 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4ea8b-6465-4638-8741-c7770ae40b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:23.421988 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4ea8b-6465-4638-8741-c7770ae40b36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:23.422281 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4ea8b-6465-4638-8741-c7770ae40b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:23.422565 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4ea8b-6465-4638-8741-c7770ae40b36 admin admin] PATH_INFO: `/v3/projects/fb376c4f135a43e7a3fa01b0761c8d95/users/3fb17045c6e142a39ac46d0e61bcb733/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:23.437057 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd4ea8b-6465-4638-8741-c7770ae40b36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb376c4f135a43e7a3fa01b0761c8d95, user_id=3fb17045c6e142a39ac46d0e61bcb733, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:23.439776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd4ea8b-6465-4638-8741-c7770ae40b36 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:23.452850 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1417/2801] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:15:23 2022] PUT /identity/v3/projects/fb376c4f135a43e7a3fa01b0761c8d95/users/3fb17045c6e142a39ac46d0e61bcb733/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:15:23.464772 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c444f07-2a70-4f24-9f05-4416f4052030 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:23.465068 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c444f07-2a70-4f24-9f05-4416f4052030 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:23.465345 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c444f07-2a70-4f24-9f05-4416f4052030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:23.490822 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-0c444f07-2a70-4f24-9f05-4416f4052030 None None] MFA Rules not processed for user `3fb17045c6e142a39ac46d0e61bcb733`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:15:23.492098 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-0c444f07-2a70-4f24-9f05-4416f4052030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:23.556409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1385/2802] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:15:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:15:23.560786 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4ea8b-6465-4638-8741-c7770ae40b36 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:23.581604 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:23.624617 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4ea8b-6465-4638-8741-c7770ae40b36 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:23.629156 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4e297-5b55-45f8-b266-43800249a4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:23.629812 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4e297-5b55-45f8-b266-43800249a4d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:23.630101 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4e297-5b55-45f8-b266-43800249a4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:23.630385 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4e297-5b55-45f8-b266-43800249a4d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:23.631839 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd4e297-5b55-45f8-b266-43800249a4d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:23.633860 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd4e297-5b55-45f8-b266-43800249a4d4 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:23.658084 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1418/2803] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:15:23 2022] POST /identity/v3/projects => generated 401 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:15:23.662100 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c444f07-2a70-4f24-9f05-4416f4052030 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:23.672742 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c444f07-2a70-4f24-9f05-4416f4052030 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:23.727841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35011a54-306d-434d-833f-83dc3e2d5865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:23.728503 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35011a54-306d-434d-833f-83dc3e2d5865 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:23.728789 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35011a54-306d-434d-833f-83dc3e2d5865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:23.729073 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35011a54-306d-434d-833f-83dc3e2d5865 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:23.729761 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35011a54-306d-434d-833f-83dc3e2d5865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:23.731699 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35011a54-306d-434d-833f-83dc3e2d5865 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:23.751434 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1386/2804] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:15:23 2022] POST /identity/v3/users => generated 307 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:15:23.755499 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4e297-5b55-45f8-b266-43800249a4d4 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:23.766210 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4e297-5b55-45f8-b266-43800249a4d4 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:23.770982 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec879958-8ffe-4510-8b75-7ca09b3e4e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:23.771673 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec879958-8ffe-4510-8b75-7ca09b3e4e85 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:23.771959 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec879958-8ffe-4510-8b75-7ca09b3e4e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:23.772239 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec879958-8ffe-4510-8b75-7ca09b3e4e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:23.772964 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec879958-8ffe-4510-8b75-7ca09b3e4e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:23.774554 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec879958-8ffe-4510-8b75-7ca09b3e4e85 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:23.784879 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1419/2805] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:15:23.788785 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35011a54-306d-434d-833f-83dc3e2d5865 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:23.798874 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35011a54-306d-434d-833f-83dc3e2d5865 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:23.804095 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34328d6-0740-4567-96d0-05b058890174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:23.804975 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34328d6-0740-4567-96d0-05b058890174 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:23.805252 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34328d6-0740-4567-96d0-05b058890174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:23.805527 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34328d6-0740-4567-96d0-05b058890174 admin admin] PATH_INFO: `/v3/projects/5108895c03f24d80bdf7048f4810ec3f/users/963b805a59154c83b3a94172cbc2646a/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:23.820417 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34328d6-0740-4567-96d0-05b058890174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5108895c03f24d80bdf7048f4810ec3f, user_id=963b805a59154c83b3a94172cbc2646a, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:23.823059 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34328d6-0740-4567-96d0-05b058890174 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:23.835389 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1387/2806] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:15:23 2022] PUT /identity/v3/projects/5108895c03f24d80bdf7048f4810ec3f/users/963b805a59154c83b3a94172cbc2646a/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:15:23.839224 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec879958-8ffe-4510-8b75-7ca09b3e4e85 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:23.848925 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec879958-8ffe-4510-8b75-7ca09b3e4e85 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:23.905588 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d752f-8df5-4064-928d-531fb9a749ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:23.906260 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d752f-8df5-4064-928d-531fb9a749ca admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:23.906567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d752f-8df5-4064-928d-531fb9a749ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:23.906830 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d752f-8df5-4064-928d-531fb9a749ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:23.907593 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d752f-8df5-4064-928d-531fb9a749ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:23.909193 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d752f-8df5-4064-928d-531fb9a749ca admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:23.918739 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1420/2807] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:15:23.922933 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34328d6-0740-4567-96d0-05b058890174 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:23.933576 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34328d6-0740-4567-96d0-05b058890174 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:23.938182 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffb8ce-6d7d-41f7-9a85-fbf1e66cfe28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:23.939057 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffb8ce-6d7d-41f7-9a85-fbf1e66cfe28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:23.939389 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffb8ce-6d7d-41f7-9a85-fbf1e66cfe28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:23.939673 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffb8ce-6d7d-41f7-9a85-fbf1e66cfe28 admin admin] PATH_INFO: `/v3/projects/5108895c03f24d80bdf7048f4810ec3f/users/963b805a59154c83b3a94172cbc2646a/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:23.941657 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ffb8ce-6d7d-41f7-9a85-fbf1e66cfe28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5108895c03f24d80bdf7048f4810ec3f, user_id=963b805a59154c83b3a94172cbc2646a, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:23.944910 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ffb8ce-6d7d-41f7-9a85-fbf1e66cfe28 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:23.954891 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1388/2808] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:15:23 2022] PUT /identity/v3/projects/5108895c03f24d80bdf7048f4810ec3f/users/963b805a59154c83b3a94172cbc2646a/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:15:23.964554 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16cc4d-79ad-4d35-a9a3-d2370273ed5f None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:23.964849 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16cc4d-79ad-4d35-a9a3-d2370273ed5f None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:23.965134 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16cc4d-79ad-4d35-a9a3-d2370273ed5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:23.991191 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7c16cc4d-79ad-4d35-a9a3-d2370273ed5f None None] MFA Rules not processed for user `963b805a59154c83b3a94172cbc2646a`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:15:23.992239 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7c16cc4d-79ad-4d35-a9a3-d2370273ed5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:24.059689 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1421/2809] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:15:23 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:15:24.070234 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffb8ce-6d7d-41f7-9a85-fbf1e66cfe28 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:24.071967 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-27ffb8ce-6d7d-41f7-9a85-fbf1e66cfe28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:24.085255 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:24.130477 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffb8ce-6d7d-41f7-9a85-fbf1e66cfe28 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:24.134631 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a9dd4-8b2f-4fce-8769-c263bad2c0b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:24.135310 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a9dd4-8b2f-4fce-8769-c263bad2c0b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:24.135601 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a9dd4-8b2f-4fce-8769-c263bad2c0b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:24.135880 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a9dd4-8b2f-4fce-8769-c263bad2c0b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:24.144919 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a9dd4-8b2f-4fce-8769-c263bad2c0b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:24.146348 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a9dd4-8b2f-4fce-8769-c263bad2c0b1 service cinder] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:24.155808 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1389/2810] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:15:24 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:15:24.231056 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16cc4d-79ad-4d35-a9a3-d2370273ed5f None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:24.241164 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16cc4d-79ad-4d35-a9a3-d2370273ed5f None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:24.244762 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74000e6-e0dc-4437-b2d0-1897eefa4875 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:24.245687 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74000e6-e0dc-4437-b2d0-1897eefa4875 service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:24.245967 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74000e6-e0dc-4437-b2d0-1897eefa4875 service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:24.246241 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74000e6-e0dc-4437-b2d0-1897eefa4875 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:24.257877 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:24.301848 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74000e6-e0dc-4437-b2d0-1897eefa4875 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:24.304022 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74000e6-e0dc-4437-b2d0-1897eefa4875 service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:24.312743 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1422/2811] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:15:24 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:15:28.320526 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a9dd4-8b2f-4fce-8769-c263bad2c0b1 service cinder] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:28.392061 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a9dd4-8b2f-4fce-8769-c263bad2c0b1 service cinder] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:28.396680 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cb9fd-1101-43b6-aeb3-87179fc04f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:28.397550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cb9fd-1101-43b6-aeb3-87179fc04f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:28.397833 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cb9fd-1101-43b6-aeb3-87179fc04f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:28.398103 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cb9fd-1101-43b6-aeb3-87179fc04f1b admin admin] PATH_INFO: `/v3/users/3fb17045c6e142a39ac46d0e61bcb733` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:28.399321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2cb9fd-1101-43b6-aeb3-87179fc04f1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fb17045c6e142a39ac46d0e61bcb733)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:28.401252 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2cb9fd-1101-43b6-aeb3-87179fc04f1b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:28.448577 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8b2cb9fd-1101-43b6-aeb3-87179fc04f1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fb17045c6e142a39ac46d0e61bcb733'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:28.455663 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8b2cb9fd-1101-43b6-aeb3-87179fc04f1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fb17045c6e142a39ac46d0e61bcb733'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:28.467618 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8b2cb9fd-1101-43b6-aeb3-87179fc04f1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fb17045c6e142a39ac46d0e61bcb733'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:28.468369 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8b2cb9fd-1101-43b6-aeb3-87179fc04f1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fb17045c6e142a39ac46d0e61bcb733'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:28.468982 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8b2cb9fd-1101-43b6-aeb3-87179fc04f1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fb17045c6e142a39ac46d0e61bcb733'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:28.481276 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1390/2812] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:15:28 2022] DELETE /identity/v3/users/3fb17045c6e142a39ac46d0e61bcb733 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:15:28.486078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c709d-7874-43a9-ba0d-1743eb3b0b98 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:28.486572 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c709d-7874-43a9-ba0d-1743eb3b0b98 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:28.487328 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c709d-7874-43a9-ba0d-1743eb3b0b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:28.505863 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-386c709d-7874-43a9-ba0d-1743eb3b0b98 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:15:28.507710 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-386c709d-7874-43a9-ba0d-1743eb3b0b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:28.565128 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1423/2813] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:15:28.575401 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cb9fd-1101-43b6-aeb3-87179fc04f1b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:28.576864 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8b2cb9fd-1101-43b6-aeb3-87179fc04f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:28.614927 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:28.640227 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cb9fd-1101-43b6-aeb3-87179fc04f1b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:28.644074 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493374bf-c885-4727-aeb2-c0ac3fd5cbc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:28.644810 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493374bf-c885-4727-aeb2-c0ac3fd5cbc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:28.645201 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493374bf-c885-4727-aeb2-c0ac3fd5cbc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:28.645557 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493374bf-c885-4727-aeb2-c0ac3fd5cbc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:28.657443 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493374bf-c885-4727-aeb2-c0ac3fd5cbc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:28.658937 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493374bf-c885-4727-aeb2-c0ac3fd5cbc8 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:28.671565 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1391/2814] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:15:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 15:15:28.940929 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c709d-7874-43a9-ba0d-1743eb3b0b98 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:28.942428 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-386c709d-7874-43a9-ba0d-1743eb3b0b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:28.960759 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c709d-7874-43a9-ba0d-1743eb3b0b98 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:28.967077 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aeb7e0-d5a2-4e1b-b6af-7eb4eefd55d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:28.969449 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aeb7e0-d5a2-4e1b-b6af-7eb4eefd55d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:28.969886 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aeb7e0-d5a2-4e1b-b6af-7eb4eefd55d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:28.970306 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aeb7e0-d5a2-4e1b-b6af-7eb4eefd55d0 admin admin] PATH_INFO: `/v3/projects/fb376c4f135a43e7a3fa01b0761c8d95` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:28.972100 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aeb7e0-d5a2-4e1b-b6af-7eb4eefd55d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb376c4f135a43e7a3fa01b0761c8d95)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:28.975832 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aeb7e0-d5a2-4e1b-b6af-7eb4eefd55d0 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:29.027567 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-23aeb7e0-d5a2-4e1b-b6af-7eb4eefd55d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb376c4f135a43e7a3fa01b0761c8d95', 'request_id': 'req-23aeb7e0-d5a2-4e1b-b6af-7eb4eefd55d0'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:29.033025 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-23aeb7e0-d5a2-4e1b-b6af-7eb4eefd55d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb376c4f135a43e7a3fa01b0761c8d95', 'request_id': 'req-23aeb7e0-d5a2-4e1b-b6af-7eb4eefd55d0'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:29.039770 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-23aeb7e0-d5a2-4e1b-b6af-7eb4eefd55d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb376c4f135a43e7a3fa01b0761c8d95', 'request_id': 'req-23aeb7e0-d5a2-4e1b-b6af-7eb4eefd55d0'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:29.051298 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-23aeb7e0-d5a2-4e1b-b6af-7eb4eefd55d0 admin admin] The token cache is being invalidate because project fb376c4f135a43e7a3fa01b0761c8d95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:15:29.051582 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-23aeb7e0-d5a2-4e1b-b6af-7eb4eefd55d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:29.052182 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-23aeb7e0-d5a2-4e1b-b6af-7eb4eefd55d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:29.053712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1424/2815] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:15:28 2022] DELETE /identity/v3/projects/fb376c4f135a43e7a3fa01b0761c8d95 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:15:29.057654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493374bf-c885-4727-aeb2-c0ac3fd5cbc8 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:29.066940 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493374bf-c885-4727-aeb2-c0ac3fd5cbc8 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:29.122759 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f7608-d9c2-49f2-ad3d-60b0805b2d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:29.123661 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f7608-d9c2-49f2-ad3d-60b0805b2d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:29.123950 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f7608-d9c2-49f2-ad3d-60b0805b2d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:29.124227 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f7608-d9c2-49f2-ad3d-60b0805b2d65 admin admin] PATH_INFO: `/v3/users/963b805a59154c83b3a94172cbc2646a` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:29.125412 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f7608-d9c2-49f2-ad3d-60b0805b2d65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=963b805a59154c83b3a94172cbc2646a)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:29.127402 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f7608-d9c2-49f2-ad3d-60b0805b2d65 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:29.172829 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8a0f7608-d9c2-49f2-ad3d-60b0805b2d65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '963b805a59154c83b3a94172cbc2646a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:29.179619 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8a0f7608-d9c2-49f2-ad3d-60b0805b2d65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '963b805a59154c83b3a94172cbc2646a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:29.191151 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8a0f7608-d9c2-49f2-ad3d-60b0805b2d65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '963b805a59154c83b3a94172cbc2646a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:29.191843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8a0f7608-d9c2-49f2-ad3d-60b0805b2d65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '963b805a59154c83b3a94172cbc2646a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:29.192466 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8a0f7608-d9c2-49f2-ad3d-60b0805b2d65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '963b805a59154c83b3a94172cbc2646a'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:29.204560 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1392/2816] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:15:29 2022] DELETE /identity/v3/users/963b805a59154c83b3a94172cbc2646a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:15:29.468265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aeb7e0-d5a2-4e1b-b6af-7eb4eefd55d0 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:29.469686 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-23aeb7e0-d5a2-4e1b-b6af-7eb4eefd55d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:29.482513 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aeb7e0-d5a2-4e1b-b6af-7eb4eefd55d0 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:29.518911 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:29.543767 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f8d7c-ab92-4494-b877-b0b14ca36dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:29.544633 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f8d7c-ab92-4494-b877-b0b14ca36dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:29.544920 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f8d7c-ab92-4494-b877-b0b14ca36dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:29.545200 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f8d7c-ab92-4494-b877-b0b14ca36dd2 admin admin] PATH_INFO: `/v3/projects/5108895c03f24d80bdf7048f4810ec3f` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:29.546369 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f8d7c-ab92-4494-b877-b0b14ca36dd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5108895c03f24d80bdf7048f4810ec3f)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:29.548318 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f8d7c-ab92-4494-b877-b0b14ca36dd2 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:29.593082 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-7e3f8d7c-ab92-4494-b877-b0b14ca36dd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5108895c03f24d80bdf7048f4810ec3f', 'request_id': 'req-7e3f8d7c-ab92-4494-b877-b0b14ca36dd2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:29.598498 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-7e3f8d7c-ab92-4494-b877-b0b14ca36dd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5108895c03f24d80bdf7048f4810ec3f', 'request_id': 'req-7e3f8d7c-ab92-4494-b877-b0b14ca36dd2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:29.604614 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-7e3f8d7c-ab92-4494-b877-b0b14ca36dd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5108895c03f24d80bdf7048f4810ec3f', 'request_id': 'req-7e3f8d7c-ab92-4494-b877-b0b14ca36dd2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:29.616751 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-7e3f8d7c-ab92-4494-b877-b0b14ca36dd2 admin admin] The token cache is being invalidate because project 5108895c03f24d80bdf7048f4810ec3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:15:29.617038 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-7e3f8d7c-ab92-4494-b877-b0b14ca36dd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:29.617658 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-7e3f8d7c-ab92-4494-b877-b0b14ca36dd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:29.619179 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1425/2817] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:15:29 2022] DELETE /identity/v3/projects/5108895c03f24d80bdf7048f4810ec3f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:15:29.625104 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b0931-72c7-45ab-868d-c48379d217f6 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:29.625586 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b0931-72c7-45ab-868d-c48379d217f6 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:29.625788 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b0931-72c7-45ab-868d-c48379d217f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:29.643442 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-476b0931-72c7-45ab-868d-c48379d217f6 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:15:29.644638 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-476b0931-72c7-45ab-868d-c48379d217f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:29.696019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:29.708606 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1393/2818] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:15:29.716539 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee658c-cb04-481c-afab-6db239c25c1d None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:29.716829 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee658c-cb04-481c-afab-6db239c25c1d None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:29.717110 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee658c-cb04-481c-afab-6db239c25c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:29.736950 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-28ee658c-cb04-481c-afab-6db239c25c1d None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:15:29.738163 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-28ee658c-cb04-481c-afab-6db239c25c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:29.746788 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1426/2819] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:15:29.751168 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b0931-72c7-45ab-868d-c48379d217f6 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:29.761567 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b0931-72c7-45ab-868d-c48379d217f6 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:29.766662 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497420a-e775-4071-9d23-91a1bf31a022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:29.767354 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497420a-e775-4071-9d23-91a1bf31a022 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:29.767678 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497420a-e775-4071-9d23-91a1bf31a022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:29.768082 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497420a-e775-4071-9d23-91a1bf31a022 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:29.768815 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497420a-e775-4071-9d23-91a1bf31a022 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:15:29.769129 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497420a-e775-4071-9d23-91a1bf31a022 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:29.770763 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497420a-e775-4071-9d23-91a1bf31a022 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:29.782853 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1394/2820] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:15:29.786848 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee658c-cb04-481c-afab-6db239c25c1d None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:29.796290 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee658c-cb04-481c-afab-6db239c25c1d None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:29.801148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e1562-bb00-424f-a5c8-1cd484a060ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:29.801802 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e1562-bb00-424f-a5c8-1cd484a060ef admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:29.802088 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e1562-bb00-424f-a5c8-1cd484a060ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:29.802368 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e1562-bb00-424f-a5c8-1cd484a060ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:29.803630 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e1562-bb00-424f-a5c8-1cd484a060ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:29.805516 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e1562-bb00-424f-a5c8-1cd484a060ef admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:29.831175 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1427/2821] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:15:29 2022] POST /identity/v3/projects => generated 361 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:15:29.835366 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497420a-e775-4071-9d23-91a1bf31a022 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:29.845248 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497420a-e775-4071-9d23-91a1bf31a022 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:29.901238 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0f41e-e606-488f-b8d4-d4fb2cc9bcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:29.901906 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0f41e-e606-488f-b8d4-d4fb2cc9bcec admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:29.902194 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0f41e-e606-488f-b8d4-d4fb2cc9bcec admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:29.902474 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0f41e-e606-488f-b8d4-d4fb2cc9bcec admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:29.903168 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0f41e-e606-488f-b8d4-d4fb2cc9bcec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:29.905093 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0f41e-e606-488f-b8d4-d4fb2cc9bcec admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:29.924319 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1395/2822] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:15:29 2022] POST /identity/v3/users => generated 281 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:15:29.928987 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e1562-bb00-424f-a5c8-1cd484a060ef admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:29.939065 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e1562-bb00-424f-a5c8-1cd484a060ef admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:29.944302 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07084610-ccba-4756-afc0-6f594ec9b3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:29.944951 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07084610-ccba-4756-afc0-6f594ec9b3c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:29.945235 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07084610-ccba-4756-afc0-6f594ec9b3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:29.945511 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07084610-ccba-4756-afc0-6f594ec9b3c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:29.946232 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07084610-ccba-4756-afc0-6f594ec9b3c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:29.947885 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07084610-ccba-4756-afc0-6f594ec9b3c5 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:29.957999 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1428/2823] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:15:29.961614 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0f41e-e606-488f-b8d4-d4fb2cc9bcec admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:29.971398 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0f41e-e606-488f-b8d4-d4fb2cc9bcec admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:29.976061 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef8f13-b844-4298-8154-590afc2a1805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:29.976724 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef8f13-b844-4298-8154-590afc2a1805 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:29.977015 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef8f13-b844-4298-8154-590afc2a1805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:29.977298 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef8f13-b844-4298-8154-590afc2a1805 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:29.978025 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef8f13-b844-4298-8154-590afc2a1805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:29.979675 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef8f13-b844-4298-8154-590afc2a1805 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:29.989497 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1396/2824] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:15:29.994209 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07084610-ccba-4756-afc0-6f594ec9b3c5 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:30.004494 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07084610-ccba-4756-afc0-6f594ec9b3c5 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:30.009819 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e5c3e-3055-4f7b-93b7-3dda9bc129df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:30.010688 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e5c3e-3055-4f7b-93b7-3dda9bc129df admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:30.010974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e5c3e-3055-4f7b-93b7-3dda9bc129df admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:30.011284 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e5c3e-3055-4f7b-93b7-3dda9bc129df admin admin] PATH_INFO: `/v3/projects/80a328cdc9dd41419ddbdb457bb70cf8/users/f5251132ea704933bc4b6d72ccbeabbb/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:30.025469 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e5c3e-3055-4f7b-93b7-3dda9bc129df admin admin] RBAC: Authorizing `identity:create_grant(project_id=80a328cdc9dd41419ddbdb457bb70cf8, user_id=f5251132ea704933bc4b6d72ccbeabbb, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:30.028196 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e5c3e-3055-4f7b-93b7-3dda9bc129df admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:30.041950 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1429/2825] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:15:29 2022] PUT /identity/v3/projects/80a328cdc9dd41419ddbdb457bb70cf8/users/f5251132ea704933bc4b6d72ccbeabbb/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:15:30.053744 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ff6ca-7921-4510-9562-8e771a2f5077 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:30.054041 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ff6ca-7921-4510-9562-8e771a2f5077 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:30.054325 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ff6ca-7921-4510-9562-8e771a2f5077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:30.080411 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-4a9ff6ca-7921-4510-9562-8e771a2f5077 None None] MFA Rules not processed for user `f5251132ea704933bc4b6d72ccbeabbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:15:30.081626 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-4a9ff6ca-7921-4510-9562-8e771a2f5077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:30.148118 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1397/2826] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:15:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:15:30.178044 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e5c3e-3055-4f7b-93b7-3dda9bc129df admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:30.179761 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a70e5c3e-3055-4f7b-93b7-3dda9bc129df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:30.235296 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e5c3e-3055-4f7b-93b7-3dda9bc129df admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:30.238821 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98fc03-c05c-45f8-bd9b-5bb822249d5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed3a61154a444a9cb925839f693208c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:30.239484 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98fc03-c05c-45f8-bd9b-5bb822249d5a service cinder] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:30.239765 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98fc03-c05c-45f8-bd9b-5bb822249d5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:30.240037 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98fc03-c05c-45f8-bd9b-5bb822249d5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:30.248275 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98fc03-c05c-45f8-bd9b-5bb822249d5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:30.249687 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98fc03-c05c-45f8-bd9b-5bb822249d5a service cinder] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:30.258761 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1430/2827] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:15:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:15:30.273250 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ff6ca-7921-4510-9562-8e771a2f5077 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:30.324474 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:30.337928 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ff6ca-7921-4510-9562-8e771a2f5077 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:30.342479 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133528bc-5682-482f-8294-f93ffa52fc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:30.343393 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133528bc-5682-482f-8294-f93ffa52fc63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:30.343674 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133528bc-5682-482f-8294-f93ffa52fc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:30.343947 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133528bc-5682-482f-8294-f93ffa52fc63 admin admin] PATH_INFO: `/v3/users/f5251132ea704933bc4b6d72ccbeabbb` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:30.345122 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133528bc-5682-482f-8294-f93ffa52fc63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5251132ea704933bc4b6d72ccbeabbb)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:30.347032 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133528bc-5682-482f-8294-f93ffa52fc63 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:30.392999 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-133528bc-5682-482f-8294-f93ffa52fc63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5251132ea704933bc4b6d72ccbeabbb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:30.400218 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-133528bc-5682-482f-8294-f93ffa52fc63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5251132ea704933bc4b6d72ccbeabbb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:30.411847 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-133528bc-5682-482f-8294-f93ffa52fc63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5251132ea704933bc4b6d72ccbeabbb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:30.412648 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-133528bc-5682-482f-8294-f93ffa52fc63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5251132ea704933bc4b6d72ccbeabbb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:30.413273 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-133528bc-5682-482f-8294-f93ffa52fc63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5251132ea704933bc4b6d72ccbeabbb'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:30.425793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1398/2828] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:15:30 2022] DELETE /identity/v3/users/f5251132ea704933bc4b6d72ccbeabbb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:15:30.430797 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2d7c8-446f-4fd6-b60f-349a6e68aa02 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:30.431109 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2d7c8-446f-4fd6-b60f-349a6e68aa02 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:30.431434 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2d7c8-446f-4fd6-b60f-349a6e68aa02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:30.442898 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:30.450096 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-7ec2d7c8-446f-4fd6-b60f-349a6e68aa02 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:15:30.452000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7ec2d7c8-446f-4fd6-b60f-349a6e68aa02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:30.511730 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1431/2829] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:15:30.521643 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133528bc-5682-482f-8294-f93ffa52fc63 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:30.523046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-133528bc-5682-482f-8294-f93ffa52fc63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:30.578602 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133528bc-5682-482f-8294-f93ffa52fc63 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:30.582220 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f44a5-c2f1-4e1e-8f95-7c26742c861a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:30.582860 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f44a5-c2f1-4e1e-8f95-7c26742c861a service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:30.583145 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f44a5-c2f1-4e1e-8f95-7c26742c861a service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:30.583453 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f44a5-c2f1-4e1e-8f95-7c26742c861a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:30.592834 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f44a5-c2f1-4e1e-8f95-7c26742c861a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:30.594267 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f44a5-c2f1-4e1e-8f95-7c26742c861a service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:30.604176 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1399/2830] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:15:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:15:30.864986 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2d7c8-446f-4fd6-b60f-349a6e68aa02 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:30.866595 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7ec2d7c8-446f-4fd6-b60f-349a6e68aa02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:30.879366 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2d7c8-446f-4fd6-b60f-349a6e68aa02 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:30.884534 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee856e2-516b-4d81-a960-f45b0ded6557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:30.885469 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee856e2-516b-4d81-a960-f45b0ded6557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:30.886236 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee856e2-516b-4d81-a960-f45b0ded6557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:30.886585 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee856e2-516b-4d81-a960-f45b0ded6557 admin admin] PATH_INFO: `/v3/projects/80a328cdc9dd41419ddbdb457bb70cf8` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:30.887947 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee856e2-516b-4d81-a960-f45b0ded6557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80a328cdc9dd41419ddbdb457bb70cf8)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:30.890000 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee856e2-516b-4d81-a960-f45b0ded6557 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:30.935664 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-bee856e2-516b-4d81-a960-f45b0ded6557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80a328cdc9dd41419ddbdb457bb70cf8', 'request_id': 'req-bee856e2-516b-4d81-a960-f45b0ded6557'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:30.941183 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-bee856e2-516b-4d81-a960-f45b0ded6557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80a328cdc9dd41419ddbdb457bb70cf8', 'request_id': 'req-bee856e2-516b-4d81-a960-f45b0ded6557'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:30.947818 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-bee856e2-516b-4d81-a960-f45b0ded6557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80a328cdc9dd41419ddbdb457bb70cf8', 'request_id': 'req-bee856e2-516b-4d81-a960-f45b0ded6557'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:30.960410 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-bee856e2-516b-4d81-a960-f45b0ded6557 admin admin] The token cache is being invalidate because project 80a328cdc9dd41419ddbdb457bb70cf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80157) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:15:30.960699 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-bee856e2-516b-4d81-a960-f45b0ded6557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:30.961325 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-bee856e2-516b-4d81-a960-f45b0ded6557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:30.962837 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1432/2831] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:15:30 2022] DELETE /identity/v3/projects/80a328cdc9dd41419ddbdb457bb70cf8 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:15:30.967864 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089b275-1581-46b3-9d2b-de7e812c108f None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:30.968335 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089b275-1581-46b3-9d2b-de7e812c108f None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:30.968435 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089b275-1581-46b3-9d2b-de7e812c108f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:30.985455 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-8089b275-1581-46b3-9d2b-de7e812c108f None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:15:30.986642 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-8089b275-1581-46b3-9d2b-de7e812c108f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:31.045924 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1400/2832] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:15:31.053712 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0b418-d7b8-4d6f-bb60-35cc865a210e None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:31.054002 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0b418-d7b8-4d6f-bb60-35cc865a210e None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:31.054285 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0b418-d7b8-4d6f-bb60-35cc865a210e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:31.072462 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-90e0b418-d7b8-4d6f-bb60-35cc865a210e None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:15:31.073650 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-90e0b418-d7b8-4d6f-bb60-35cc865a210e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:31.081427 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1433/2833] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:15:31.085958 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089b275-1581-46b3-9d2b-de7e812c108f None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:31.095794 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089b275-1581-46b3-9d2b-de7e812c108f None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:31.100409 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3ed1d-5588-413f-86ae-d7291f29ede1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:31.101056 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3ed1d-5588-413f-86ae-d7291f29ede1 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:31.101344 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3ed1d-5588-413f-86ae-d7291f29ede1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:31.101624 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3ed1d-5588-413f-86ae-d7291f29ede1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:31.102347 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3ed1d-5588-413f-86ae-d7291f29ede1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80158) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:15:31.102657 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3ed1d-5588-413f-86ae-d7291f29ede1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:31.104297 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3ed1d-5588-413f-86ae-d7291f29ede1 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:31.112616 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:31.116748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1401/2834] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:15:31.121230 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0b418-d7b8-4d6f-bb60-35cc865a210e None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:31.130239 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0b418-d7b8-4d6f-bb60-35cc865a210e None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:31.137930 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b5243-ec36-4c1b-bc90-d0c33f9e7c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:31.138615 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b5243-ec36-4c1b-bc90-d0c33f9e7c7b admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:31.138902 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b5243-ec36-4c1b-bc90-d0c33f9e7c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:31.139185 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b5243-ec36-4c1b-bc90-d0c33f9e7c7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:31.139918 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b5243-ec36-4c1b-bc90-d0c33f9e7c7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:31.141806 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b5243-ec36-4c1b-bc90-d0c33f9e7c7b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:31.165785 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1434/2835] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:15:31 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:15:31.170177 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3ed1d-5588-413f-86ae-d7291f29ede1 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:31.180662 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3ed1d-5588-413f-86ae-d7291f29ede1 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:31.235399 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05b3f4-1a4f-47af-a5cd-d504186e4d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:31.235998 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05b3f4-1a4f-47af-a5cd-d504186e4d24 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:31.236288 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05b3f4-1a4f-47af-a5cd-d504186e4d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:31.236569 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05b3f4-1a4f-47af-a5cd-d504186e4d24 admin admin] PATH_INFO: `/v3/users` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:31.237247 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05b3f4-1a4f-47af-a5cd-d504186e4d24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:31.239163 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05b3f4-1a4f-47af-a5cd-d504186e4d24 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:31.259496 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1402/2836] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:15:31 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:15:31.263622 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b5243-ec36-4c1b-bc90-d0c33f9e7c7b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:31.273678 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b5243-ec36-4c1b-bc90-d0c33f9e7c7b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:31.278155 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa0d17-16f5-4e0a-97b7-fb46a9318bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:31.278801 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa0d17-16f5-4e0a-97b7-fb46a9318bad admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:31.279078 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa0d17-16f5-4e0a-97b7-fb46a9318bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:31.279391 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa0d17-16f5-4e0a-97b7-fb46a9318bad admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:31.280118 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa0d17-16f5-4e0a-97b7-fb46a9318bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:31.281694 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa0d17-16f5-4e0a-97b7-fb46a9318bad admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:31.291776 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1435/2837] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:15:31.295561 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05b3f4-1a4f-47af-a5cd-d504186e4d24 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:31.306427 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05b3f4-1a4f-47af-a5cd-d504186e4d24 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:31.311941 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc038686-e129-4a05-8779-598a36afed56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:31.312651 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc038686-e129-4a05-8779-598a36afed56 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:31.312952 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc038686-e129-4a05-8779-598a36afed56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:31.313405 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc038686-e129-4a05-8779-598a36afed56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:31.314999 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc038686-e129-4a05-8779-598a36afed56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:31.317889 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc038686-e129-4a05-8779-598a36afed56 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:31.333716 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1403/2838] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:15:31.337892 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa0d17-16f5-4e0a-97b7-fb46a9318bad admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:31.348360 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa0d17-16f5-4e0a-97b7-fb46a9318bad admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:31.353002 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716717b-f146-4b62-99f6-4f3bdf39232a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:31.353872 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716717b-f146-4b62-99f6-4f3bdf39232a admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:31.354153 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716717b-f146-4b62-99f6-4f3bdf39232a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:31.354431 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716717b-f146-4b62-99f6-4f3bdf39232a admin admin] PATH_INFO: `/v3/projects/671c1650f68446e9a8a429507132cfcb/users/c276579d318249f99ae71ae26e727c4a/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:31.369848 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716717b-f146-4b62-99f6-4f3bdf39232a admin admin] RBAC: Authorizing `identity:create_grant(project_id=671c1650f68446e9a8a429507132cfcb, user_id=c276579d318249f99ae71ae26e727c4a, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:31.372758 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716717b-f146-4b62-99f6-4f3bdf39232a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:31.386059 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1436/2839] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:15:31 2022] PUT /identity/v3/projects/671c1650f68446e9a8a429507132cfcb/users/c276579d318249f99ae71ae26e727c4a/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:15:31.396307 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d5948-1cb4-440e-8336-97eeaa5689eb None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:31.396654 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d5948-1cb4-440e-8336-97eeaa5689eb None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:31.396945 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d5948-1cb4-440e-8336-97eeaa5689eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:31.423015 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ea5d5948-1cb4-440e-8336-97eeaa5689eb None None] MFA Rules not processed for user `c276579d318249f99ae71ae26e727c4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:15:31.424274 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ea5d5948-1cb4-440e-8336-97eeaa5689eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:31.486410 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1404/2840] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:15:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:15:31.498312 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716717b-f146-4b62-99f6-4f3bdf39232a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:31.500080 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-8716717b-f146-4b62-99f6-4f3bdf39232a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:31.530620 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:31.560115 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716717b-f146-4b62-99f6-4f3bdf39232a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:31.563784 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afc93c-4e85-4a21-a159-b62504858dcb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1dc1d74631b4d69a3094e4e1e2a0ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:31.564434 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afc93c-4e85-4a21-a159-b62504858dcb service glance] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:31.564716 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afc93c-4e85-4a21-a159-b62504858dcb service glance] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:31.564992 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afc93c-4e85-4a21-a159-b62504858dcb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:31.573595 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afc93c-4e85-4a21-a159-b62504858dcb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:31.575021 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afc93c-4e85-4a21-a159-b62504858dcb service glance] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:31.583981 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1437/2841] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:15:31 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:15:32.641904 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d5948-1cb4-440e-8336-97eeaa5689eb None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:32.643381 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ea5d5948-1cb4-440e-8336-97eeaa5689eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:32.720569 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d5948-1cb4-440e-8336-97eeaa5689eb None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:32.720569 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f50da0-c2ca-4146-b400-b483671d2de2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:32.720569 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f50da0-c2ca-4146-b400-b483671d2de2 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:32.721035 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f50da0-c2ca-4146-b400-b483671d2de2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:32.721139 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f50da0-c2ca-4146-b400-b483671d2de2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:32.723375 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e1f50da0-c2ca-4146-b400-b483671d2de2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:32.747872 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:32.803358 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f50da0-c2ca-4146-b400-b483671d2de2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:32.804805 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f50da0-c2ca-4146-b400-b483671d2de2 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:32.817637 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1405/2842] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:15:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:15:34.011311 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afc93c-4e85-4a21-a159-b62504858dcb service glance] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:34.020673 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afc93c-4e85-4a21-a159-b62504858dcb service glance] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:34.024614 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39d9b2-199e-45f9-ba81-6cf8f860c12c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:34.025608 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39d9b2-199e-45f9-ba81-6cf8f860c12c service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:34.025900 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39d9b2-199e-45f9-ba81-6cf8f860c12c service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:34.026184 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39d9b2-199e-45f9-ba81-6cf8f860c12c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:34.028127 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2b39d9b2-199e-45f9-ba81-6cf8f860c12c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:34.042557 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39d9b2-199e-45f9-ba81-6cf8f860c12c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:34.044033 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39d9b2-199e-45f9-ba81-6cf8f860c12c service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:34.055674 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1438/2843] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:15:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 19 15:15:42.811877 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=23 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:44.050096 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=20 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:44.440752 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f50da0-c2ca-4146-b400-b483671d2de2 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:44.442184 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e1f50da0-c2ca-4146-b400-b483671d2de2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:44.453067 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f50da0-c2ca-4146-b400-b483671d2de2 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:44.456676 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e7f0f-8ba1-4db4-86a4-190067a628d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:44.457324 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e7f0f-8ba1-4db4-86a4-190067a628d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:44.457629 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e7f0f-8ba1-4db4-86a4-190067a628d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:44.457911 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e7f0f-8ba1-4db4-86a4-190067a628d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:44.460177 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-2d7e7f0f-8ba1-4db4-86a4-190067a628d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:44.521569 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e7f0f-8ba1-4db4-86a4-190067a628d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:44.523555 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e7f0f-8ba1-4db4-86a4-190067a628d2 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:44.533161 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1406/2844] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:15:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:15:50.806497 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39d9b2-199e-45f9-ba81-6cf8f860c12c service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:50.808063 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2b39d9b2-199e-45f9-ba81-6cf8f860c12c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:50.822979 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39d9b2-199e-45f9-ba81-6cf8f860c12c service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:50.827511 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479737a-75a4-4f7d-8d9f-09d988a57fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:50.828497 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479737a-75a4-4f7d-8d9f-09d988a57fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:50.828783 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479737a-75a4-4f7d-8d9f-09d988a57fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:50.829062 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479737a-75a4-4f7d-8d9f-09d988a57fea admin admin] PATH_INFO: `/v3/users/9877b9bbc14141bba21625fc8f1046d2` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:50.830261 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1479737a-75a4-4f7d-8d9f-09d988a57fea admin admin] RBAC: Authorizing `identity:delete_user(user_id=9877b9bbc14141bba21625fc8f1046d2)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:50.832207 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1479737a-75a4-4f7d-8d9f-09d988a57fea admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:50.878297 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1479737a-75a4-4f7d-8d9f-09d988a57fea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9877b9bbc14141bba21625fc8f1046d2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:50.879231 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1479737a-75a4-4f7d-8d9f-09d988a57fea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9877b9bbc14141bba21625fc8f1046d2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:50.879845 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1479737a-75a4-4f7d-8d9f-09d988a57fea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9877b9bbc14141bba21625fc8f1046d2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:50.886961 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1479737a-75a4-4f7d-8d9f-09d988a57fea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9877b9bbc14141bba21625fc8f1046d2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:50.898931 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-1479737a-75a4-4f7d-8d9f-09d988a57fea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9877b9bbc14141bba21625fc8f1046d2'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:50.910948 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1439/2845] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:15:50 2022] DELETE /identity/v3/users/9877b9bbc14141bba21625fc8f1046d2 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:15:51.085562 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e7f0f-8ba1-4db4-86a4-190067a628d2 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:51.095652 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e7f0f-8ba1-4db4-86a4-190067a628d2 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:51.163127 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c8d12-bf68-4dab-b048-150e47a34486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:51.164054 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c8d12-bf68-4dab-b048-150e47a34486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:51.164341 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c8d12-bf68-4dab-b048-150e47a34486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:51.164620 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c8d12-bf68-4dab-b048-150e47a34486 admin admin] PATH_INFO: `/v3/projects/2c71bc8f0a164884bc0c046fd1e7faab` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:51.165931 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c8d12-bf68-4dab-b048-150e47a34486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c71bc8f0a164884bc0c046fd1e7faab)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:51.167968 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c8d12-bf68-4dab-b048-150e47a34486 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:51.217960 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-148c8d12-bf68-4dab-b048-150e47a34486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c71bc8f0a164884bc0c046fd1e7faab', 'request_id': 'req-148c8d12-bf68-4dab-b048-150e47a34486'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:51.226773 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-148c8d12-bf68-4dab-b048-150e47a34486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c71bc8f0a164884bc0c046fd1e7faab', 'request_id': 'req-148c8d12-bf68-4dab-b048-150e47a34486'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:51.233688 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-148c8d12-bf68-4dab-b048-150e47a34486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c71bc8f0a164884bc0c046fd1e7faab', 'request_id': 'req-148c8d12-bf68-4dab-b048-150e47a34486'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:51.245046 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-148c8d12-bf68-4dab-b048-150e47a34486 admin admin] The token cache is being invalidate because project 2c71bc8f0a164884bc0c046fd1e7faab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:15:51.245404 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-148c8d12-bf68-4dab-b048-150e47a34486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:51.246380 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-148c8d12-bf68-4dab-b048-150e47a34486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:51.248074 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1407/2846] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:15:51 2022] DELETE /identity/v3/projects/2c71bc8f0a164884bc0c046fd1e7faab => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:15:51.252199 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479737a-75a4-4f7d-8d9f-09d988a57fea admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:51.253727 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-1479737a-75a4-4f7d-8d9f-09d988a57fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:51.267411 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479737a-75a4-4f7d-8d9f-09d988a57fea admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:51.329509 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7fa57-4519-4256-85c3-aa998a586581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:51.330412 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7fa57-4519-4256-85c3-aa998a586581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:51.330701 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7fa57-4519-4256-85c3-aa998a586581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:51.330974 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7fa57-4519-4256-85c3-aa998a586581 admin admin] PATH_INFO: `/v3/users/91a54df480ce4d60979bf20b62f75867` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:51.332247 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb7fa57-4519-4256-85c3-aa998a586581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91a54df480ce4d60979bf20b62f75867)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:51.334718 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb7fa57-4519-4256-85c3-aa998a586581 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:51.384026 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0cb7fa57-4519-4256-85c3-aa998a586581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91a54df480ce4d60979bf20b62f75867'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:51.384688 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0cb7fa57-4519-4256-85c3-aa998a586581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91a54df480ce4d60979bf20b62f75867'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:51.385297 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0cb7fa57-4519-4256-85c3-aa998a586581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91a54df480ce4d60979bf20b62f75867'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:51.392626 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0cb7fa57-4519-4256-85c3-aa998a586581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91a54df480ce4d60979bf20b62f75867'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:51.406427 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-0cb7fa57-4519-4256-85c3-aa998a586581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91a54df480ce4d60979bf20b62f75867'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:51.408624 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:51.421168 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1440/2847] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:15:51 2022] DELETE /identity/v3/users/91a54df480ce4d60979bf20b62f75867 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:15:51.598111 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c8d12-bf68-4dab-b048-150e47a34486 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:15:51.599843 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-148c8d12-bf68-4dab-b048-150e47a34486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:15:51.613033 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c8d12-bf68-4dab-b048-150e47a34486 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:15:51.634749 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:51.671500 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46960b4a-f379-4192-9b2e-0af34a798564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:15:51.672358 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46960b4a-f379-4192-9b2e-0af34a798564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:15:51.672639 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46960b4a-f379-4192-9b2e-0af34a798564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:15:51.672918 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46960b4a-f379-4192-9b2e-0af34a798564 admin admin] PATH_INFO: `/v3/projects/6407de57591f46f290c7c425a5b6c76d` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:15:51.674068 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46960b4a-f379-4192-9b2e-0af34a798564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6407de57591f46f290c7c425a5b6c76d)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:15:51.676014 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46960b4a-f379-4192-9b2e-0af34a798564 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:15:51.720720 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-46960b4a-f379-4192-9b2e-0af34a798564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6407de57591f46f290c7c425a5b6c76d', 'request_id': 'req-46960b4a-f379-4192-9b2e-0af34a798564'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:51.727591 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-46960b4a-f379-4192-9b2e-0af34a798564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6407de57591f46f290c7c425a5b6c76d', 'request_id': 'req-46960b4a-f379-4192-9b2e-0af34a798564'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:51.733765 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-46960b4a-f379-4192-9b2e-0af34a798564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6407de57591f46f290c7c425a5b6c76d', 'request_id': 'req-46960b4a-f379-4192-9b2e-0af34a798564'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:51.744413 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-46960b4a-f379-4192-9b2e-0af34a798564 admin admin] The token cache is being invalidate because project 6407de57591f46f290c7c425a5b6c76d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:15:51.744703 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-46960b4a-f379-4192-9b2e-0af34a798564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:51.745329 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-46960b4a-f379-4192-9b2e-0af34a798564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:15:51.747085 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1408/2848] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:15:51 2022] DELETE /identity/v3/projects/6407de57591f46f290c7c425a5b6c76d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:16:01.429052 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=4 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:16:01.741617 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:16:02.810596 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7fa57-4519-4256-85c3-aa998a586581 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:16:02.812038 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-0cb7fa57-4519-4256-85c3-aa998a586581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:16:02.825074 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7fa57-4519-4256-85c3-aa998a586581 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:16:02.880820 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cde573-3cf8-41d1-8250-e7fecf4a38b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:16:02.881614 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cde573-3cf8-41d1-8250-e7fecf4a38b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:02.881902 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cde573-3cf8-41d1-8250-e7fecf4a38b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:02.882714 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cde573-3cf8-41d1-8250-e7fecf4a38b8 admin admin] PATH_INFO: `/v3/users/c276579d318249f99ae71ae26e727c4a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:02.883963 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cde573-3cf8-41d1-8250-e7fecf4a38b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c276579d318249f99ae71ae26e727c4a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:16:02.885884 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cde573-3cf8-41d1-8250-e7fecf4a38b8 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:16:02.945588 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-76cde573-3cf8-41d1-8250-e7fecf4a38b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c276579d318249f99ae71ae26e727c4a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:16:02.946505 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-76cde573-3cf8-41d1-8250-e7fecf4a38b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c276579d318249f99ae71ae26e727c4a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:16:02.947428 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-76cde573-3cf8-41d1-8250-e7fecf4a38b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c276579d318249f99ae71ae26e727c4a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:16:02.955800 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-76cde573-3cf8-41d1-8250-e7fecf4a38b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c276579d318249f99ae71ae26e727c4a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:16:02.973381 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-76cde573-3cf8-41d1-8250-e7fecf4a38b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c276579d318249f99ae71ae26e727c4a'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:16:02.986950 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1441/2849] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:16:02 2022] DELETE /identity/v3/users/c276579d318249f99ae71ae26e727c4a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:16:02.992081 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b8531-5b5b-48e2-ab61-92b754a16a96 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:02.992584 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b8531-5b5b-48e2-ab61-92b754a16a96 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:02.992697 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b8531-5b5b-48e2-ab61-92b754a16a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:03.015393 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-bc0b8531-5b5b-48e2-ab61-92b754a16a96 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:16:03.016617 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bc0b8531-5b5b-48e2-ab61-92b754a16a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:16:03.075331 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1409/2850] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:16:03.084907 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cde573-3cf8-41d1-8250-e7fecf4a38b8 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:16:03.086338 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-76cde573-3cf8-41d1-8250-e7fecf4a38b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:16:03.143887 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cde573-3cf8-41d1-8250-e7fecf4a38b8 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:16:03.147427 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ffd341-cf90-4177-b02f-e44358efe2f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:16:03.148244 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffd341-cf90-4177-b02f-e44358efe2f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:03.148526 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffd341-cf90-4177-b02f-e44358efe2f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:03.148800 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffd341-cf90-4177-b02f-e44358efe2f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:03.157596 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ffd341-cf90-4177-b02f-e44358efe2f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:16:03.159011 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ffd341-cf90-4177-b02f-e44358efe2f0 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:16:03.168202 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1442/2851] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:16:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:16:03.447174 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b8531-5b5b-48e2-ab61-92b754a16a96 None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:16:03.448746 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bc0b8531-5b5b-48e2-ab61-92b754a16a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:16:03.462131 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b8531-5b5b-48e2-ab61-92b754a16a96 None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:16:03.466792 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ebdb05-ce23-49ee-a614-7c4432779eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:16:03.467714 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebdb05-ce23-49ee-a614-7c4432779eb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:03.467991 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebdb05-ce23-49ee-a614-7c4432779eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:03.468266 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ebdb05-ce23-49ee-a614-7c4432779eb9 admin admin] PATH_INFO: `/v3/projects/671c1650f68446e9a8a429507132cfcb` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:03.469453 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ebdb05-ce23-49ee-a614-7c4432779eb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=671c1650f68446e9a8a429507132cfcb)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:16:03.471426 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ebdb05-ce23-49ee-a614-7c4432779eb9 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:16:03.518474 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d8ebdb05-ce23-49ee-a614-7c4432779eb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '671c1650f68446e9a8a429507132cfcb', 'request_id': 'req-d8ebdb05-ce23-49ee-a614-7c4432779eb9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:16:03.526905 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d8ebdb05-ce23-49ee-a614-7c4432779eb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '671c1650f68446e9a8a429507132cfcb', 'request_id': 'req-d8ebdb05-ce23-49ee-a614-7c4432779eb9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:16:03.534017 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d8ebdb05-ce23-49ee-a614-7c4432779eb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '671c1650f68446e9a8a429507132cfcb', 'request_id': 'req-d8ebdb05-ce23-49ee-a614-7c4432779eb9'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:16:03.544781 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d8ebdb05-ce23-49ee-a614-7c4432779eb9 admin admin] The token cache is being invalidate because project 671c1650f68446e9a8a429507132cfcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:16:03.545075 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d8ebdb05-ce23-49ee-a614-7c4432779eb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:16:03.545710 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-d8ebdb05-ce23-49ee-a614-7c4432779eb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:16:03.547269 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1410/2852] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:16:03 2022] DELETE /identity/v3/projects/671c1650f68446e9a8a429507132cfcb => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:16:03.552085 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dde26-2173-4bb1-8abd-a846e460b6de None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:03.552373 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dde26-2173-4bb1-8abd-a846e460b6de None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:03.552645 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dde26-2173-4bb1-8abd-a846e460b6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:03.570149 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-2f4dde26-2173-4bb1-8abd-a846e460b6de None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:16:03.571368 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-2f4dde26-2173-4bb1-8abd-a846e460b6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:16:03.587320 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:16:03.632474 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1443/2853] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:16:03.641532 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7387a7b-0b1e-43de-8411-4cb58e1b78eb None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:03.641793 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7387a7b-0b1e-43de-8411-4cb58e1b78eb None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:03.641970 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7387a7b-0b1e-43de-8411-4cb58e1b78eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:03.660207 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-d7387a7b-0b1e-43de-8411-4cb58e1b78eb None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:16:03.661401 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-d7387a7b-0b1e-43de-8411-4cb58e1b78eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:16:03.669740 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1411/2854] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:16:03.673823 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4dde26-2173-4bb1-8abd-a846e460b6de None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:16:03.684276 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4dde26-2173-4bb1-8abd-a846e460b6de None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:16:03.688909 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735aff1-f909-4085-8748-5add606bffca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:16:03.689559 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735aff1-f909-4085-8748-5add606bffca admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:03.689846 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735aff1-f909-4085-8748-5add606bffca admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:03.690117 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735aff1-f909-4085-8748-5add606bffca admin admin] PATH_INFO: `/v3/domains` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:03.690837 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735aff1-f909-4085-8748-5add606bffca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80157) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 19 15:16:03.691144 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735aff1-f909-4085-8748-5add606bffca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:16:03.692765 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735aff1-f909-4085-8748-5add606bffca admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:16:03.704089 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1444/2855] 10.222.0.24 () {58 vars in 1152 bytes} [Thu May 19 15:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 19 15:16:03.708146 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7387a7b-0b1e-43de-8411-4cb58e1b78eb None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:16:03.717683 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7387a7b-0b1e-43de-8411-4cb58e1b78eb None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:16:03.722332 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e4b45-4e7b-4565-9bee-30c8f3067d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:16:03.722977 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e4b45-4e7b-4565-9bee-30c8f3067d6d admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:03.723329 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e4b45-4e7b-4565-9bee-30c8f3067d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:03.723613 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e4b45-4e7b-4565-9bee-30c8f3067d6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:03.724289 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e4b45-4e7b-4565-9bee-30c8f3067d6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:16:03.726829 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e4b45-4e7b-4565-9bee-30c8f3067d6d admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:16:03.752483 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1412/2856] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:16:03 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:16:03.756433 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735aff1-f909-4085-8748-5add606bffca admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:16:03.766103 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735aff1-f909-4085-8748-5add606bffca admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:16:03.820786 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b36ba6-6542-43a7-a7bc-31bc218d0ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:16:03.821481 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b36ba6-6542-43a7-a7bc-31bc218d0ddc admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:03.821771 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b36ba6-6542-43a7-a7bc-31bc218d0ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:03.822050 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b36ba6-6542-43a7-a7bc-31bc218d0ddc admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:03.822786 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b36ba6-6542-43a7-a7bc-31bc218d0ddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:16:03.824751 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b36ba6-6542-43a7-a7bc-31bc218d0ddc admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:16:03.847525 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1445/2857] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:16:03 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 19 15:16:03.848914 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e4b45-4e7b-4565-9bee-30c8f3067d6d admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:16:03.859651 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e4b45-4e7b-4565-9bee-30c8f3067d6d admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:16:03.864369 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be06f9-028b-4cbb-9cc8-d52b3220b794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:16:03.865030 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be06f9-028b-4cbb-9cc8-d52b3220b794 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:03.865316 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be06f9-028b-4cbb-9cc8-d52b3220b794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:03.865594 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be06f9-028b-4cbb-9cc8-d52b3220b794 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:03.866321 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be06f9-028b-4cbb-9cc8-d52b3220b794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:16:03.867969 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be06f9-028b-4cbb-9cc8-d52b3220b794 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:16:03.878408 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1413/2858] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:16:03.882194 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b36ba6-6542-43a7-a7bc-31bc218d0ddc admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:16:03.892010 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b36ba6-6542-43a7-a7bc-31bc218d0ddc admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:16:03.896554 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65071e14-f852-42c5-85f5-28d43c73b2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:16:03.897200 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65071e14-f852-42c5-85f5-28d43c73b2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:03.897484 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65071e14-f852-42c5-85f5-28d43c73b2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:03.898276 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65071e14-f852-42c5-85f5-28d43c73b2d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:03.899035 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65071e14-f852-42c5-85f5-28d43c73b2d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:16:03.900657 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65071e14-f852-42c5-85f5-28d43c73b2d3 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:16:03.910333 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1446/2859] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 15:16:03.914672 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be06f9-028b-4cbb-9cc8-d52b3220b794 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:16:03.924451 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be06f9-028b-4cbb-9cc8-d52b3220b794 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:16:03.929615 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e62a68-d494-4102-81d9-68a2d8c0e047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:16:03.930488 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e62a68-d494-4102-81d9-68a2d8c0e047 admin admin] REQUEST_METHOD: `PUT` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:03.930777 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e62a68-d494-4102-81d9-68a2d8c0e047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:03.931089 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e62a68-d494-4102-81d9-68a2d8c0e047 admin admin] PATH_INFO: `/v3/projects/75c950a99db0449d914183ad7ca845a7/users/6c9b6e614944426fb39c3784a21bbf3b/roles/fd5043dc9e3e4ec49e035ee01fc68854` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:03.945774 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e62a68-d494-4102-81d9-68a2d8c0e047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75c950a99db0449d914183ad7ca845a7, user_id=6c9b6e614944426fb39c3784a21bbf3b, role_id=fd5043dc9e3e4ec49e035ee01fc68854)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:16:03.948546 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e62a68-d494-4102-81d9-68a2d8c0e047 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:16:03.961279 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1414/2860] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:16:03 2022] PUT /identity/v3/projects/75c950a99db0449d914183ad7ca845a7/users/6c9b6e614944426fb39c3784a21bbf3b/roles/fd5043dc9e3e4ec49e035ee01fc68854 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:16:03.966278 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f85e7-ca6c-41b8-9d63-e54d1ddf6853 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:03.966591 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f85e7-ca6c-41b8-9d63-e54d1ddf6853 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:03.966870 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f85e7-ca6c-41b8-9d63-e54d1ddf6853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:03.984327 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-b97f85e7-ca6c-41b8-9d63-e54d1ddf6853 None None] MFA Rules not processed for user `83eec44e6acd4004ba2088801e9d8f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:16:03.985511 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-b97f85e7-ca6c-41b8-9d63-e54d1ddf6853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:16:04.043469 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1447/2861] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 19 15:16:04.052656 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e62a68-d494-4102-81d9-68a2d8c0e047 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:16:04.054883 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-16e62a68-d494-4102-81d9-68a2d8c0e047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:16:04.076864 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:16:04.114342 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e62a68-d494-4102-81d9-68a2d8c0e047 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:16:04.118561 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d4990-6e46-4237-8976-524aedde42f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:16:04.119224 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d4990-6e46-4237-8976-524aedde42f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:04.119518 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d4990-6e46-4237-8976-524aedde42f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:04.119795 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d4990-6e46-4237-8976-524aedde42f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:04.128891 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d4990-6e46-4237-8976-524aedde42f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:16:04.130334 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d4990-6e46-4237-8976-524aedde42f4 service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:16:04.140758 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1415/2862] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:16:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:16:08.005247 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7a7a-6710-4c74-821b-f74828ef67bc None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:08.005750 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7a7a-6710-4c74-821b-f74828ef67bc None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:08.005894 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7a7a-6710-4c74-821b-f74828ef67bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:08.031844 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-11ce7a7a-6710-4c74-821b-f74828ef67bc None None] MFA Rules not processed for user `6c9b6e614944426fb39c3784a21bbf3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:16:08.033056 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-11ce7a7a-6710-4c74-821b-f74828ef67bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:16:08.050331 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:16:08.102226 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1448/2863] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:16:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:16:08.106689 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d4990-6e46-4237-8976-524aedde42f4 service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:16:08.117599 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d4990-6e46-4237-8976-524aedde42f4 service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:16:08.124005 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b087ec0-0ff1-429b-9706-02643752dfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:16:08.125244 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b087ec0-0ff1-429b-9706-02643752dfb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:08.125573 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b087ec0-0ff1-429b-9706-02643752dfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:08.125908 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b087ec0-0ff1-429b-9706-02643752dfb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:08.126564 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b087ec0-0ff1-429b-9706-02643752dfb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:16:08.130196 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b087ec0-0ff1-429b-9706-02643752dfb4 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:16:08.162671 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1416/2864] 10.222.0.24 () {60 vars in 1152 bytes} [Thu May 19 15:16:08 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:16:08.167305 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce7a7a-6710-4c74-821b-f74828ef67bc None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:16:08.178162 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce7a7a-6710-4c74-821b-f74828ef67bc None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:16:08.239159 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e446e61-b068-4917-8fc9-097b0265d80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:16:08.239876 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e446e61-b068-4917-8fc9-097b0265d80a admin admin] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:08.240139 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e446e61-b068-4917-8fc9-097b0265d80a admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:08.240433 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e446e61-b068-4917-8fc9-097b0265d80a admin admin] PATH_INFO: `/v3/users` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:08.241128 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e446e61-b068-4917-8fc9-097b0265d80a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:16:08.243086 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e446e61-b068-4917-8fc9-097b0265d80a admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:16:08.262814 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1449/2865] 10.222.0.24 () {60 vars in 1143 bytes} [Thu May 19 15:16:08 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 19 15:16:08.266692 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b087ec0-0ff1-429b-9706-02643752dfb4 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:16:08.277716 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b087ec0-0ff1-429b-9706-02643752dfb4 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:16:08.282390 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b5494-79e2-431e-8e5e-245ff6c3587b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:16:08.283061 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b5494-79e2-431e-8e5e-245ff6c3587b admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:08.283463 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b5494-79e2-431e-8e5e-245ff6c3587b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:08.283732 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b5494-79e2-431e-8e5e-245ff6c3587b admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:08.284379 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b5494-79e2-431e-8e5e-245ff6c3587b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:16:08.285994 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b5494-79e2-431e-8e5e-245ff6c3587b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:16:08.297770 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1417/2866] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 19 15:16:08.301953 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e446e61-b068-4917-8fc9-097b0265d80a admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:16:08.316156 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e446e61-b068-4917-8fc9-097b0265d80a admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:16:08.330012 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15887a20-3313-4114-bf0b-59683ec0ab23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:16:08.330931 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15887a20-3313-4114-bf0b-59683ec0ab23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:08.331475 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15887a20-3313-4114-bf0b-59683ec0ab23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:08.331912 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15887a20-3313-4114-bf0b-59683ec0ab23 admin admin] PATH_INFO: `/v3/projects/467f161ede384306962c46839569a9c1/users/0665507adb954831b484795434b557cb/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:08.358708 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15887a20-3313-4114-bf0b-59683ec0ab23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=467f161ede384306962c46839569a9c1, user_id=0665507adb954831b484795434b557cb, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:16:08.361451 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15887a20-3313-4114-bf0b-59683ec0ab23 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:16:08.374440 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1450/2867] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:16:08 2022] PUT /identity/v3/projects/467f161ede384306962c46839569a9c1/users/0665507adb954831b484795434b557cb/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:16:08.379128 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b5494-79e2-431e-8e5e-245ff6c3587b admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:16:08.394448 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b5494-79e2-431e-8e5e-245ff6c3587b admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:16:08.466589 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2fa0bd-a682-431f-8638-1b484cb11d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:16:08.467319 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fa0bd-a682-431f-8638-1b484cb11d27 admin admin] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:08.467612 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fa0bd-a682-431f-8638-1b484cb11d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:08.467895 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2fa0bd-a682-431f-8638-1b484cb11d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:08.468628 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2fa0bd-a682-431f-8638-1b484cb11d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:16:08.470251 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2fa0bd-a682-431f-8638-1b484cb11d27 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:16:08.482215 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1418/2868] 10.222.0.24 () {58 vars in 1121 bytes} [Thu May 19 15:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 19 15:16:08.486196 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15887a20-3313-4114-bf0b-59683ec0ab23 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:16:08.497479 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15887a20-3313-4114-bf0b-59683ec0ab23 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:16:08.502275 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bafa88a-1150-4d83-b0a4-841d8760f420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:16:08.503148 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafa88a-1150-4d83-b0a4-841d8760f420 admin admin] REQUEST_METHOD: `PUT` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:08.503476 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafa88a-1150-4d83-b0a4-841d8760f420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:08.503752 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafa88a-1150-4d83-b0a4-841d8760f420 admin admin] PATH_INFO: `/v3/projects/467f161ede384306962c46839569a9c1/users/0665507adb954831b484795434b557cb/roles/ec4b73b709ca4cdc983e35e955aed57a` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:08.505724 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bafa88a-1150-4d83-b0a4-841d8760f420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=467f161ede384306962c46839569a9c1, user_id=0665507adb954831b484795434b557cb, role_id=ec4b73b709ca4cdc983e35e955aed57a)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:16:08.508474 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bafa88a-1150-4d83-b0a4-841d8760f420 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:16:08.519554 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1451/2869] 10.222.0.24 () {60 vars in 1482 bytes} [Thu May 19 15:16:08 2022] PUT /identity/v3/projects/467f161ede384306962c46839569a9c1/users/0665507adb954831b484795434b557cb/roles/ec4b73b709ca4cdc983e35e955aed57a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:16:12.954835 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a3d4a-e6bd-49ef-84d8-f7312cce2fc7 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:12.955352 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a3d4a-e6bd-49ef-84d8-f7312cce2fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:12.955454 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a3d4a-e6bd-49ef-84d8-f7312cce2fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:12.981401 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-1c1a3d4a-e6bd-49ef-84d8-f7312cce2fc7 None None] MFA Rules not processed for user `0665507adb954831b484795434b557cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:16:12.982539 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-1c1a3d4a-e6bd-49ef-84d8-f7312cce2fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:16:13.051783 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1419/2870] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:16:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:16:13.064192 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bafa88a-1150-4d83-b0a4-841d8760f420 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:16:13.066030 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-7bafa88a-1150-4d83-b0a4-841d8760f420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:16:13.130839 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bafa88a-1150-4d83-b0a4-841d8760f420 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:16:13.135897 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc8645-63a9-451a-8e88-79a055cec551 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1dc1d74631b4d69a3094e4e1e2a0ebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:16:13.136655 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc8645-63a9-451a-8e88-79a055cec551 service glance] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:13.136942 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc8645-63a9-451a-8e88-79a055cec551 service glance] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:13.137252 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc8645-63a9-451a-8e88-79a055cec551 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:13.164869 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:16:13.200175 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc8645-63a9-451a-8e88-79a055cec551 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:16:13.201637 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc8645-63a9-451a-8e88-79a055cec551 service glance] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:16:13.212544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1452/2871] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:16:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:16:13.313775 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a497c-4414-4079-8805-fa0091700eb0 None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:13.314072 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a497c-4414-4079-8805-fa0091700eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:13.314357 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a497c-4414-4079-8805-fa0091700eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:13.335119 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-ff9a497c-4414-4079-8805-fa0091700eb0 None None] MFA Rules not processed for user `fcd1725924134616b903b3e374d45817`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:16:13.336929 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-ff9a497c-4414-4079-8805-fa0091700eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:16:13.344099 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:16:13.397408 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1420/2872] 10.222.0.24 () {58 vars in 1009 bytes} [Thu May 19 15:16:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:16:13.484132 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc8645-63a9-451a-8e88-79a055cec551 service glance] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:16:13.485555 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-33fc8645-63a9-451a-8e88-79a055cec551 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:16:13.586085 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc8645-63a9-451a-8e88-79a055cec551 service glance] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:16:13.591855 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a44d0-778c-4b48-81ed-677582e05727 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecbeee0c1cf4c58be6c22aa11d7ff5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:16:13.592714 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a44d0-778c-4b48-81ed-677582e05727 service swift] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:13.593203 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a44d0-778c-4b48-81ed-677582e05727 service swift] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:13.593775 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a44d0-778c-4b48-81ed-677582e05727 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:13.603990 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a44d0-778c-4b48-81ed-677582e05727 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:16:13.606180 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a44d0-778c-4b48-81ed-677582e05727 service swift] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:16:13.617354 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1453/2873] 10.222.0.24 () {60 vars in 1384 bytes} [Thu May 19 15:16:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 15:16:22.394477 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4938b2-d449-4275-a765-15b6bc281a8e None None] REQUEST_METHOD: `POST` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:22.395092 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4938b2-d449-4275-a765-15b6bc281a8e None None] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:22.395092 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4938b2-d449-4275-a765-15b6bc281a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:22.413035 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.auth.core [None req-bf4938b2-d449-4275-a765-15b6bc281a8e None None] MFA Rules not processed for user `6c9b6e614944426fb39c3784a21bbf3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80158) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:16:22.414238 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bf4938b2-d449-4275-a765-15b6bc281a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:16:22.421119 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1421/2874] 10.222.0.24 () {58 vars in 957 bytes} [Thu May 19 15:16:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:16:22.674538 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a44d0-778c-4b48-81ed-677582e05727 service swift] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:16:22.726960 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a44d0-778c-4b48-81ed-677582e05727 service swift] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:16:22.730436 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773237a-5141-4972-90a5-29f26c066aa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:16:22.731068 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773237a-5141-4972-90a5-29f26c066aa7 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:22.731392 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773237a-5141-4972-90a5-29f26c066aa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:22.731670 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773237a-5141-4972-90a5-29f26c066aa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:22.733433 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-a773237a-5141-4972-90a5-29f26c066aa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:16:22.743166 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773237a-5141-4972-90a5-29f26c066aa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:16:22.744618 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773237a-5141-4972-90a5-29f26c066aa7 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:16:22.752657 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1454/2875] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:16:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:16:23.067378 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4938b2-d449-4275-a765-15b6bc281a8e None None] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:16:23.068898 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-bf4938b2-d449-4275-a765-15b6bc281a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:16:23.144441 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4938b2-d449-4275-a765-15b6bc281a8e None None] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:16:23.155935 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1040c-0e97-492e-b114-5a45948446f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adec680c4f5f4e6dbe5989d5d7acf620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:16:23.156629 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1040c-0e97-492e-b114-5a45948446f2 service placement] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:23.156915 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1040c-0e97-492e-b114-5a45948446f2 service placement] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:23.157194 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1040c-0e97-492e-b114-5a45948446f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:23.159019 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-cde1040c-0e97-492e-b114-5a45948446f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:16:23.172647 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1040c-0e97-492e-b114-5a45948446f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:16:23.174236 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1040c-0e97-492e-b114-5a45948446f2 service placement] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:16:23.185310 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1422/2876] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:16:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:16:24.332029 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dfc71-54bd-4995-99a7-3c4689705375 None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:24.332535 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dfc71-54bd-4995-99a7-3c4689705375 None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:24.332630 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dfc71-54bd-4995-99a7-3c4689705375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:24.352384 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-339dfc71-54bd-4995-99a7-3c4689705375 None None] MFA Rules not processed for user `fcd1725924134616b903b3e374d45817`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:16:24.353671 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-339dfc71-54bd-4995-99a7-3c4689705375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:16:24.360917 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1455/2877] 10.222.0.24 () {58 vars in 1009 bytes} [Thu May 19 15:16:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:16:24.374294 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1040c-0e97-492e-b114-5a45948446f2 service placement] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:16:24.388312 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1040c-0e97-492e-b114-5a45948446f2 service placement] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:16:24.394517 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8128c99-4409-4b91-84bc-95e9e070ef9c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecbeee0c1cf4c58be6c22aa11d7ff5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:16:24.394735 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8128c99-4409-4b91-84bc-95e9e070ef9c service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:24.395025 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8128c99-4409-4b91-84bc-95e9e070ef9c service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:24.395550 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8128c99-4409-4b91-84bc-95e9e070ef9c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:24.404675 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8128c99-4409-4b91-84bc-95e9e070ef9c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:16:24.406283 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8128c99-4409-4b91-84bc-95e9e070ef9c service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:16:24.415014 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1423/2878] 10.222.0.24 () {60 vars in 1384 bytes} [Thu May 19 15:16:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 15:16:32.294601 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339dfc71-54bd-4995-99a7-3c4689705375 None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:16:32.304539 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339dfc71-54bd-4995-99a7-3c4689705375 None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:16:32.308116 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466f906-6fe3-434a-afd4-b219a0bdc370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:16:32.308752 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466f906-6fe3-434a-afd4-b219a0bdc370 service neutron] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:32.309045 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466f906-6fe3-434a-afd4-b219a0bdc370 service neutron] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:32.309327 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466f906-6fe3-434a-afd4-b219a0bdc370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:32.311268 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f466f906-6fe3-434a-afd4-b219a0bdc370 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:16:32.321819 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466f906-6fe3-434a-afd4-b219a0bdc370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:16:32.323304 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466f906-6fe3-434a-afd4-b219a0bdc370 service neutron] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:16:32.331813 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1456/2879] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:16:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:16:33.304960 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8128c99-4409-4b91-84bc-95e9e070ef9c service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:16:33.307570 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-e8128c99-4409-4b91-84bc-95e9e070ef9c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:16:33.423518 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8128c99-4409-4b91-84bc-95e9e070ef9c service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:16:33.430092 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91872a-3209-4997-8a55-c43e97f37135 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:16:33.430967 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91872a-3209-4997-8a55-c43e97f37135 service nova] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:33.431354 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91872a-3209-4997-8a55-c43e97f37135 service nova] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:33.431711 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91872a-3209-4997-8a55-c43e97f37135 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:33.433631 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-aa91872a-3209-4997-8a55-c43e97f37135 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:16:33.447694 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91872a-3209-4997-8a55-c43e97f37135 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:16:33.449333 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91872a-3209-4997-8a55-c43e97f37135 service nova] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:16:33.471548 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1424/2880] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:16:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:16:37.450847 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466f906-6fe3-434a-afd4-b219a0bdc370 service neutron] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:16:37.452395 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-f466f906-6fe3-434a-afd4-b219a0bdc370 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:16:37.471837 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466f906-6fe3-434a-afd4-b219a0bdc370 service neutron] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:16:37.477556 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfba3e-041f-4fa3-a9d1-6f994eff4a44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06fb8bb5aeb143ad95f33c3b43dbd346', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:16:37.478265 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfba3e-041f-4fa3-a9d1-6f994eff4a44 service nova] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:37.478544 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfba3e-041f-4fa3-a9d1-6f994eff4a44 service nova] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:37.478825 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfba3e-041f-4fa3-a9d1-6f994eff4a44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:37.481052 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-fccfba3e-041f-4fa3-a9d1-6f994eff4a44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:16:37.494809 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccfba3e-041f-4fa3-a9d1-6f994eff4a44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:16:37.496789 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccfba3e-041f-4fa3-a9d1-6f994eff4a44 service nova] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:16:37.507933 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1457/2881] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:16:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:16:43.462481 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=95 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:16:47.503799 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:16:48.902433 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91872a-3209-4997-8a55-c43e97f37135 service nova] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:16:48.911742 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91872a-3209-4997-8a55-c43e97f37135 service nova] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:16:48.915343 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17875c-2d5d-45fd-9a7b-9baeb0b6589b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d089b5ee94e441ebbd084c2581a42df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:16:48.915982 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17875c-2d5d-45fd-9a7b-9baeb0b6589b service neutron] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:16:48.916272 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17875c-2d5d-45fd-9a7b-9baeb0b6589b service neutron] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:16:48.916553 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17875c-2d5d-45fd-9a7b-9baeb0b6589b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:16:48.925394 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be17875c-2d5d-45fd-9a7b-9baeb0b6589b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:16:48.926751 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be17875c-2d5d-45fd-9a7b-9baeb0b6589b service neutron] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:16:48.936820 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1425/2882] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:16:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:16:58.932618 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=6 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:18:13.090584 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9109a-8495-405c-b728-d4569fe77fad None None] REQUEST_METHOD: `POST` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:18:13.091074 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9109a-8495-405c-b728-d4569fe77fad None None] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:18:13.091190 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9109a-8495-405c-b728-d4569fe77fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:18:13.128608 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.auth.core [None req-5dd9109a-8495-405c-b728-d4569fe77fad None None] MFA Rules not processed for user `fcd1725924134616b903b3e374d45817`. Rule list: `[]` (Enabled: `True`). {{(pid=80157) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 19 15:18:13.129802 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5dd9109a-8495-405c-b728-d4569fe77fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:18:13.162613 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1458/2883] 10.222.0.24 () {58 vars in 967 bytes} [Thu May 19 15:18:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 19 15:18:13.202351 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17875c-2d5d-45fd-9a7b-9baeb0b6589b service neutron] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:18:13.244042 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17875c-2d5d-45fd-9a7b-9baeb0b6589b service neutron] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:18:13.254178 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bd27a-7570-409d-8ef9-2503c0cc5036 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecbeee0c1cf4c58be6c22aa11d7ff5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:18:13.254837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bd27a-7570-409d-8ef9-2503c0cc5036 service swift] REQUEST_METHOD: `GET` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:18:13.255126 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bd27a-7570-409d-8ef9-2503c0cc5036 service swift] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:18:13.255435 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bd27a-7570-409d-8ef9-2503c0cc5036 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:18:13.264190 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6bd27a-7570-409d-8ef9-2503c0cc5036 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:18:13.265727 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6bd27a-7570-409d-8ef9-2503c0cc5036 service swift] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:18:13.273854 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1426/2884] 10.222.0.24 () {60 vars in 1384 bytes} [Thu May 19 15:18:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 19 15:18:19.780311 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9109a-8495-405c-b728-d4569fe77fad None None] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:18:19.865529 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9109a-8495-405c-b728-d4569fe77fad None None] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:18:19.870467 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459e54e-6545-47b9-9f2c-bb20c825d4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:18:19.871988 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459e54e-6545-47b9-9f2c-bb20c825d4a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:18:19.872274 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459e54e-6545-47b9-9f2c-bb20c825d4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:18:19.872551 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459e54e-6545-47b9-9f2c-bb20c825d4a2 admin admin] PATH_INFO: `/v3/users/6c9b6e614944426fb39c3784a21bbf3b` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:18:19.874226 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459e54e-6545-47b9-9f2c-bb20c825d4a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c9b6e614944426fb39c3784a21bbf3b)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:18:19.876229 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459e54e-6545-47b9-9f2c-bb20c825d4a2 admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:18:19.926609 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5459e54e-6545-47b9-9f2c-bb20c825d4a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c9b6e614944426fb39c3784a21bbf3b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:18:19.927290 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5459e54e-6545-47b9-9f2c-bb20c825d4a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c9b6e614944426fb39c3784a21bbf3b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:18:19.927917 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5459e54e-6545-47b9-9f2c-bb20c825d4a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c9b6e614944426fb39c3784a21bbf3b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:18:19.935927 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5459e54e-6545-47b9-9f2c-bb20c825d4a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c9b6e614944426fb39c3784a21bbf3b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:18:19.947788 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-5459e54e-6545-47b9-9f2c-bb20c825d4a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c9b6e614944426fb39c3784a21bbf3b'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:18:19.959715 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1459/2885] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:18:19 2022] DELETE /identity/v3/users/6c9b6e614944426fb39c3784a21bbf3b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:18:20.135185 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bd27a-7570-409d-8ef9-2503c0cc5036 service swift] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:18:20.149944 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bd27a-7570-409d-8ef9-2503c0cc5036 service swift] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:18:20.207078 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42481987-99c6-4f34-9384-eedd6f20dad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:18:20.208000 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42481987-99c6-4f34-9384-eedd6f20dad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:18:20.208291 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42481987-99c6-4f34-9384-eedd6f20dad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:18:20.208571 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42481987-99c6-4f34-9384-eedd6f20dad3 admin admin] PATH_INFO: `/v3/projects/75c950a99db0449d914183ad7ca845a7` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:18:20.209748 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42481987-99c6-4f34-9384-eedd6f20dad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75c950a99db0449d914183ad7ca845a7)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:18:20.211735 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42481987-99c6-4f34-9384-eedd6f20dad3 admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:18:20.258301 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-42481987-99c6-4f34-9384-eedd6f20dad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75c950a99db0449d914183ad7ca845a7', 'request_id': 'req-42481987-99c6-4f34-9384-eedd6f20dad3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:18:20.266212 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-42481987-99c6-4f34-9384-eedd6f20dad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75c950a99db0449d914183ad7ca845a7', 'request_id': 'req-42481987-99c6-4f34-9384-eedd6f20dad3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:18:20.272341 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-42481987-99c6-4f34-9384-eedd6f20dad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75c950a99db0449d914183ad7ca845a7', 'request_id': 'req-42481987-99c6-4f34-9384-eedd6f20dad3'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:18:20.294961 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-42481987-99c6-4f34-9384-eedd6f20dad3 admin admin] The token cache is being invalidate because project 75c950a99db0449d914183ad7ca845a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:18:20.295271 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-42481987-99c6-4f34-9384-eedd6f20dad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:18:20.295891 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-42481987-99c6-4f34-9384-eedd6f20dad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:18:20.297490 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1427/2886] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:18:20 2022] DELETE /identity/v3/projects/75c950a99db0449d914183ad7ca845a7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 19 15:18:20.301533 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459e54e-6545-47b9-9f2c-bb20c825d4a2 admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:18:20.302929 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-5459e54e-6545-47b9-9f2c-bb20c825d4a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:18:20.315718 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459e54e-6545-47b9-9f2c-bb20c825d4a2 admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:18:20.323419 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:18:20.379828 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4313a-e2e1-4f99-a910-cf9758fb5c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:18:20.380705 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4313a-e2e1-4f99-a910-cf9758fb5c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:18:20.380983 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4313a-e2e1-4f99-a910-cf9758fb5c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:18:20.381255 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4313a-e2e1-4f99-a910-cf9758fb5c5b admin admin] PATH_INFO: `/v3/users/0665507adb954831b484795434b557cb` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:18:20.382759 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4313a-e2e1-4f99-a910-cf9758fb5c5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0665507adb954831b484795434b557cb)` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:18:20.384858 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4313a-e2e1-4f99-a910-cf9758fb5c5b admin admin] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:18:20.430390 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c2e4313a-e2e1-4f99-a910-cf9758fb5c5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0665507adb954831b484795434b557cb'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:18:20.431037 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c2e4313a-e2e1-4f99-a910-cf9758fb5c5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0665507adb954831b484795434b557cb'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:18:20.431683 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c2e4313a-e2e1-4f99-a910-cf9758fb5c5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0665507adb954831b484795434b557cb'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:18:20.438621 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c2e4313a-e2e1-4f99-a910-cf9758fb5c5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0665507adb954831b484795434b557cb'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:18:20.450651 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.notifications [None req-c2e4313a-e2e1-4f99-a910-cf9758fb5c5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0665507adb954831b484795434b557cb'} {{(pid=80157) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:18:20.462638 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1460/2887] 10.222.0.24 () {58 vars in 1223 bytes} [Thu May 19 15:18:20 2022] DELETE /identity/v3/users/0665507adb954831b484795434b557cb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:18:20.634841 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42481987-99c6-4f34-9384-eedd6f20dad3 admin admin] Authenticating user token {{(pid=80158) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:18:20.636605 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.fernet_utils [None req-42481987-99c6-4f34-9384-eedd6f20dad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80158) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:18:20.651997 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42481987-99c6-4f34-9384-eedd6f20dad3 admin admin] Validating token access rules against request {{(pid=80158) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:18:20.685212 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:18:20.711243 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429247b-c757-4c48-a4c2-dcbbafeba53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83eec44e6acd4004ba2088801e9d8f88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55b46daee5c44a5cacdc54e48d280e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80158) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:18:20.712110 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429247b-c757-4c48-a4c2-dcbbafeba53b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:18:20.712396 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429247b-c757-4c48-a4c2-dcbbafeba53b admin admin] SCRIPT_NAME: `/identity` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:18:20.712674 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429247b-c757-4c48-a4c2-dcbbafeba53b admin admin] PATH_INFO: `/v3/projects/467f161ede384306962c46839569a9c1` {{(pid=80158) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:18:20.713837 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8429247b-c757-4c48-a4c2-dcbbafeba53b admin admin] RBAC: Authorizing `identity:delete_project(project_id=467f161ede384306962c46839569a9c1)` {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:18:20.716385 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8429247b-c757-4c48-a4c2-dcbbafeba53b admin admin] RBAC: Authorization granted {{(pid=80158) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:18:20.759963 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8429247b-c757-4c48-a4c2-dcbbafeba53b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '467f161ede384306962c46839569a9c1', 'request_id': 'req-8429247b-c757-4c48-a4c2-dcbbafeba53b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:18:20.768456 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8429247b-c757-4c48-a4c2-dcbbafeba53b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '467f161ede384306962c46839569a9c1', 'request_id': 'req-8429247b-c757-4c48-a4c2-dcbbafeba53b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:18:20.774587 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8429247b-c757-4c48-a4c2-dcbbafeba53b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '467f161ede384306962c46839569a9c1', 'request_id': 'req-8429247b-c757-4c48-a4c2-dcbbafeba53b'} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:18:20.785442 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8429247b-c757-4c48-a4c2-dcbbafeba53b admin admin] The token cache is being invalidate because project 467f161ede384306962c46839569a9c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80158) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 19 15:18:20.785728 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8429247b-c757-4c48-a4c2-dcbbafeba53b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:18:20.786387 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG keystone.notifications [None req-8429247b-c757-4c48-a4c2-dcbbafeba53b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80158) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 19 15:18:20.787912 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: [pid: 80158|app: 0|req: 1428/2888] 10.222.0.24 () {58 vars in 1232 bytes} [Thu May 19 15:18:20 2022] DELETE /identity/v3/projects/467f161ede384306962c46839569a9c1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 19 15:18:30.459010 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=48,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:18:30.782521 dv-cinder-825492-12-iscsi devstack@keystone.service[80158]: DEBUG dbcounter [-] [80158] Writing DB stats keystone:SELECT=35,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:18:43.160972 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4313a-e2e1-4f99-a910-cf9758fb5c5b admin admin] Authenticating user token {{(pid=80157) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 19 15:18:43.162371 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-c2e4313a-e2e1-4f99-a910-cf9758fb5c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:18:43.250598 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4313a-e2e1-4f99-a910-cf9758fb5c5b admin admin] Validating token access rules against request {{(pid=80157) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 19 15:18:43.306638 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc52cb6-c276-4f23-891f-f1b6c87c3dbb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adec680c4f5f4e6dbe5989d5d7acf620', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2633b53c336145bba3d4744dbdfe99b7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80157) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 19 15:18:43.307303 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc52cb6-c276-4f23-891f-f1b6c87c3dbb service placement] REQUEST_METHOD: `GET` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 19 15:18:43.307598 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc52cb6-c276-4f23-891f-f1b6c87c3dbb service placement] SCRIPT_NAME: `/identity` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 19 15:18:43.307874 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc52cb6-c276-4f23-891f-f1b6c87c3dbb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80157) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 19 15:18:43.310141 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.fernet_utils [None req-ccc52cb6-c276-4f23-891f-f1b6c87c3dbb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80157) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 19 15:18:43.321373 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc52cb6-c276-4f23-891f-f1b6c87c3dbb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 19 15:18:43.322954 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc52cb6-c276-4f23-891f-f1b6c87c3dbb service placement] RBAC: Authorization granted {{(pid=80157) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 19 15:18:43.333935 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: [pid: 80157|app: 0|req: 1461/2889] 10.222.0.24 () {60 vars in 1365 bytes} [Thu May 19 15:18:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 19 15:18:53.329299 dv-cinder-825492-12-iscsi devstack@keystone.service[80157]: DEBUG dbcounter [-] [80157] Writing DB stats keystone:SELECT=67 {{(pid=80157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}